Aug 03 04:36:31 user nova-compute[72444]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 03 04:36:33 user nova-compute[72444]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72444) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 03 04:36:33 user nova-compute[72444]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72444) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 03 04:36:33 user nova-compute[72444]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72444) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 03 04:36:33 user nova-compute[72444]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 03 04:36:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:36:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:36:34 user nova-compute[72444]: INFO nova.virt.driver [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 03 04:36:34 user nova-compute[72444]: INFO nova.compute.provider_config [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] Acquiring lock "singleton_lock" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] Acquired lock "singleton_lock" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] Releasing lock "singleton_lock" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] Full set of CONF: {{(pid=72444) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] ******************************************************************************** {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] Configuration options gathered from: {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] ================================================================================ {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] allow_resize_to_same_host      = True {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] arq_binding_timeout            = 300 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] backdoor_port                  = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] backdoor_socket                = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] block_device_allocate_retries  = 300 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] block_device_allocate_retries_interval = 5 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cert                           = self.pem {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] compute_monitors               = [] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] config_dir                     = [] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] config_drive_format            = iso9660 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] config_source                  = [] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] console_host                   = user {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] control_exchange               = nova {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cpu_allocation_ratio           = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] daemon                         = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] debug                          = True {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] default_access_ip_network_name = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] default_availability_zone      = nova {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] default_ephemeral_format       = ext4 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] default_schedule_zone          = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] disk_allocation_ratio          = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] enable_new_services            = True {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] enabled_apis                   = ['osapi_compute'] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] enabled_ssl_apis               = [] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] flat_injected                  = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] force_config_drive             = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] force_raw_images               = True {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] graceful_shutdown_timeout      = 5 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] heal_instance_info_cache_interval = 60 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] host                           = user {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] instance_build_timeout         = 0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] instance_delete_interval       = 300 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] instance_format                = [instance: %(uuid)s]  {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] instance_name_template         = instance-%08x {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] instance_usage_audit           = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] instance_usage_audit_period    = month {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] internal_service_availability_zone = internal {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] key                            = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] live_migration_retry_count     = 30 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] log_config_append              = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] log_dir                        = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] log_file                       = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] log_options                    = True {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] log_rotate_interval            = 1 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] log_rotate_interval_type       = days {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] log_rotation_type              = none {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] long_rpc_timeout               = 1800 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] max_concurrent_builds          = 10 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] max_concurrent_live_migrations = 1 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] max_concurrent_snapshots       = 5 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] max_local_block_devices        = 3 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] max_logfile_count              = 30 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] max_logfile_size_mb            = 200 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] maximum_instance_delete_attempts = 5 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] metadata_listen                = 0.0.0.0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] metadata_listen_port           = 8775 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] metadata_workers               = 3 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] migrate_max_retries            = -1 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] mkisofs_cmd                    = genisoimage {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] my_ip                          = 10.0.0.210 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] network_allocate_retries       = 0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] osapi_compute_listen_port      = 8774 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] osapi_compute_unique_server_name_scope =  {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] osapi_compute_workers          = 3 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] password_length                = 12 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] periodic_enable                = True {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] periodic_fuzzy_delay           = 60 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] pointer_model                  = ps2mouse {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] preallocate_images             = none {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] publish_errors                 = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] pybasedir                      = /opt/stack/nova {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] ram_allocation_ratio           = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] rate_limit_burst               = 0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] rate_limit_except_level        = CRITICAL {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] rate_limit_interval            = 0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] reboot_timeout                 = 0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] reclaim_instance_interval      = 0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] record                         = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] reimage_timeout_per_gb         = 60 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] report_interval                = 10 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] rescue_timeout                 = 0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] reserved_host_cpus             = 0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] reserved_host_disk_mb          = 0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] reserved_host_memory_mb        = 512 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] reserved_huge_pages            = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] resize_confirm_window          = 0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] resize_fs_using_block_device   = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] resume_guests_state_on_host_boot = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] rpc_response_timeout           = 60 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] run_external_periodic_tasks    = True {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] running_deleted_instance_action = reap {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] running_deleted_instance_poll_interval = 1800 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] running_deleted_instance_timeout = 0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] scheduler_instance_sync_interval = 120 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] service_down_time              = 60 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] servicegroup_driver            = db {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] shelved_offload_time           = 0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] shelved_poll_interval          = 3600 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] shutdown_timeout               = 0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] source_is_ipv6                 = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] ssl_only                       = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] state_path                     = /opt/stack/data/nova {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] sync_power_state_interval      = 600 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] sync_power_state_pool_size     = 1000 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] syslog_log_facility            = LOG_USER {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] tempdir                        = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] timeout_nbd                    = 10 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] transport_url                  = **** {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] update_resources_interval      = 0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] use_cow_images                 = True {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] use_eventlog                   = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] use_journal                    = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] use_json                       = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] use_rootwrap_daemon            = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] use_stderr                     = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] use_syslog                     = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vcpu_pin_set                   = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vif_plugging_is_fatal          = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vif_plugging_timeout           = 0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] virt_mkfs                      = [] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] volume_usage_poll_interval     = 0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] watch_log_file                 = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] web                            = /usr/share/spice-html5 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_concurrency.disable_process_locking = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api.auth_strategy              = keystone {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api.compute_link_prefix        = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api.dhcp_domain                = novalocal {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api.enable_instance_password   = True {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api.glance_link_prefix         = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api.instance_list_per_project_cells = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api.list_records_by_skipping_down_cells = True {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api.local_metadata_per_cell    = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api.max_limit                  = 1000 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api.metadata_cache_expiration  = 15 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api.neutron_default_tenant_id  = default {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api.use_forwarded_for          = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api.use_neutron_default_nets   = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api.vendordata_dynamic_targets = [] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api.vendordata_jsonfile_path   = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cache.backend                  = dogpile.cache.memcached {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cache.backend_argument         = **** {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cache.config_prefix            = cache.oslo {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cache.dead_timeout             = 60.0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cache.debug_cache_backend      = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cache.enable_retry_client      = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cache.enable_socket_keepalive  = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cache.enabled                  = True {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cache.expiration_time          = 600 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cache.hashclient_retry_attempts = 2 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cache.memcache_dead_retry      = 300 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cache.memcache_password        =  {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cache.memcache_pool_maxsize    = 10 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cache.memcache_sasl_enabled    = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cache.memcache_username        =  {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cache.proxies                  = [] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cache.retry_attempts           = 2 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cache.retry_delay              = 0.0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cache.socket_keepalive_count   = 1 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cache.socket_keepalive_idle    = 1 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cache.socket_keepalive_interval = 1 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cache.tls_allowed_ciphers      = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cache.tls_cafile               = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cache.tls_certfile             = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cache.tls_enabled              = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cache.tls_keyfile              = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cinder.auth_section            = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cinder.auth_type               = password {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cinder.cafile                  = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cinder.certfile                = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cinder.collect_timing          = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cinder.cross_az_attach         = True {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cinder.debug                   = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cinder.endpoint_template       = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cinder.http_retries            = 3 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cinder.insecure                = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cinder.keyfile                 = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cinder.os_region_name          = RegionOne {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cinder.split_loggers           = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cinder.timeout                 = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] compute.cpu_dedicated_set      = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] compute.cpu_shared_set         = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] compute.image_type_exclude_list = [] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] compute.max_concurrent_disk_ops = 0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] compute.max_disk_devices_to_attach = -1 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] compute.resource_provider_association_refresh = 300 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] compute.shutdown_retry_interval = 10 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] conductor.workers              = 3 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] console.allowed_origins        = [] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] console.ssl_ciphers            = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] console.ssl_minimum_version    = default {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] consoleauth.token_ttl          = 600 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cyborg.cafile                  = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cyborg.certfile                = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cyborg.collect_timing          = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cyborg.connect_retries         = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cyborg.connect_retry_delay     = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cyborg.endpoint_override       = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cyborg.insecure                = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cyborg.keyfile                 = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cyborg.max_version             = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cyborg.min_version             = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cyborg.region_name             = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cyborg.service_name            = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cyborg.service_type            = accelerator {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cyborg.split_loggers           = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cyborg.status_code_retries     = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cyborg.status_code_retry_delay = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cyborg.timeout                 = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] cyborg.version                 = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] database.backend               = sqlalchemy {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] database.connection            = **** {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] database.connection_debug      = 0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] database.connection_parameters =  {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] database.connection_recycle_time = 3600 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] database.connection_trace      = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] database.db_inc_retry_interval = True {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] database.db_max_retries        = 20 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] database.db_max_retry_interval = 10 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] database.db_retry_interval     = 1 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] database.max_overflow          = 50 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] database.max_pool_size         = 5 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] database.max_retries           = 10 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] database.mysql_enable_ndb      = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] database.mysql_wsrep_sync_wait = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] database.pool_timeout          = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] database.retry_interval        = 10 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] database.slave_connection      = **** {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] database.sqlite_synchronous    = True {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api_database.backend           = sqlalchemy {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api_database.connection        = **** {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api_database.connection_debug  = 0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api_database.connection_parameters =  {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api_database.connection_recycle_time = 3600 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api_database.connection_trace  = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api_database.db_inc_retry_interval = True {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api_database.db_max_retries    = 20 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api_database.db_max_retry_interval = 10 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api_database.db_retry_interval = 1 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api_database.max_overflow      = 50 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api_database.max_pool_size     = 5 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api_database.max_retries       = 10 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api_database.mysql_enable_ndb  = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api_database.pool_timeout      = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api_database.retry_interval    = 10 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api_database.slave_connection  = **** {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] api_database.sqlite_synchronous = True {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] devices.enabled_mdev_types     = [] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] ephemeral_storage_encryption.enabled = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] glance.api_servers             = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] glance.cafile                  = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] glance.certfile                = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] glance.collect_timing          = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] glance.connect_retries         = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] glance.connect_retry_delay     = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] glance.debug                   = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] glance.default_trusted_certificate_ids = [] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] glance.enable_certificate_validation = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] glance.enable_rbd_download     = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] glance.endpoint_override       = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] glance.insecure                = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] glance.keyfile                 = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] glance.max_version             = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] glance.min_version             = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] glance.num_retries             = 3 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] glance.rbd_ceph_conf           =  {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] glance.rbd_connect_timeout     = 5 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] glance.rbd_pool                =  {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] glance.rbd_user                =  {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] glance.region_name             = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] glance.service_name            = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] glance.service_type            = image {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] glance.split_loggers           = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] glance.status_code_retries     = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] glance.status_code_retry_delay = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] glance.timeout                 = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] glance.verify_glance_signatures = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] glance.version                 = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] guestfs.debug                  = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] hyperv.config_drive_cdrom      = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] hyperv.config_drive_inject_password = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] hyperv.enable_instance_metrics_collection = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] hyperv.enable_remotefx         = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] hyperv.instances_path_share    =  {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] hyperv.iscsi_initiator_list    = [] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] hyperv.limit_cpu_features      = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] hyperv.power_state_check_timeframe = 60 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] hyperv.use_multipath_io        = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] hyperv.volume_attach_retry_count = 10 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] hyperv.vswitch_name            = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] mks.enabled                    = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] image_cache.manager_interval   = 2400 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] image_cache.precache_concurrency = 1 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] image_cache.remove_unused_base_images = True {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] image_cache.subdirectory_name  = _base {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] ironic.api_max_retries         = 60 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] ironic.api_retry_interval      = 2 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] ironic.auth_section            = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] ironic.auth_type               = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] ironic.cafile                  = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] ironic.certfile                = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] ironic.collect_timing          = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] ironic.connect_retries         = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] ironic.connect_retry_delay     = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] ironic.endpoint_override       = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] ironic.insecure                = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] ironic.keyfile                 = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] ironic.max_version             = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] ironic.min_version             = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] ironic.partition_key           = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] ironic.peer_list               = [] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] ironic.region_name             = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] ironic.serial_console_state_timeout = 10 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] ironic.service_name            = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] ironic.service_type            = baremetal {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] ironic.split_loggers           = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] ironic.status_code_retries     = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] ironic.status_code_retry_delay = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] ironic.timeout                 = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] ironic.version                 = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] key_manager.fixed_key          = **** {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] barbican.barbican_api_version  = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] barbican.barbican_endpoint     = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] barbican.barbican_endpoint_type = public {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] barbican.barbican_region_name  = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] barbican.cafile                = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] barbican.certfile              = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] barbican.collect_timing        = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] barbican.insecure              = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] barbican.keyfile               = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] barbican.number_of_retries     = 60 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] barbican.retry_delay           = 1 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] barbican.send_service_user_token = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] barbican.split_loggers         = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] barbican.timeout               = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] barbican.verify_ssl            = True {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] barbican.verify_ssl_path       = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] barbican_service_user.auth_section = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] barbican_service_user.auth_type = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] barbican_service_user.cafile   = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] barbican_service_user.certfile = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] barbican_service_user.collect_timing = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] barbican_service_user.insecure = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] barbican_service_user.keyfile  = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] barbican_service_user.split_loggers = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] barbican_service_user.timeout  = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vault.approle_role_id          = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vault.approle_secret_id        = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vault.cafile                   = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vault.certfile                 = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vault.collect_timing           = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vault.insecure                 = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vault.keyfile                  = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vault.kv_mountpoint            = secret {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vault.kv_version               = 2 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vault.namespace                = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vault.root_token_id            = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vault.split_loggers            = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vault.ssl_ca_crt_file          = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vault.timeout                  = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vault.use_ssl                  = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] keystone.cafile                = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] keystone.certfile              = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] keystone.collect_timing        = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] keystone.connect_retries       = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] keystone.connect_retry_delay   = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] keystone.endpoint_override     = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] keystone.insecure              = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] keystone.keyfile               = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] keystone.max_version           = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] keystone.min_version           = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] keystone.region_name           = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] keystone.service_name          = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] keystone.service_type          = identity {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] keystone.split_loggers         = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] keystone.status_code_retries   = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] keystone.status_code_retry_delay = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] keystone.timeout               = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] keystone.version               = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.connection_uri         =  {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.cpu_mode               = custom {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: WARNING oslo_config.cfg [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.cpu_power_governor_high = performance {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.cpu_power_governor_low = powersave {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.cpu_power_management   = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.device_detach_attempts = 8 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.device_detach_timeout  = 20 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.disk_cachemodes        = [] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.disk_prefix            = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.enabled_perf_events    = [] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.file_backed_memory     = 0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.gid_maps               = [] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.hw_disk_discard        = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.hw_machine_type        = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.images_rbd_glance_store_name =  {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.images_rbd_pool        = rbd {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.images_type            = default {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.images_volume_group    = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.inject_key             = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.inject_partition       = -2 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.inject_password        = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.iscsi_iface            = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.iser_use_multipath     = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.live_migration_bandwidth = 0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.live_migration_downtime = 500 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.live_migration_inbound_addr = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.live_migration_permit_post_copy = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.live_migration_scheme  = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.live_migration_timeout_action = abort {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.live_migration_tunnelled = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: WARNING oslo_config.cfg [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 03 04:36:34 user nova-compute[72444]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 03 04:36:34 user nova-compute[72444]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 03 04:36:34 user nova-compute[72444]: and ``live_migration_inbound_addr`` respectively.
Aug 03 04:36:34 user nova-compute[72444]: ).  Its value may be silently ignored in the future.
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.live_migration_with_native_tls = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.max_queues             = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.nfs_mount_options      = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.num_memory_encrypted_guests = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.num_pcie_ports         = 0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.pmem_namespaces        = [] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.quobyte_client_cfg     = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.rbd_secret_uuid        = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.rbd_user               = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.remote_filesystem_transport = ssh {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.rescue_image_id        = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.rescue_kernel_id       = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.rescue_ramdisk_id      = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.rx_queue_size          = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.smbfs_mount_options    =  {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.snapshot_compression   = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.snapshot_image_format  = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.sparse_logical_volumes = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.swtpm_enabled          = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.swtpm_group            = tss {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.swtpm_user             = tss {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.sysinfo_serial         = unique {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.tb_cache_size          = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.tx_queue_size          = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.uid_maps               = [] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.use_virtio_for_bridges = True {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.virt_type              = kvm {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.volume_clear           = zero {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.volume_clear_size      = 0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.volume_use_multipath   = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.vzstorage_cache_path   = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.vzstorage_mount_user   = stack {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] neutron.auth_section           = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] neutron.auth_type              = password {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] neutron.cafile                 = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] neutron.certfile               = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] neutron.collect_timing         = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] neutron.connect_retries        = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] neutron.connect_retry_delay    = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] neutron.default_floating_pool  = public {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] neutron.endpoint_override      = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] neutron.extension_sync_interval = 600 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] neutron.http_retries           = 3 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] neutron.insecure               = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] neutron.keyfile                = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] neutron.max_version            = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] neutron.min_version            = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] neutron.ovs_bridge             = br-int {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] neutron.physnets               = [] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] neutron.region_name            = RegionOne {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] neutron.service_metadata_proxy = True {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] neutron.service_name           = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] neutron.service_type           = network {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] neutron.split_loggers          = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] neutron.status_code_retries    = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] neutron.status_code_retry_delay = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] neutron.timeout                = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] neutron.version                = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] notifications.bdms_in_notifications = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] notifications.default_level    = INFO {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] notifications.notification_format = unversioned {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] notifications.notify_on_state_change = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] pci.alias                      = [] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] pci.device_spec                = [] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] pci.report_in_placement        = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] placement.auth_section         = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] placement.auth_type            = password {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] placement.cafile               = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] placement.certfile             = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] placement.collect_timing       = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] placement.connect_retries      = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] placement.connect_retry_delay  = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] placement.default_domain_id    = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] placement.default_domain_name  = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] placement.domain_id            = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] placement.domain_name          = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] placement.endpoint_override    = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] placement.insecure             = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] placement.keyfile              = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] placement.max_version          = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] placement.min_version          = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] placement.password             = **** {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] placement.project_domain_id    = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] placement.project_domain_name  = Default {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] placement.project_id           = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] placement.project_name         = service {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] placement.region_name          = RegionOne {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] placement.service_name         = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] placement.service_type         = placement {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] placement.split_loggers        = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] placement.status_code_retries  = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] placement.status_code_retry_delay = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] placement.system_scope         = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] placement.timeout              = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] placement.trust_id             = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] placement.user_domain_id       = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] placement.user_domain_name     = Default {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] placement.user_id              = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] placement.username             = placement {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] placement.version              = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] quota.cores                    = 20 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] quota.count_usage_from_placement = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] quota.injected_file_content_bytes = 10240 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] quota.injected_file_path_length = 255 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] quota.injected_files           = 5 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] quota.instances                = 10 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] quota.key_pairs                = 100 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] quota.metadata_items           = 128 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] quota.ram                      = 51200 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] quota.recheck_quota            = True {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] quota.server_group_members     = 10 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] quota.server_groups            = 10 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] rdp.enabled                    = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] scheduler.image_metadata_prefilter = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] scheduler.max_attempts         = 3 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] scheduler.max_placement_results = 1000 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] scheduler.query_placement_for_availability_zone = True {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] scheduler.query_placement_for_image_type_support = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] scheduler.workers              = 3 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] filter_scheduler.host_subset_size = 1 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] filter_scheduler.isolated_hosts = [] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] filter_scheduler.isolated_images = [] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] filter_scheduler.pci_in_placement = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] filter_scheduler.track_instance_changes = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] metrics.required               = True {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] metrics.weight_multiplier      = 1.0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] metrics.weight_setting         = [] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] serial_console.enabled         = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] serial_console.port_range      = 10000:20000 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] serial_console.serialproxy_port = 6083 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] service_user.auth_section      = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] service_user.auth_type         = password {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] service_user.cafile            = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] service_user.certfile          = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] service_user.collect_timing    = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] service_user.insecure          = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] service_user.keyfile           = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] service_user.send_service_user_token = True {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] service_user.split_loggers     = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] service_user.timeout           = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] spice.agent_enabled            = True {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] spice.enabled                  = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] spice.html5proxy_port          = 6082 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] spice.image_compression        = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] spice.jpeg_compression         = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] spice.playback_compression     = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] spice.server_listen            = 127.0.0.1 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] spice.streaming_mode           = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] spice.zlib_compression         = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] upgrade_levels.baseapi         = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] upgrade_levels.cert            = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] upgrade_levels.compute         = auto {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] upgrade_levels.conductor       = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] upgrade_levels.scheduler       = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vendordata_dynamic_auth.auth_section = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vendordata_dynamic_auth.auth_type = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vendordata_dynamic_auth.cafile = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vendordata_dynamic_auth.certfile = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vendordata_dynamic_auth.insecure = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vendordata_dynamic_auth.keyfile = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vendordata_dynamic_auth.timeout = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vmware.api_retry_count         = 10 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vmware.ca_file                 = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vmware.cache_prefix            = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vmware.cluster_name            = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vmware.connection_pool_size    = 10 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vmware.console_delay_seconds   = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vmware.datastore_regex         = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vmware.host_ip                 = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vmware.host_password           = **** {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vmware.host_port               = 443 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vmware.host_username           = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vmware.insecure                = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vmware.integration_bridge      = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vmware.maximum_objects         = 100 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vmware.pbm_default_policy      = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vmware.pbm_enabled             = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vmware.pbm_wsdl_location       = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vmware.serial_port_proxy_uri   = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vmware.serial_port_service_uri = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vmware.task_poll_interval      = 0.5 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vmware.use_linked_clone        = True {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vmware.vnc_keymap              = en-us {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vmware.vnc_port                = 5900 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vmware.vnc_port_total          = 10000 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vnc.auth_schemes               = ['none'] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vnc.enabled                    = True {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vnc.novncproxy_port            = 6080 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vnc.server_listen              = 0.0.0.0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vnc.vencrypt_ca_certs          = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vnc.vencrypt_client_cert       = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vnc.vencrypt_client_key        = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] workarounds.disable_rootwrap   = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] workarounds.enable_numa_live_migration = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] workarounds.libvirt_disable_apic = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] wsgi.client_socket_timeout     = 900 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] wsgi.default_pool_size         = 1000 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] wsgi.keep_alive                = True {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] wsgi.max_header_line           = 16384 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] wsgi.ssl_ca_file               = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] wsgi.ssl_cert_file             = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] wsgi.ssl_key_file              = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] wsgi.tcp_keepidle              = 600 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] zvm.ca_file                    = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] zvm.cloud_connector_url        = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] zvm.reachable_timeout          = 300 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_policy.enforce_new_defaults = True {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_policy.enforce_scope      = True {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_policy.policy_default_rule = default {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_policy.policy_file        = policy.yaml {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] profiler.connection_string     = messaging:// {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] profiler.enabled               = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] profiler.es_doc_type           = notification {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] profiler.es_scroll_size        = 10000 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] profiler.es_scroll_time        = 2m {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] profiler.filter_error_trace    = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] profiler.hmac_keys             = **** {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] profiler.sentinel_service_name = mymaster {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] profiler.socket_timeout        = 0.1 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] profiler.trace_requests        = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] profiler.trace_sqlalchemy      = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] profiler_jaeger.process_tags   = {} {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] profiler_jaeger.service_name_prefix = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] profiler_otlp.service_name_prefix = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] remote_debug.host              = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] remote_debug.port              = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_rabbit.ssl      = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_notifications.retry = -1 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_messaging_notifications.transport_url = **** {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_limit.auth_section        = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_limit.auth_type           = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_limit.cafile              = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_limit.certfile            = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_limit.collect_timing      = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_limit.connect_retries     = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_limit.connect_retry_delay = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_limit.endpoint_id         = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_limit.endpoint_override   = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_limit.insecure            = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_limit.keyfile             = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_limit.max_version         = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_limit.min_version         = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_limit.region_name         = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_limit.service_name        = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_limit.service_type        = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_limit.split_loggers       = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_limit.status_code_retries = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_limit.status_code_retry_delay = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_limit.timeout             = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_limit.valid_interfaces    = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_limit.version             = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_reports.file_event_handler = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] oslo_reports.log_dir           = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vif_plug_ovs_privileged.group  = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] vif_plug_ovs_privileged.user   = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] os_vif_linux_bridge.flat_interface = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] os_vif_ovs.isolate_vif         = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] os_vif_ovs.per_port_bridge     = False {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] os_brick.lock_path             = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] privsep_osbrick.capabilities   = [21] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] privsep_osbrick.group          = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] privsep_osbrick.helper_command = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] privsep_osbrick.user           = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] nova_sys_admin.group           = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] nova_sys_admin.helper_command  = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] nova_sys_admin.user            = None {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG oslo_service.service [None req-cf1bd10e-3e98-42a5-a146-c4171239566f None None] ******************************************************************************** {{(pid=72444) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Aug 03 04:36:34 user nova-compute[72444]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 03 04:36:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Starting native event thread {{(pid=72444) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Starting green dispatch thread {{(pid=72444) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Starting connection event dispatch thread {{(pid=72444) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Connecting to libvirt: qemu:///system {{(pid=72444) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f309cdfcaf0> {{(pid=72444) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 03 04:36:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f309cdfcaf0> {{(pid=72444) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 03 04:36:34 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Connection event '1' reason 'None'
Aug 03 04:36:34 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 03 04:36:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.mount [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Initialising _HostMountState generation 0 {{(pid=72444) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 03 04:36:41 user nova-compute[72444]: INFO nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Libvirt host capabilities <capabilities>
Aug 03 04:36:41 user nova-compute[72444]:   <host>
Aug 03 04:36:41 user nova-compute[72444]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 03 04:36:41 user nova-compute[72444]:     <cpu>
Aug 03 04:36:41 user nova-compute[72444]:       <arch>x86_64</arch>
Aug 03 04:36:41 user nova-compute[72444]:       <model>IvyBridge-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <vendor>Intel</vendor>
Aug 03 04:36:41 user nova-compute[72444]:       <microcode version='1070'/>
Aug 03 04:36:41 user nova-compute[72444]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 03 04:36:41 user nova-compute[72444]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature name='ss'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature name='vmx'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature name='pcid'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature name='osxsave'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature name='hypervisor'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature name='arat'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature name='tsc_adjust'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature name='md-clear'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature name='stibp'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature name='arch-capabilities'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature name='ssbd'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature name='invtsc'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature name='rsba'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature name='skip-l1dfl-vmentry'/>
Aug 03 04:36:41 user nova-compute[72444]:       <pages unit='KiB' size='4'/>
Aug 03 04:36:41 user nova-compute[72444]:       <pages unit='KiB' size='2048'/>
Aug 03 04:36:41 user nova-compute[72444]:     </cpu>
Aug 03 04:36:41 user nova-compute[72444]:     <power_management>
Aug 03 04:36:41 user nova-compute[72444]:       <suspend_mem/>
Aug 03 04:36:41 user nova-compute[72444]:       <suspend_disk/>
Aug 03 04:36:41 user nova-compute[72444]:       <suspend_hybrid/>
Aug 03 04:36:41 user nova-compute[72444]:     </power_management>
Aug 03 04:36:41 user nova-compute[72444]:     <iommu support='no'/>
Aug 03 04:36:41 user nova-compute[72444]:     <migration_features>
Aug 03 04:36:41 user nova-compute[72444]:       <live/>
Aug 03 04:36:41 user nova-compute[72444]:       <uri_transports>
Aug 03 04:36:41 user nova-compute[72444]:         <uri_transport>tcp</uri_transport>
Aug 03 04:36:41 user nova-compute[72444]:         <uri_transport>rdma</uri_transport>
Aug 03 04:36:41 user nova-compute[72444]:       </uri_transports>
Aug 03 04:36:41 user nova-compute[72444]:     </migration_features>
Aug 03 04:36:41 user nova-compute[72444]:     <topology>
Aug 03 04:36:41 user nova-compute[72444]:       <cells num='2'>
Aug 03 04:36:41 user nova-compute[72444]:         <cell id='0'>
Aug 03 04:36:41 user nova-compute[72444]:           <memory unit='KiB'>8189224</memory>
Aug 03 04:36:41 user nova-compute[72444]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 03 04:36:41 user nova-compute[72444]:           <pages unit='KiB' size='2048'>0</pages>
Aug 03 04:36:41 user nova-compute[72444]:           <distances>
Aug 03 04:36:41 user nova-compute[72444]:             <sibling id='0' value='10'/>
Aug 03 04:36:41 user nova-compute[72444]:             <sibling id='1' value='20'/>
Aug 03 04:36:41 user nova-compute[72444]:           </distances>
Aug 03 04:36:41 user nova-compute[72444]:           <cpus num='6'>
Aug 03 04:36:41 user nova-compute[72444]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 03 04:36:41 user nova-compute[72444]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 03 04:36:41 user nova-compute[72444]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 03 04:36:41 user nova-compute[72444]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 03 04:36:41 user nova-compute[72444]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 03 04:36:41 user nova-compute[72444]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 03 04:36:41 user nova-compute[72444]:           </cpus>
Aug 03 04:36:41 user nova-compute[72444]:         </cell>
Aug 03 04:36:41 user nova-compute[72444]:         <cell id='1'>
Aug 03 04:36:41 user nova-compute[72444]:           <memory unit='KiB'>8206460</memory>
Aug 03 04:36:41 user nova-compute[72444]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 03 04:36:41 user nova-compute[72444]:           <pages unit='KiB' size='2048'>0</pages>
Aug 03 04:36:41 user nova-compute[72444]:           <distances>
Aug 03 04:36:41 user nova-compute[72444]:             <sibling id='0' value='20'/>
Aug 03 04:36:41 user nova-compute[72444]:             <sibling id='1' value='10'/>
Aug 03 04:36:41 user nova-compute[72444]:           </distances>
Aug 03 04:36:41 user nova-compute[72444]:           <cpus num='6'>
Aug 03 04:36:41 user nova-compute[72444]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 03 04:36:41 user nova-compute[72444]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 03 04:36:41 user nova-compute[72444]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 03 04:36:41 user nova-compute[72444]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 03 04:36:41 user nova-compute[72444]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 03 04:36:41 user nova-compute[72444]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 03 04:36:41 user nova-compute[72444]:           </cpus>
Aug 03 04:36:41 user nova-compute[72444]:         </cell>
Aug 03 04:36:41 user nova-compute[72444]:       </cells>
Aug 03 04:36:41 user nova-compute[72444]:     </topology>
Aug 03 04:36:41 user nova-compute[72444]:     <cache>
Aug 03 04:36:41 user nova-compute[72444]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 03 04:36:41 user nova-compute[72444]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 03 04:36:41 user nova-compute[72444]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 03 04:36:41 user nova-compute[72444]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 03 04:36:41 user nova-compute[72444]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 03 04:36:41 user nova-compute[72444]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 03 04:36:41 user nova-compute[72444]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 03 04:36:41 user nova-compute[72444]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 03 04:36:41 user nova-compute[72444]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 03 04:36:41 user nova-compute[72444]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 03 04:36:41 user nova-compute[72444]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 03 04:36:41 user nova-compute[72444]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 03 04:36:41 user nova-compute[72444]:     </cache>
Aug 03 04:36:41 user nova-compute[72444]:     <secmodel>
Aug 03 04:36:41 user nova-compute[72444]:       <model>apparmor</model>
Aug 03 04:36:41 user nova-compute[72444]:       <doi>0</doi>
Aug 03 04:36:41 user nova-compute[72444]:     </secmodel>
Aug 03 04:36:41 user nova-compute[72444]:     <secmodel>
Aug 03 04:36:41 user nova-compute[72444]:       <model>dac</model>
Aug 03 04:36:41 user nova-compute[72444]:       <doi>0</doi>
Aug 03 04:36:41 user nova-compute[72444]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 03 04:36:41 user nova-compute[72444]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 03 04:36:41 user nova-compute[72444]:     </secmodel>
Aug 03 04:36:41 user nova-compute[72444]:   </host>
Aug 03 04:36:41 user nova-compute[72444]:   <guest>
Aug 03 04:36:41 user nova-compute[72444]:     <os_type>hvm</os_type>
Aug 03 04:36:41 user nova-compute[72444]:     <arch name='alpha'>
Aug 03 04:36:41 user nova-compute[72444]:       <wordsize>64</wordsize>
Aug 03 04:36:41 user nova-compute[72444]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='4'>clipper</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <domain type='qemu'/>
Aug 03 04:36:41 user nova-compute[72444]:     </arch>
Aug 03 04:36:41 user nova-compute[72444]:     <features>
Aug 03 04:36:41 user nova-compute[72444]:       <cpuselection/>
Aug 03 04:36:41 user nova-compute[72444]:       <deviceboot/>
Aug 03 04:36:41 user nova-compute[72444]:       <disksnapshot default='on' toggle='no'/>
Aug 03 04:36:41 user nova-compute[72444]:     </features>
Aug 03 04:36:41 user nova-compute[72444]:   </guest>
Aug 03 04:36:41 user nova-compute[72444]:   <guest>
Aug 03 04:36:41 user nova-compute[72444]:     <os_type>hvm</os_type>
Aug 03 04:36:41 user nova-compute[72444]:     <arch name='armv6l'>
Aug 03 04:36:41 user nova-compute[72444]:       <wordsize>32</wordsize>
Aug 03 04:36:41 user nova-compute[72444]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>integratorcp</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>borzoi</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>spitz</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>nuri</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>musca-b1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>versatileab</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>kzm</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>musca-a</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>smdkc210</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>sx1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>z2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>tosa</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='4'>sabrelite</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>realview-eb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>n810</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>n800</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>versatilepb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>terrier</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>mainstone</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='4'>midway</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>musicpal</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>microbit</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>cubieboard</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>verdex</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>netduino2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='4'>raspi2b</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>cheetah</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='4'>highbank</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>akita</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>connex</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>collie</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>raspi0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <domain type='qemu'/>
Aug 03 04:36:41 user nova-compute[72444]:     </arch>
Aug 03 04:36:41 user nova-compute[72444]:     <features>
Aug 03 04:36:41 user nova-compute[72444]:       <cpuselection/>
Aug 03 04:36:41 user nova-compute[72444]:       <deviceboot/>
Aug 03 04:36:41 user nova-compute[72444]:       <disksnapshot default='on' toggle='no'/>
Aug 03 04:36:41 user nova-compute[72444]:     </features>
Aug 03 04:36:41 user nova-compute[72444]:   </guest>
Aug 03 04:36:41 user nova-compute[72444]:   <guest>
Aug 03 04:36:41 user nova-compute[72444]:     <os_type>hvm</os_type>
Aug 03 04:36:41 user nova-compute[72444]:     <arch name='armv7l'>
Aug 03 04:36:41 user nova-compute[72444]:       <wordsize>32</wordsize>
Aug 03 04:36:41 user nova-compute[72444]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>integratorcp</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>borzoi</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>spitz</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>nuri</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>musca-b1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>versatileab</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>kzm</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>musca-a</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>smdkc210</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>sx1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>z2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>tosa</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='4'>sabrelite</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>realview-eb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>n810</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>n800</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>versatilepb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>terrier</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>mainstone</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='4'>midway</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>musicpal</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>microbit</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>cubieboard</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>verdex</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>netduino2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='4'>raspi2b</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>cheetah</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='4'>highbank</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>akita</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>connex</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>collie</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>raspi0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <domain type='qemu'/>
Aug 03 04:36:41 user nova-compute[72444]:     </arch>
Aug 03 04:36:41 user nova-compute[72444]:     <features>
Aug 03 04:36:41 user nova-compute[72444]:       <cpuselection/>
Aug 03 04:36:41 user nova-compute[72444]:       <deviceboot/>
Aug 03 04:36:41 user nova-compute[72444]:       <disksnapshot default='on' toggle='no'/>
Aug 03 04:36:41 user nova-compute[72444]:     </features>
Aug 03 04:36:41 user nova-compute[72444]:   </guest>
Aug 03 04:36:41 user nova-compute[72444]:   <guest>
Aug 03 04:36:41 user nova-compute[72444]:     <os_type>hvm</os_type>
Aug 03 04:36:41 user nova-compute[72444]:     <arch name='aarch64'>
Aug 03 04:36:41 user nova-compute[72444]:       <wordsize>64</wordsize>
Aug 03 04:36:41 user nova-compute[72444]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>integratorcp</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>borzoi</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>spitz</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>nuri</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>musca-b1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>versatileab</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>kzm</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>musca-a</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>smdkc210</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>sx1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>z2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>tosa</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='4'>sabrelite</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>realview-eb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>n810</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>n800</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>versatilepb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>terrier</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>mainstone</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='4'>midway</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>musicpal</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>microbit</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>cubieboard</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>verdex</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>netduino2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='4'>raspi3b</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='4'>raspi2b</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>cheetah</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='4'>highbank</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>akita</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>connex</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>collie</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>raspi0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <domain type='qemu'/>
Aug 03 04:36:41 user nova-compute[72444]:     </arch>
Aug 03 04:36:41 user nova-compute[72444]:     <features>
Aug 03 04:36:41 user nova-compute[72444]:       <acpi default='on' toggle='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:       <cpuselection/>
Aug 03 04:36:41 user nova-compute[72444]:       <deviceboot/>
Aug 03 04:36:41 user nova-compute[72444]:       <disksnapshot default='on' toggle='no'/>
Aug 03 04:36:41 user nova-compute[72444]:     </features>
Aug 03 04:36:41 user nova-compute[72444]:   </guest>
Aug 03 04:36:41 user nova-compute[72444]:   <guest>
Aug 03 04:36:41 user nova-compute[72444]:     <os_type>hvm</os_type>
Aug 03 04:36:41 user nova-compute[72444]:     <arch name='cris'>
Aug 03 04:36:41 user nova-compute[72444]:       <wordsize>32</wordsize>
Aug 03 04:36:41 user nova-compute[72444]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <domain type='qemu'/>
Aug 03 04:36:41 user nova-compute[72444]:     </arch>
Aug 03 04:36:41 user nova-compute[72444]:     <features>
Aug 03 04:36:41 user nova-compute[72444]:       <cpuselection/>
Aug 03 04:36:41 user nova-compute[72444]:       <deviceboot/>
Aug 03 04:36:41 user nova-compute[72444]:       <disksnapshot default='on' toggle='no'/>
Aug 03 04:36:41 user nova-compute[72444]:     </features>
Aug 03 04:36:41 user nova-compute[72444]:   </guest>
Aug 03 04:36:41 user nova-compute[72444]:   <guest>
Aug 03 04:36:41 user nova-compute[72444]:     <os_type>hvm</os_type>
Aug 03 04:36:41 user nova-compute[72444]:     <arch name='i686'>
Aug 03 04:36:41 user nova-compute[72444]:       <wordsize>32</wordsize>
Aug 03 04:36:41 user nova-compute[72444]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>x-remote</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>isapc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>microvm</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <domain type='qemu'/>
Aug 03 04:36:41 user nova-compute[72444]:       <domain type='kvm'/>
Aug 03 04:36:41 user nova-compute[72444]:     </arch>
Aug 03 04:36:41 user nova-compute[72444]:     <features>
Aug 03 04:36:41 user nova-compute[72444]:       <pae/>
Aug 03 04:36:41 user nova-compute[72444]:       <nonpae/>
Aug 03 04:36:41 user nova-compute[72444]:       <acpi default='on' toggle='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:       <apic default='on' toggle='no'/>
Aug 03 04:36:41 user nova-compute[72444]:       <cpuselection/>
Aug 03 04:36:41 user nova-compute[72444]:       <deviceboot/>
Aug 03 04:36:41 user nova-compute[72444]:       <disksnapshot default='on' toggle='no'/>
Aug 03 04:36:41 user nova-compute[72444]:     </features>
Aug 03 04:36:41 user nova-compute[72444]:   </guest>
Aug 03 04:36:41 user nova-compute[72444]:   <guest>
Aug 03 04:36:41 user nova-compute[72444]:     <os_type>hvm</os_type>
Aug 03 04:36:41 user nova-compute[72444]:     <arch name='m68k'>
Aug 03 04:36:41 user nova-compute[72444]:       <wordsize>32</wordsize>
Aug 03 04:36:41 user nova-compute[72444]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>an5206</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>q800</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>next-cube</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <domain type='qemu'/>
Aug 03 04:36:41 user nova-compute[72444]:     </arch>
Aug 03 04:36:41 user nova-compute[72444]:     <features>
Aug 03 04:36:41 user nova-compute[72444]:       <cpuselection/>
Aug 03 04:36:41 user nova-compute[72444]:       <deviceboot/>
Aug 03 04:36:41 user nova-compute[72444]:       <disksnapshot default='on' toggle='no'/>
Aug 03 04:36:41 user nova-compute[72444]:     </features>
Aug 03 04:36:41 user nova-compute[72444]:   </guest>
Aug 03 04:36:41 user nova-compute[72444]:   <guest>
Aug 03 04:36:41 user nova-compute[72444]:     <os_type>hvm</os_type>
Aug 03 04:36:41 user nova-compute[72444]:     <arch name='microblaze'>
Aug 03 04:36:41 user nova-compute[72444]:       <wordsize>32</wordsize>
Aug 03 04:36:41 user nova-compute[72444]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <domain type='qemu'/>
Aug 03 04:36:41 user nova-compute[72444]:     </arch>
Aug 03 04:36:41 user nova-compute[72444]:     <features>
Aug 03 04:36:41 user nova-compute[72444]:       <cpuselection/>
Aug 03 04:36:41 user nova-compute[72444]:       <deviceboot/>
Aug 03 04:36:41 user nova-compute[72444]:       <disksnapshot default='on' toggle='no'/>
Aug 03 04:36:41 user nova-compute[72444]:     </features>
Aug 03 04:36:41 user nova-compute[72444]:   </guest>
Aug 03 04:36:41 user nova-compute[72444]:   <guest>
Aug 03 04:36:41 user nova-compute[72444]:     <os_type>hvm</os_type>
Aug 03 04:36:41 user nova-compute[72444]:     <arch name='microblazeel'>
Aug 03 04:36:41 user nova-compute[72444]:       <wordsize>32</wordsize>
Aug 03 04:36:41 user nova-compute[72444]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <domain type='qemu'/>
Aug 03 04:36:41 user nova-compute[72444]:     </arch>
Aug 03 04:36:41 user nova-compute[72444]:     <features>
Aug 03 04:36:41 user nova-compute[72444]:       <cpuselection/>
Aug 03 04:36:41 user nova-compute[72444]:       <deviceboot/>
Aug 03 04:36:41 user nova-compute[72444]:       <disksnapshot default='on' toggle='no'/>
Aug 03 04:36:41 user nova-compute[72444]:     </features>
Aug 03 04:36:41 user nova-compute[72444]:   </guest>
Aug 03 04:36:41 user nova-compute[72444]:   <guest>
Aug 03 04:36:41 user nova-compute[72444]:     <os_type>hvm</os_type>
Aug 03 04:36:41 user nova-compute[72444]:     <arch name='mips'>
Aug 03 04:36:41 user nova-compute[72444]:       <wordsize>32</wordsize>
Aug 03 04:36:41 user nova-compute[72444]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='16'>malta</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>mipssim</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <domain type='qemu'/>
Aug 03 04:36:41 user nova-compute[72444]:     </arch>
Aug 03 04:36:41 user nova-compute[72444]:     <features>
Aug 03 04:36:41 user nova-compute[72444]:       <cpuselection/>
Aug 03 04:36:41 user nova-compute[72444]:       <deviceboot/>
Aug 03 04:36:41 user nova-compute[72444]:       <disksnapshot default='on' toggle='no'/>
Aug 03 04:36:41 user nova-compute[72444]:     </features>
Aug 03 04:36:41 user nova-compute[72444]:   </guest>
Aug 03 04:36:41 user nova-compute[72444]:   <guest>
Aug 03 04:36:41 user nova-compute[72444]:     <os_type>hvm</os_type>
Aug 03 04:36:41 user nova-compute[72444]:     <arch name='mipsel'>
Aug 03 04:36:41 user nova-compute[72444]:       <wordsize>32</wordsize>
Aug 03 04:36:41 user nova-compute[72444]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='16'>malta</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>mipssim</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <domain type='qemu'/>
Aug 03 04:36:41 user nova-compute[72444]:     </arch>
Aug 03 04:36:41 user nova-compute[72444]:     <features>
Aug 03 04:36:41 user nova-compute[72444]:       <cpuselection/>
Aug 03 04:36:41 user nova-compute[72444]:       <deviceboot/>
Aug 03 04:36:41 user nova-compute[72444]:       <disksnapshot default='on' toggle='no'/>
Aug 03 04:36:41 user nova-compute[72444]:     </features>
Aug 03 04:36:41 user nova-compute[72444]:   </guest>
Aug 03 04:36:41 user nova-compute[72444]:   <guest>
Aug 03 04:36:41 user nova-compute[72444]:     <os_type>hvm</os_type>
Aug 03 04:36:41 user nova-compute[72444]:     <arch name='mips64'>
Aug 03 04:36:41 user nova-compute[72444]:       <wordsize>64</wordsize>
Aug 03 04:36:41 user nova-compute[72444]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='16'>malta</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>mipssim</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>pica61</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>magnum</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <domain type='qemu'/>
Aug 03 04:36:41 user nova-compute[72444]:     </arch>
Aug 03 04:36:41 user nova-compute[72444]:     <features>
Aug 03 04:36:41 user nova-compute[72444]:       <cpuselection/>
Aug 03 04:36:41 user nova-compute[72444]:       <deviceboot/>
Aug 03 04:36:41 user nova-compute[72444]:       <disksnapshot default='on' toggle='no'/>
Aug 03 04:36:41 user nova-compute[72444]:     </features>
Aug 03 04:36:41 user nova-compute[72444]:   </guest>
Aug 03 04:36:41 user nova-compute[72444]:   <guest>
Aug 03 04:36:41 user nova-compute[72444]:     <os_type>hvm</os_type>
Aug 03 04:36:41 user nova-compute[72444]:     <arch name='mips64el'>
Aug 03 04:36:41 user nova-compute[72444]:       <wordsize>64</wordsize>
Aug 03 04:36:41 user nova-compute[72444]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='16'>malta</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>mipssim</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>pica61</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>magnum</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='16'>boston</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <domain type='qemu'/>
Aug 03 04:36:41 user nova-compute[72444]:     </arch>
Aug 03 04:36:41 user nova-compute[72444]:     <features>
Aug 03 04:36:41 user nova-compute[72444]:       <cpuselection/>
Aug 03 04:36:41 user nova-compute[72444]:       <deviceboot/>
Aug 03 04:36:41 user nova-compute[72444]:       <disksnapshot default='on' toggle='no'/>
Aug 03 04:36:41 user nova-compute[72444]:     </features>
Aug 03 04:36:41 user nova-compute[72444]:   </guest>
Aug 03 04:36:41 user nova-compute[72444]:   <guest>
Aug 03 04:36:41 user nova-compute[72444]:     <os_type>hvm</os_type>
Aug 03 04:36:41 user nova-compute[72444]:     <arch name='ppc'>
Aug 03 04:36:41 user nova-compute[72444]:       <wordsize>32</wordsize>
Aug 03 04:36:41 user nova-compute[72444]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>g3beige</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>mac99</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='32'>ppce500</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>pegasos2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>sam460ex</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>bamboo</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>40p</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>ref405ep</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>taihu</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <domain type='qemu'/>
Aug 03 04:36:41 user nova-compute[72444]:     </arch>
Aug 03 04:36:41 user nova-compute[72444]:     <features>
Aug 03 04:36:41 user nova-compute[72444]:       <cpuselection/>
Aug 03 04:36:41 user nova-compute[72444]:       <deviceboot/>
Aug 03 04:36:41 user nova-compute[72444]:       <disksnapshot default='on' toggle='no'/>
Aug 03 04:36:41 user nova-compute[72444]:     </features>
Aug 03 04:36:41 user nova-compute[72444]:   </guest>
Aug 03 04:36:41 user nova-compute[72444]:   <guest>
Aug 03 04:36:41 user nova-compute[72444]:     <os_type>hvm</os_type>
Aug 03 04:36:41 user nova-compute[72444]:     <arch name='ppc64'>
Aug 03 04:36:41 user nova-compute[72444]:       <wordsize>64</wordsize>
Aug 03 04:36:41 user nova-compute[72444]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2048'>powernv9</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>taihu</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2048'>powernv10</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='32'>ppce500</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>40p</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>pegasos2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>bamboo</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>g3beige</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>mac99</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>sam460ex</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>ref405ep</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2048'>powernv8</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <domain type='qemu'/>
Aug 03 04:36:41 user nova-compute[72444]:     </arch>
Aug 03 04:36:41 user nova-compute[72444]:     <features>
Aug 03 04:36:41 user nova-compute[72444]:       <cpuselection/>
Aug 03 04:36:41 user nova-compute[72444]:       <deviceboot/>
Aug 03 04:36:41 user nova-compute[72444]:       <disksnapshot default='on' toggle='no'/>
Aug 03 04:36:41 user nova-compute[72444]:     </features>
Aug 03 04:36:41 user nova-compute[72444]:   </guest>
Aug 03 04:36:41 user nova-compute[72444]:   <guest>
Aug 03 04:36:41 user nova-compute[72444]:     <os_type>hvm</os_type>
Aug 03 04:36:41 user nova-compute[72444]:     <arch name='ppc64le'>
Aug 03 04:36:41 user nova-compute[72444]:       <wordsize>64</wordsize>
Aug 03 04:36:41 user nova-compute[72444]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2048'>powernv9</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>taihu</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2048'>powernv10</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='32'>ppce500</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>40p</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>pegasos2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>bamboo</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>g3beige</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>mac99</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>sam460ex</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>ref405ep</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2048'>powernv8</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <domain type='qemu'/>
Aug 03 04:36:41 user nova-compute[72444]:     </arch>
Aug 03 04:36:41 user nova-compute[72444]:     <features>
Aug 03 04:36:41 user nova-compute[72444]:       <cpuselection/>
Aug 03 04:36:41 user nova-compute[72444]:       <deviceboot/>
Aug 03 04:36:41 user nova-compute[72444]:       <disksnapshot default='on' toggle='no'/>
Aug 03 04:36:41 user nova-compute[72444]:     </features>
Aug 03 04:36:41 user nova-compute[72444]:   </guest>
Aug 03 04:36:41 user nova-compute[72444]:   <guest>
Aug 03 04:36:41 user nova-compute[72444]:     <os_type>hvm</os_type>
Aug 03 04:36:41 user nova-compute[72444]:     <arch name='riscv32'>
Aug 03 04:36:41 user nova-compute[72444]:       <wordsize>32</wordsize>
Aug 03 04:36:41 user nova-compute[72444]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='8'>spike</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>opentitan</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='5'>sifive_u</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>sifive_e</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='8'>virt</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <domain type='qemu'/>
Aug 03 04:36:41 user nova-compute[72444]:     </arch>
Aug 03 04:36:41 user nova-compute[72444]:     <features>
Aug 03 04:36:41 user nova-compute[72444]:       <cpuselection/>
Aug 03 04:36:41 user nova-compute[72444]:       <deviceboot/>
Aug 03 04:36:41 user nova-compute[72444]:       <disksnapshot default='on' toggle='no'/>
Aug 03 04:36:41 user nova-compute[72444]:     </features>
Aug 03 04:36:41 user nova-compute[72444]:   </guest>
Aug 03 04:36:41 user nova-compute[72444]:   <guest>
Aug 03 04:36:41 user nova-compute[72444]:     <os_type>hvm</os_type>
Aug 03 04:36:41 user nova-compute[72444]:     <arch name='riscv64'>
Aug 03 04:36:41 user nova-compute[72444]:       <wordsize>64</wordsize>
Aug 03 04:36:41 user nova-compute[72444]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='8'>spike</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='5'>sifive_u</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>shakti_c</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>sifive_e</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='8'>virt</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <domain type='qemu'/>
Aug 03 04:36:41 user nova-compute[72444]:     </arch>
Aug 03 04:36:41 user nova-compute[72444]:     <features>
Aug 03 04:36:41 user nova-compute[72444]:       <cpuselection/>
Aug 03 04:36:41 user nova-compute[72444]:       <deviceboot/>
Aug 03 04:36:41 user nova-compute[72444]:       <disksnapshot default='on' toggle='no'/>
Aug 03 04:36:41 user nova-compute[72444]:     </features>
Aug 03 04:36:41 user nova-compute[72444]:   </guest>
Aug 03 04:36:41 user nova-compute[72444]:   <guest>
Aug 03 04:36:41 user nova-compute[72444]:     <os_type>hvm</os_type>
Aug 03 04:36:41 user nova-compute[72444]:     <arch name='s390x'>
Aug 03 04:36:41 user nova-compute[72444]:       <wordsize>64</wordsize>
Aug 03 04:36:41 user nova-compute[72444]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <domain type='qemu'/>
Aug 03 04:36:41 user nova-compute[72444]:     </arch>
Aug 03 04:36:41 user nova-compute[72444]:     <features>
Aug 03 04:36:41 user nova-compute[72444]:       <cpuselection/>
Aug 03 04:36:41 user nova-compute[72444]:       <deviceboot/>
Aug 03 04:36:41 user nova-compute[72444]:       <disksnapshot default='on' toggle='no'/>
Aug 03 04:36:41 user nova-compute[72444]:     </features>
Aug 03 04:36:41 user nova-compute[72444]:   </guest>
Aug 03 04:36:41 user nova-compute[72444]:   <guest>
Aug 03 04:36:41 user nova-compute[72444]:     <os_type>hvm</os_type>
Aug 03 04:36:41 user nova-compute[72444]:     <arch name='sh4'>
Aug 03 04:36:41 user nova-compute[72444]:       <wordsize>32</wordsize>
Aug 03 04:36:41 user nova-compute[72444]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>shix</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>r2d</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <domain type='qemu'/>
Aug 03 04:36:41 user nova-compute[72444]:     </arch>
Aug 03 04:36:41 user nova-compute[72444]:     <features>
Aug 03 04:36:41 user nova-compute[72444]:       <cpuselection/>
Aug 03 04:36:41 user nova-compute[72444]:       <deviceboot/>
Aug 03 04:36:41 user nova-compute[72444]:       <disksnapshot default='on' toggle='no'/>
Aug 03 04:36:41 user nova-compute[72444]:     </features>
Aug 03 04:36:41 user nova-compute[72444]:   </guest>
Aug 03 04:36:41 user nova-compute[72444]:   <guest>
Aug 03 04:36:41 user nova-compute[72444]:     <os_type>hvm</os_type>
Aug 03 04:36:41 user nova-compute[72444]:     <arch name='sh4eb'>
Aug 03 04:36:41 user nova-compute[72444]:       <wordsize>64</wordsize>
Aug 03 04:36:41 user nova-compute[72444]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>shix</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>r2d</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <domain type='qemu'/>
Aug 03 04:36:41 user nova-compute[72444]:     </arch>
Aug 03 04:36:41 user nova-compute[72444]:     <features>
Aug 03 04:36:41 user nova-compute[72444]:       <cpuselection/>
Aug 03 04:36:41 user nova-compute[72444]:       <deviceboot/>
Aug 03 04:36:41 user nova-compute[72444]:       <disksnapshot default='on' toggle='no'/>
Aug 03 04:36:41 user nova-compute[72444]:     </features>
Aug 03 04:36:41 user nova-compute[72444]:   </guest>
Aug 03 04:36:41 user nova-compute[72444]:   <guest>
Aug 03 04:36:41 user nova-compute[72444]:     <os_type>hvm</os_type>
Aug 03 04:36:41 user nova-compute[72444]:     <arch name='sparc'>
Aug 03 04:36:41 user nova-compute[72444]:       <wordsize>32</wordsize>
Aug 03 04:36:41 user nova-compute[72444]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>SS-5</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='4'>SS-20</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>LX</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>SS-4</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='4'>SS-10</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>Voyager</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <domain type='qemu'/>
Aug 03 04:36:41 user nova-compute[72444]:     </arch>
Aug 03 04:36:41 user nova-compute[72444]:     <features>
Aug 03 04:36:41 user nova-compute[72444]:       <cpuselection/>
Aug 03 04:36:41 user nova-compute[72444]:       <deviceboot/>
Aug 03 04:36:41 user nova-compute[72444]:       <disksnapshot default='on' toggle='no'/>
Aug 03 04:36:41 user nova-compute[72444]:     </features>
Aug 03 04:36:41 user nova-compute[72444]:   </guest>
Aug 03 04:36:41 user nova-compute[72444]:   <guest>
Aug 03 04:36:41 user nova-compute[72444]:     <os_type>hvm</os_type>
Aug 03 04:36:41 user nova-compute[72444]:     <arch name='sparc64'>
Aug 03 04:36:41 user nova-compute[72444]:       <wordsize>64</wordsize>
Aug 03 04:36:41 user nova-compute[72444]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>sun4u</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>niagara</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>sun4v</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <domain type='qemu'/>
Aug 03 04:36:41 user nova-compute[72444]:     </arch>
Aug 03 04:36:41 user nova-compute[72444]:     <features>
Aug 03 04:36:41 user nova-compute[72444]:       <cpuselection/>
Aug 03 04:36:41 user nova-compute[72444]:       <deviceboot/>
Aug 03 04:36:41 user nova-compute[72444]:       <disksnapshot default='on' toggle='no'/>
Aug 03 04:36:41 user nova-compute[72444]:     </features>
Aug 03 04:36:41 user nova-compute[72444]:   </guest>
Aug 03 04:36:41 user nova-compute[72444]:   <guest>
Aug 03 04:36:41 user nova-compute[72444]:     <os_type>hvm</os_type>
Aug 03 04:36:41 user nova-compute[72444]:     <arch name='x86_64'>
Aug 03 04:36:41 user nova-compute[72444]:       <wordsize>64</wordsize>
Aug 03 04:36:41 user nova-compute[72444]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>x-remote</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='1'>isapc</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>microvm</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <domain type='qemu'/>
Aug 03 04:36:41 user nova-compute[72444]:       <domain type='kvm'/>
Aug 03 04:36:41 user nova-compute[72444]:     </arch>
Aug 03 04:36:41 user nova-compute[72444]:     <features>
Aug 03 04:36:41 user nova-compute[72444]:       <acpi default='on' toggle='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:       <apic default='on' toggle='no'/>
Aug 03 04:36:41 user nova-compute[72444]:       <cpuselection/>
Aug 03 04:36:41 user nova-compute[72444]:       <deviceboot/>
Aug 03 04:36:41 user nova-compute[72444]:       <disksnapshot default='on' toggle='no'/>
Aug 03 04:36:41 user nova-compute[72444]:     </features>
Aug 03 04:36:41 user nova-compute[72444]:   </guest>
Aug 03 04:36:41 user nova-compute[72444]:   <guest>
Aug 03 04:36:41 user nova-compute[72444]:     <os_type>hvm</os_type>
Aug 03 04:36:41 user nova-compute[72444]:     <arch name='xtensa'>
Aug 03 04:36:41 user nova-compute[72444]:       <wordsize>32</wordsize>
Aug 03 04:36:41 user nova-compute[72444]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='4'>sim</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='32'>kc705</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='32'>ml605</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='32'>virt</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='32'>lx200</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='32'>lx60</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <domain type='qemu'/>
Aug 03 04:36:41 user nova-compute[72444]:     </arch>
Aug 03 04:36:41 user nova-compute[72444]:     <features>
Aug 03 04:36:41 user nova-compute[72444]:       <cpuselection/>
Aug 03 04:36:41 user nova-compute[72444]:       <deviceboot/>
Aug 03 04:36:41 user nova-compute[72444]:       <disksnapshot default='on' toggle='no'/>
Aug 03 04:36:41 user nova-compute[72444]:     </features>
Aug 03 04:36:41 user nova-compute[72444]:   </guest>
Aug 03 04:36:41 user nova-compute[72444]:   <guest>
Aug 03 04:36:41 user nova-compute[72444]:     <os_type>hvm</os_type>
Aug 03 04:36:41 user nova-compute[72444]:     <arch name='xtensaeb'>
Aug 03 04:36:41 user nova-compute[72444]:       <wordsize>32</wordsize>
Aug 03 04:36:41 user nova-compute[72444]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='4'>sim</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='32'>kc705</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='32'>ml605</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='32'>virt</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='32'>lx200</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='32'>lx60</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 03 04:36:41 user nova-compute[72444]:       <domain type='qemu'/>
Aug 03 04:36:41 user nova-compute[72444]:     </arch>
Aug 03 04:36:41 user nova-compute[72444]:     <features>
Aug 03 04:36:41 user nova-compute[72444]:       <cpuselection/>
Aug 03 04:36:41 user nova-compute[72444]:       <deviceboot/>
Aug 03 04:36:41 user nova-compute[72444]:       <disksnapshot default='on' toggle='no'/>
Aug 03 04:36:41 user nova-compute[72444]:     </features>
Aug 03 04:36:41 user nova-compute[72444]:   </guest>
Aug 03 04:36:41 user nova-compute[72444]: </capabilities>
Aug 03 04:36:41 user nova-compute[72444]: 
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72444) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72444) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=72444) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72444) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72444) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72444) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72444) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72444) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72444) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72444) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72444) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'ubuntu', 'q35', 'pc'} {{(pid=72444) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 03 04:36:41 user nova-compute[72444]: <domainCapabilities>
Aug 03 04:36:41 user nova-compute[72444]:   <path>/usr/bin/qemu-system-i386</path>
Aug 03 04:36:41 user nova-compute[72444]:   <domain>kvm</domain>
Aug 03 04:36:41 user nova-compute[72444]:   <machine>pc-q35-jammy</machine>
Aug 03 04:36:41 user nova-compute[72444]:   <arch>i686</arch>
Aug 03 04:36:41 user nova-compute[72444]:   <vcpu max='288'/>
Aug 03 04:36:41 user nova-compute[72444]:   <iothreads supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:   <os supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:     <enum name='firmware'/>
Aug 03 04:36:41 user nova-compute[72444]:     <loader supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 03 04:36:41 user nova-compute[72444]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 03 04:36:41 user nova-compute[72444]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 03 04:36:41 user nova-compute[72444]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 03 04:36:41 user nova-compute[72444]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='type'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>rom</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>pflash</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='readonly'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>yes</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>no</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='secure'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>no</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </loader>
Aug 03 04:36:41 user nova-compute[72444]:   </os>
Aug 03 04:36:41 user nova-compute[72444]:   <cpu>
Aug 03 04:36:41 user nova-compute[72444]:     <mode name='host-passthrough' supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='hostPassthroughMigratable'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>off</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </mode>
Aug 03 04:36:41 user nova-compute[72444]:     <mode name='maximum' supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='maximumMigratable'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>on</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>off</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </mode>
Aug 03 04:36:41 user nova-compute[72444]:     <mode name='host-model' supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <vendor>Intel</vendor>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='ss'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='vmx'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='pcid'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='hypervisor'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='arat'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='tsc_adjust'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='umip'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='md-clear'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='stibp'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='arch-capabilities'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='ssbd'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='ibpb'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='ibrs'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='amd-stibp'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='amd-ssbd'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='disable' name='erms'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='disable' name='xsaveopt'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='disable' name='lm'/>
Aug 03 04:36:41 user nova-compute[72444]:     </mode>
Aug 03 04:36:41 user nova-compute[72444]:     <mode name='custom' supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>qemu64</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>qemu32</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>phenom</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>pentium3</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>pentium2</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>pentium</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>n270</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>kvm64</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>kvm32</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>coreduo</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>core2duo</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>athlon</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Westmere-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Westmere</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Snowridge</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Server</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Client</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>SandyBridge</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Penryn</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Opteron_G5</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Opteron_G4</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Opteron_G3</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Opteron_G2</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Opteron_G1</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Nehalem-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Nehalem</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>IvyBridge</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Icelake-Server</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Haswell-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Haswell-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Haswell</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>EPYC-Rome</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>EPYC-Milan</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>EPYC-IBPB</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>EPYC</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Dhyana</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Cooperlake</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Conroe</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Cascadelake-Server</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Broadwell-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Broadwell-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Broadwell</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>486</model>
Aug 03 04:36:41 user nova-compute[72444]:     </mode>
Aug 03 04:36:41 user nova-compute[72444]:   </cpu>
Aug 03 04:36:41 user nova-compute[72444]:   <memoryBacking supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:     <enum name='sourceType'>
Aug 03 04:36:41 user nova-compute[72444]:       <value>file</value>
Aug 03 04:36:41 user nova-compute[72444]:       <value>anonymous</value>
Aug 03 04:36:41 user nova-compute[72444]:       <value>memfd</value>
Aug 03 04:36:41 user nova-compute[72444]:     </enum>
Aug 03 04:36:41 user nova-compute[72444]:   </memoryBacking>
Aug 03 04:36:41 user nova-compute[72444]:   <devices>
Aug 03 04:36:41 user nova-compute[72444]:     <disk supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='diskDevice'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>disk</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>cdrom</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>floppy</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>lun</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='bus'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>fdc</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>scsi</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>usb</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>sata</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='model'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio-transitional</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio-non-transitional</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </disk>
Aug 03 04:36:41 user nova-compute[72444]:     <graphics supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='type'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>sdl</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>vnc</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>spice</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>egl-headless</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </graphics>
Aug 03 04:36:41 user nova-compute[72444]:     <video supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='modelType'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>vga</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>cirrus</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>vmvga</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>qxl</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>none</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>bochs</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>ramfb</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </video>
Aug 03 04:36:41 user nova-compute[72444]:     <hostdev supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='mode'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>subsystem</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='startupPolicy'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>default</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>mandatory</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>requisite</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>optional</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='subsysType'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>usb</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>pci</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>scsi</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='capsType'/>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='pciBackend'/>
Aug 03 04:36:41 user nova-compute[72444]:     </hostdev>
Aug 03 04:36:41 user nova-compute[72444]:     <rng supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='model'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio-transitional</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio-non-transitional</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='backendModel'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>random</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>egd</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>builtin</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </rng>
Aug 03 04:36:41 user nova-compute[72444]:     <filesystem supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='driverType'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>path</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>handle</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtiofs</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </filesystem>
Aug 03 04:36:41 user nova-compute[72444]:     <tpm supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='model'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>tpm-tis</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>tpm-crb</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='backendModel'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>passthrough</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>emulator</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </tpm>
Aug 03 04:36:41 user nova-compute[72444]:   </devices>
Aug 03 04:36:41 user nova-compute[72444]:   <features>
Aug 03 04:36:41 user nova-compute[72444]:     <gic supported='no'/>
Aug 03 04:36:41 user nova-compute[72444]:     <vmcoreinfo supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:     <genid supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:     <backingStoreInput supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:     <backup supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:     <sev supported='no'/>
Aug 03 04:36:41 user nova-compute[72444]:   </features>
Aug 03 04:36:41 user nova-compute[72444]: </domainCapabilities>
Aug 03 04:36:41 user nova-compute[72444]:  {{(pid=72444) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 03 04:36:41 user nova-compute[72444]: <domainCapabilities>
Aug 03 04:36:41 user nova-compute[72444]:   <path>/usr/bin/qemu-system-i386</path>
Aug 03 04:36:41 user nova-compute[72444]:   <domain>kvm</domain>
Aug 03 04:36:41 user nova-compute[72444]:   <machine>pc-i440fx-jammy</machine>
Aug 03 04:36:41 user nova-compute[72444]:   <arch>i686</arch>
Aug 03 04:36:41 user nova-compute[72444]:   <vcpu max='255'/>
Aug 03 04:36:41 user nova-compute[72444]:   <iothreads supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:   <os supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:     <enum name='firmware'/>
Aug 03 04:36:41 user nova-compute[72444]:     <loader supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 03 04:36:41 user nova-compute[72444]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 03 04:36:41 user nova-compute[72444]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 03 04:36:41 user nova-compute[72444]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 03 04:36:41 user nova-compute[72444]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='type'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>rom</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>pflash</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='readonly'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>yes</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>no</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='secure'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>no</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </loader>
Aug 03 04:36:41 user nova-compute[72444]:   </os>
Aug 03 04:36:41 user nova-compute[72444]:   <cpu>
Aug 03 04:36:41 user nova-compute[72444]:     <mode name='host-passthrough' supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='hostPassthroughMigratable'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>off</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </mode>
Aug 03 04:36:41 user nova-compute[72444]:     <mode name='maximum' supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='maximumMigratable'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>on</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>off</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </mode>
Aug 03 04:36:41 user nova-compute[72444]:     <mode name='host-model' supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <vendor>Intel</vendor>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='ss'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='vmx'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='pcid'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='hypervisor'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='arat'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='tsc_adjust'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='umip'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='md-clear'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='stibp'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='arch-capabilities'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='ssbd'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='ibpb'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='ibrs'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='amd-stibp'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='amd-ssbd'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='disable' name='erms'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='disable' name='xsaveopt'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='disable' name='lm'/>
Aug 03 04:36:41 user nova-compute[72444]:     </mode>
Aug 03 04:36:41 user nova-compute[72444]:     <mode name='custom' supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>qemu64</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>qemu32</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>phenom</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>pentium3</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>pentium2</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>pentium</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>n270</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>kvm64</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>kvm32</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>coreduo</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>core2duo</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>athlon</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Westmere-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Westmere</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Snowridge</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Server</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Client</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>SandyBridge</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Penryn</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Opteron_G5</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Opteron_G4</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Opteron_G3</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Opteron_G2</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Opteron_G1</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Nehalem-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Nehalem</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>IvyBridge</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Icelake-Server</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Haswell-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Haswell-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Haswell</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>EPYC-Rome</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>EPYC-Milan</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>EPYC-IBPB</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>EPYC</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Dhyana</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Cooperlake</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Conroe</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Cascadelake-Server</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Broadwell-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Broadwell-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Broadwell</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>486</model>
Aug 03 04:36:41 user nova-compute[72444]:     </mode>
Aug 03 04:36:41 user nova-compute[72444]:   </cpu>
Aug 03 04:36:41 user nova-compute[72444]:   <memoryBacking supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:     <enum name='sourceType'>
Aug 03 04:36:41 user nova-compute[72444]:       <value>file</value>
Aug 03 04:36:41 user nova-compute[72444]:       <value>anonymous</value>
Aug 03 04:36:41 user nova-compute[72444]:       <value>memfd</value>
Aug 03 04:36:41 user nova-compute[72444]:     </enum>
Aug 03 04:36:41 user nova-compute[72444]:   </memoryBacking>
Aug 03 04:36:41 user nova-compute[72444]:   <devices>
Aug 03 04:36:41 user nova-compute[72444]:     <disk supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='diskDevice'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>disk</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>cdrom</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>floppy</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>lun</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='bus'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>ide</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>fdc</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>scsi</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>usb</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>sata</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='model'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio-transitional</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio-non-transitional</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </disk>
Aug 03 04:36:41 user nova-compute[72444]:     <graphics supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='type'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>sdl</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>vnc</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>spice</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>egl-headless</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </graphics>
Aug 03 04:36:41 user nova-compute[72444]:     <video supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='modelType'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>vga</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>cirrus</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>vmvga</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>qxl</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>none</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>bochs</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>ramfb</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </video>
Aug 03 04:36:41 user nova-compute[72444]:     <hostdev supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='mode'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>subsystem</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='startupPolicy'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>default</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>mandatory</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>requisite</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>optional</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='subsysType'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>usb</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>pci</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>scsi</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='capsType'/>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='pciBackend'/>
Aug 03 04:36:41 user nova-compute[72444]:     </hostdev>
Aug 03 04:36:41 user nova-compute[72444]:     <rng supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='model'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio-transitional</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio-non-transitional</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='backendModel'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>random</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>egd</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>builtin</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </rng>
Aug 03 04:36:41 user nova-compute[72444]:     <filesystem supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='driverType'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>path</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>handle</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtiofs</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </filesystem>
Aug 03 04:36:41 user nova-compute[72444]:     <tpm supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='model'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>tpm-tis</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>tpm-crb</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='backendModel'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>passthrough</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>emulator</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </tpm>
Aug 03 04:36:41 user nova-compute[72444]:   </devices>
Aug 03 04:36:41 user nova-compute[72444]:   <features>
Aug 03 04:36:41 user nova-compute[72444]:     <gic supported='no'/>
Aug 03 04:36:41 user nova-compute[72444]:     <vmcoreinfo supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:     <genid supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:     <backingStoreInput supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:     <backup supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:     <sev supported='no'/>
Aug 03 04:36:41 user nova-compute[72444]:   </features>
Aug 03 04:36:41 user nova-compute[72444]: </domainCapabilities>
Aug 03 04:36:41 user nova-compute[72444]:  {{(pid=72444) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 03 04:36:41 user nova-compute[72444]: <domainCapabilities>
Aug 03 04:36:41 user nova-compute[72444]:   <path>/usr/bin/qemu-system-i386</path>
Aug 03 04:36:41 user nova-compute[72444]:   <domain>kvm</domain>
Aug 03 04:36:41 user nova-compute[72444]:   <machine>pc-q35-6.2</machine>
Aug 03 04:36:41 user nova-compute[72444]:   <arch>i686</arch>
Aug 03 04:36:41 user nova-compute[72444]:   <vcpu max='288'/>
Aug 03 04:36:41 user nova-compute[72444]:   <iothreads supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:   <os supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:     <enum name='firmware'/>
Aug 03 04:36:41 user nova-compute[72444]:     <loader supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 03 04:36:41 user nova-compute[72444]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 03 04:36:41 user nova-compute[72444]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 03 04:36:41 user nova-compute[72444]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 03 04:36:41 user nova-compute[72444]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='type'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>rom</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>pflash</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='readonly'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>yes</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>no</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='secure'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>no</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </loader>
Aug 03 04:36:41 user nova-compute[72444]:   </os>
Aug 03 04:36:41 user nova-compute[72444]:   <cpu>
Aug 03 04:36:41 user nova-compute[72444]:     <mode name='host-passthrough' supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='hostPassthroughMigratable'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>off</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </mode>
Aug 03 04:36:41 user nova-compute[72444]:     <mode name='maximum' supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='maximumMigratable'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>on</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>off</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </mode>
Aug 03 04:36:41 user nova-compute[72444]:     <mode name='host-model' supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <vendor>Intel</vendor>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='ss'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='vmx'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='pcid'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='hypervisor'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='arat'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='tsc_adjust'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='umip'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='md-clear'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='stibp'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='arch-capabilities'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='ssbd'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='ibpb'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='ibrs'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='amd-stibp'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='amd-ssbd'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='disable' name='erms'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='disable' name='xsaveopt'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='disable' name='lm'/>
Aug 03 04:36:41 user nova-compute[72444]:     </mode>
Aug 03 04:36:41 user nova-compute[72444]:     <mode name='custom' supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>qemu64</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>qemu32</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>phenom</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>pentium3</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>pentium2</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>pentium</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>n270</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>kvm64</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>kvm32</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>coreduo</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>core2duo</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>athlon</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Westmere-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Westmere</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Snowridge</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Server</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Client</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>SandyBridge</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Penryn</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Opteron_G5</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Opteron_G4</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Opteron_G3</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Opteron_G2</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Opteron_G1</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Nehalem-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Nehalem</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>IvyBridge</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Icelake-Server</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Haswell-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Haswell-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Haswell</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>EPYC-Rome</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>EPYC-Milan</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>EPYC-IBPB</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>EPYC</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Dhyana</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Cooperlake</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Conroe</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Cascadelake-Server</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Broadwell-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Broadwell-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Broadwell</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>486</model>
Aug 03 04:36:41 user nova-compute[72444]:     </mode>
Aug 03 04:36:41 user nova-compute[72444]:   </cpu>
Aug 03 04:36:41 user nova-compute[72444]:   <memoryBacking supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:     <enum name='sourceType'>
Aug 03 04:36:41 user nova-compute[72444]:       <value>file</value>
Aug 03 04:36:41 user nova-compute[72444]:       <value>anonymous</value>
Aug 03 04:36:41 user nova-compute[72444]:       <value>memfd</value>
Aug 03 04:36:41 user nova-compute[72444]:     </enum>
Aug 03 04:36:41 user nova-compute[72444]:   </memoryBacking>
Aug 03 04:36:41 user nova-compute[72444]:   <devices>
Aug 03 04:36:41 user nova-compute[72444]:     <disk supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='diskDevice'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>disk</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>cdrom</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>floppy</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>lun</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='bus'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>fdc</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>scsi</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>usb</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>sata</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='model'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio-transitional</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio-non-transitional</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </disk>
Aug 03 04:36:41 user nova-compute[72444]:     <graphics supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='type'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>sdl</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>vnc</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>spice</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>egl-headless</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </graphics>
Aug 03 04:36:41 user nova-compute[72444]:     <video supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='modelType'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>vga</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>cirrus</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>vmvga</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>qxl</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>none</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>bochs</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>ramfb</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </video>
Aug 03 04:36:41 user nova-compute[72444]:     <hostdev supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='mode'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>subsystem</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='startupPolicy'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>default</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>mandatory</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>requisite</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>optional</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='subsysType'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>usb</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>pci</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>scsi</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='capsType'/>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='pciBackend'/>
Aug 03 04:36:41 user nova-compute[72444]:     </hostdev>
Aug 03 04:36:41 user nova-compute[72444]:     <rng supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='model'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio-transitional</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio-non-transitional</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='backendModel'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>random</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>egd</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>builtin</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </rng>
Aug 03 04:36:41 user nova-compute[72444]:     <filesystem supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='driverType'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>path</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>handle</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtiofs</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </filesystem>
Aug 03 04:36:41 user nova-compute[72444]:     <tpm supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='model'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>tpm-tis</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>tpm-crb</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='backendModel'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>passthrough</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>emulator</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </tpm>
Aug 03 04:36:41 user nova-compute[72444]:   </devices>
Aug 03 04:36:41 user nova-compute[72444]:   <features>
Aug 03 04:36:41 user nova-compute[72444]:     <gic supported='no'/>
Aug 03 04:36:41 user nova-compute[72444]:     <vmcoreinfo supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:     <genid supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:     <backingStoreInput supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:     <backup supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:     <sev supported='no'/>
Aug 03 04:36:41 user nova-compute[72444]:   </features>
Aug 03 04:36:41 user nova-compute[72444]: </domainCapabilities>
Aug 03 04:36:41 user nova-compute[72444]:  {{(pid=72444) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 03 04:36:41 user nova-compute[72444]: <domainCapabilities>
Aug 03 04:36:41 user nova-compute[72444]:   <path>/usr/bin/qemu-system-i386</path>
Aug 03 04:36:41 user nova-compute[72444]:   <domain>kvm</domain>
Aug 03 04:36:41 user nova-compute[72444]:   <machine>pc-i440fx-6.2</machine>
Aug 03 04:36:41 user nova-compute[72444]:   <arch>i686</arch>
Aug 03 04:36:41 user nova-compute[72444]:   <vcpu max='255'/>
Aug 03 04:36:41 user nova-compute[72444]:   <iothreads supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:   <os supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:     <enum name='firmware'/>
Aug 03 04:36:41 user nova-compute[72444]:     <loader supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 03 04:36:41 user nova-compute[72444]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 03 04:36:41 user nova-compute[72444]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 03 04:36:41 user nova-compute[72444]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 03 04:36:41 user nova-compute[72444]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='type'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>rom</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>pflash</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='readonly'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>yes</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>no</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='secure'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>no</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </loader>
Aug 03 04:36:41 user nova-compute[72444]:   </os>
Aug 03 04:36:41 user nova-compute[72444]:   <cpu>
Aug 03 04:36:41 user nova-compute[72444]:     <mode name='host-passthrough' supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='hostPassthroughMigratable'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>off</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </mode>
Aug 03 04:36:41 user nova-compute[72444]:     <mode name='maximum' supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='maximumMigratable'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>on</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>off</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </mode>
Aug 03 04:36:41 user nova-compute[72444]:     <mode name='host-model' supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <vendor>Intel</vendor>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='ss'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='vmx'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='pcid'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='hypervisor'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='arat'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='tsc_adjust'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='umip'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='md-clear'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='stibp'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='arch-capabilities'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='ssbd'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='ibpb'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='ibrs'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='amd-stibp'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='amd-ssbd'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='disable' name='erms'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='disable' name='xsaveopt'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='disable' name='lm'/>
Aug 03 04:36:41 user nova-compute[72444]:     </mode>
Aug 03 04:36:41 user nova-compute[72444]:     <mode name='custom' supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>qemu64</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>qemu32</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>phenom</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>pentium3</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>pentium2</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>pentium</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>n270</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>kvm64</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>kvm32</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>coreduo</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>core2duo</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>athlon</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Westmere-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Westmere</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Snowridge</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Server</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Client</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>SandyBridge</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Penryn</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Opteron_G5</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Opteron_G4</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Opteron_G3</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Opteron_G2</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Opteron_G1</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Nehalem-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Nehalem</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>IvyBridge</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Icelake-Server</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Haswell-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Haswell-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Haswell</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>EPYC-Rome</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>EPYC-Milan</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>EPYC-IBPB</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>EPYC</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Dhyana</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Cooperlake</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Conroe</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Cascadelake-Server</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Broadwell-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Broadwell-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Broadwell</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>486</model>
Aug 03 04:36:41 user nova-compute[72444]:     </mode>
Aug 03 04:36:41 user nova-compute[72444]:   </cpu>
Aug 03 04:36:41 user nova-compute[72444]:   <memoryBacking supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:     <enum name='sourceType'>
Aug 03 04:36:41 user nova-compute[72444]:       <value>file</value>
Aug 03 04:36:41 user nova-compute[72444]:       <value>anonymous</value>
Aug 03 04:36:41 user nova-compute[72444]:       <value>memfd</value>
Aug 03 04:36:41 user nova-compute[72444]:     </enum>
Aug 03 04:36:41 user nova-compute[72444]:   </memoryBacking>
Aug 03 04:36:41 user nova-compute[72444]:   <devices>
Aug 03 04:36:41 user nova-compute[72444]:     <disk supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='diskDevice'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>disk</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>cdrom</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>floppy</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>lun</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='bus'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>ide</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>fdc</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>scsi</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>usb</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>sata</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='model'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio-transitional</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio-non-transitional</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </disk>
Aug 03 04:36:41 user nova-compute[72444]:     <graphics supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='type'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>sdl</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>vnc</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>spice</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>egl-headless</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </graphics>
Aug 03 04:36:41 user nova-compute[72444]:     <video supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='modelType'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>vga</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>cirrus</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>vmvga</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>qxl</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>none</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>bochs</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>ramfb</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </video>
Aug 03 04:36:41 user nova-compute[72444]:     <hostdev supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='mode'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>subsystem</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='startupPolicy'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>default</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>mandatory</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>requisite</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>optional</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='subsysType'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>usb</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>pci</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>scsi</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='capsType'/>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='pciBackend'/>
Aug 03 04:36:41 user nova-compute[72444]:     </hostdev>
Aug 03 04:36:41 user nova-compute[72444]:     <rng supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='model'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio-transitional</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio-non-transitional</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='backendModel'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>random</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>egd</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>builtin</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </rng>
Aug 03 04:36:41 user nova-compute[72444]:     <filesystem supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='driverType'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>path</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>handle</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtiofs</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </filesystem>
Aug 03 04:36:41 user nova-compute[72444]:     <tpm supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='model'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>tpm-tis</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>tpm-crb</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='backendModel'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>passthrough</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>emulator</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </tpm>
Aug 03 04:36:41 user nova-compute[72444]:   </devices>
Aug 03 04:36:41 user nova-compute[72444]:   <features>
Aug 03 04:36:41 user nova-compute[72444]:     <gic supported='no'/>
Aug 03 04:36:41 user nova-compute[72444]:     <vmcoreinfo supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:     <genid supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:     <backingStoreInput supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:     <backup supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:     <sev supported='no'/>
Aug 03 04:36:41 user nova-compute[72444]:   </features>
Aug 03 04:36:41 user nova-compute[72444]: </domainCapabilities>
Aug 03 04:36:41 user nova-compute[72444]:  {{(pid=72444) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=72444) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72444) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72444) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72444) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72444) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72444) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72444) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72444) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72444) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72444) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72444) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72444) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72444) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72444) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72444) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72444) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72444) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=72444) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72444) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72444) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72444) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=72444) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72444) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72444) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72444) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72444) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72444) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72444) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72444) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72444) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72444) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72444) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72444) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72444) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72444) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72444) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72444) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72444) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'ubuntu', 'q35', 'pc'} {{(pid=72444) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 03 04:36:41 user nova-compute[72444]: <domainCapabilities>
Aug 03 04:36:41 user nova-compute[72444]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 03 04:36:41 user nova-compute[72444]:   <domain>kvm</domain>
Aug 03 04:36:41 user nova-compute[72444]:   <machine>pc-q35-jammy</machine>
Aug 03 04:36:41 user nova-compute[72444]:   <arch>x86_64</arch>
Aug 03 04:36:41 user nova-compute[72444]:   <vcpu max='288'/>
Aug 03 04:36:41 user nova-compute[72444]:   <iothreads supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:   <os supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:     <enum name='firmware'>
Aug 03 04:36:41 user nova-compute[72444]:       <value>efi</value>
Aug 03 04:36:41 user nova-compute[72444]:     </enum>
Aug 03 04:36:41 user nova-compute[72444]:     <loader supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 03 04:36:41 user nova-compute[72444]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 03 04:36:41 user nova-compute[72444]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='type'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>rom</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>pflash</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='readonly'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>yes</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>no</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='secure'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>yes</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>no</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </loader>
Aug 03 04:36:41 user nova-compute[72444]:   </os>
Aug 03 04:36:41 user nova-compute[72444]:   <cpu>
Aug 03 04:36:41 user nova-compute[72444]:     <mode name='host-passthrough' supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='hostPassthroughMigratable'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>on</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>off</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </mode>
Aug 03 04:36:41 user nova-compute[72444]:     <mode name='maximum' supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='maximumMigratable'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>on</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>off</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </mode>
Aug 03 04:36:41 user nova-compute[72444]:     <mode name='host-model' supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <vendor>Intel</vendor>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='ss'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='vmx'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='pcid'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='hypervisor'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='arat'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='tsc_adjust'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='umip'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='md-clear'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='stibp'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='arch-capabilities'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='ssbd'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='invtsc'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='ibpb'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='ibrs'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='amd-stibp'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='amd-ssbd'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='rsba'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='pschange-mc-no'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='disable' name='erms'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='disable' name='xsaveopt'/>
Aug 03 04:36:41 user nova-compute[72444]:     </mode>
Aug 03 04:36:41 user nova-compute[72444]:     <mode name='custom' supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>qemu64</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>qemu32</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>phenom</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>pentium3</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>pentium2</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>pentium</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>n270</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>kvm64</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>kvm32</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>coreduo</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>core2duo</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>athlon</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>Westmere-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>Westmere</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Snowridge</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Server</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Client</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>SandyBridge</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>Penryn</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Opteron_G5</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Opteron_G4</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Opteron_G3</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Opteron_G2</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>Opteron_G1</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>Nehalem</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>IvyBridge</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Icelake-Server</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Haswell-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Haswell-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Haswell</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>EPYC-Rome</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>EPYC-Milan</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>EPYC-IBPB</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>EPYC</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Dhyana</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Cooperlake</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>Conroe</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Cascadelake-Server</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Broadwell-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Broadwell-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Broadwell</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>486</model>
Aug 03 04:36:41 user nova-compute[72444]:     </mode>
Aug 03 04:36:41 user nova-compute[72444]:   </cpu>
Aug 03 04:36:41 user nova-compute[72444]:   <memoryBacking supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:     <enum name='sourceType'>
Aug 03 04:36:41 user nova-compute[72444]:       <value>file</value>
Aug 03 04:36:41 user nova-compute[72444]:       <value>anonymous</value>
Aug 03 04:36:41 user nova-compute[72444]:       <value>memfd</value>
Aug 03 04:36:41 user nova-compute[72444]:     </enum>
Aug 03 04:36:41 user nova-compute[72444]:   </memoryBacking>
Aug 03 04:36:41 user nova-compute[72444]:   <devices>
Aug 03 04:36:41 user nova-compute[72444]:     <disk supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='diskDevice'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>disk</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>cdrom</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>floppy</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>lun</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='bus'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>fdc</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>scsi</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>usb</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>sata</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='model'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio-transitional</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio-non-transitional</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </disk>
Aug 03 04:36:41 user nova-compute[72444]:     <graphics supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='type'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>sdl</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>vnc</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>spice</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>egl-headless</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </graphics>
Aug 03 04:36:41 user nova-compute[72444]:     <video supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='modelType'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>vga</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>cirrus</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>vmvga</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>qxl</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>none</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>bochs</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>ramfb</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </video>
Aug 03 04:36:41 user nova-compute[72444]:     <hostdev supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='mode'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>subsystem</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='startupPolicy'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>default</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>mandatory</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>requisite</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>optional</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='subsysType'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>usb</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>pci</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>scsi</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='capsType'/>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='pciBackend'/>
Aug 03 04:36:41 user nova-compute[72444]:     </hostdev>
Aug 03 04:36:41 user nova-compute[72444]:     <rng supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='model'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio-transitional</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio-non-transitional</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='backendModel'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>random</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>egd</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>builtin</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </rng>
Aug 03 04:36:41 user nova-compute[72444]:     <filesystem supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='driverType'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>path</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>handle</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtiofs</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </filesystem>
Aug 03 04:36:41 user nova-compute[72444]:     <tpm supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='model'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>tpm-tis</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>tpm-crb</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='backendModel'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>passthrough</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>emulator</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </tpm>
Aug 03 04:36:41 user nova-compute[72444]:   </devices>
Aug 03 04:36:41 user nova-compute[72444]:   <features>
Aug 03 04:36:41 user nova-compute[72444]:     <gic supported='no'/>
Aug 03 04:36:41 user nova-compute[72444]:     <vmcoreinfo supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:     <genid supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:     <backingStoreInput supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:     <backup supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:     <sev supported='no'/>
Aug 03 04:36:41 user nova-compute[72444]:   </features>
Aug 03 04:36:41 user nova-compute[72444]: </domainCapabilities>
Aug 03 04:36:41 user nova-compute[72444]:  {{(pid=72444) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 03 04:36:41 user nova-compute[72444]: <domainCapabilities>
Aug 03 04:36:41 user nova-compute[72444]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 03 04:36:41 user nova-compute[72444]:   <domain>kvm</domain>
Aug 03 04:36:41 user nova-compute[72444]:   <machine>pc-i440fx-jammy</machine>
Aug 03 04:36:41 user nova-compute[72444]:   <arch>x86_64</arch>
Aug 03 04:36:41 user nova-compute[72444]:   <vcpu max='255'/>
Aug 03 04:36:41 user nova-compute[72444]:   <iothreads supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:   <os supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:     <enum name='firmware'>
Aug 03 04:36:41 user nova-compute[72444]:       <value>efi</value>
Aug 03 04:36:41 user nova-compute[72444]:     </enum>
Aug 03 04:36:41 user nova-compute[72444]:     <loader supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='type'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>rom</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>pflash</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='readonly'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>yes</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>no</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='secure'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>no</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </loader>
Aug 03 04:36:41 user nova-compute[72444]:   </os>
Aug 03 04:36:41 user nova-compute[72444]:   <cpu>
Aug 03 04:36:41 user nova-compute[72444]:     <mode name='host-passthrough' supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='hostPassthroughMigratable'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>on</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>off</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </mode>
Aug 03 04:36:41 user nova-compute[72444]:     <mode name='maximum' supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='maximumMigratable'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>on</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>off</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </mode>
Aug 03 04:36:41 user nova-compute[72444]:     <mode name='host-model' supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <vendor>Intel</vendor>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='ss'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='vmx'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='pcid'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='hypervisor'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='arat'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='tsc_adjust'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='umip'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='md-clear'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='stibp'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='arch-capabilities'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='ssbd'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='invtsc'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='ibpb'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='ibrs'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='amd-stibp'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='amd-ssbd'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='rsba'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='pschange-mc-no'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='disable' name='erms'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='disable' name='xsaveopt'/>
Aug 03 04:36:41 user nova-compute[72444]:     </mode>
Aug 03 04:36:41 user nova-compute[72444]:     <mode name='custom' supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>qemu64</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>qemu32</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>phenom</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>pentium3</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>pentium2</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>pentium</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>n270</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>kvm64</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>kvm32</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>coreduo</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>core2duo</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>athlon</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>Westmere-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>Westmere</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Snowridge</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Server</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Client</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>SandyBridge</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>Penryn</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Opteron_G5</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Opteron_G4</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Opteron_G3</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Opteron_G2</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>Opteron_G1</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>Nehalem</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>IvyBridge</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Icelake-Server</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Haswell-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Haswell-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Haswell</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>EPYC-Rome</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>EPYC-Milan</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>EPYC-IBPB</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>EPYC</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Dhyana</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Cooperlake</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>Conroe</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Cascadelake-Server</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Broadwell-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Broadwell-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Broadwell</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>486</model>
Aug 03 04:36:41 user nova-compute[72444]:     </mode>
Aug 03 04:36:41 user nova-compute[72444]:   </cpu>
Aug 03 04:36:41 user nova-compute[72444]:   <memoryBacking supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:     <enum name='sourceType'>
Aug 03 04:36:41 user nova-compute[72444]:       <value>file</value>
Aug 03 04:36:41 user nova-compute[72444]:       <value>anonymous</value>
Aug 03 04:36:41 user nova-compute[72444]:       <value>memfd</value>
Aug 03 04:36:41 user nova-compute[72444]:     </enum>
Aug 03 04:36:41 user nova-compute[72444]:   </memoryBacking>
Aug 03 04:36:41 user nova-compute[72444]:   <devices>
Aug 03 04:36:41 user nova-compute[72444]:     <disk supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='diskDevice'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>disk</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>cdrom</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>floppy</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>lun</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='bus'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>ide</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>fdc</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>scsi</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>usb</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>sata</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='model'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio-transitional</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio-non-transitional</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </disk>
Aug 03 04:36:41 user nova-compute[72444]:     <graphics supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='type'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>sdl</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>vnc</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>spice</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>egl-headless</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </graphics>
Aug 03 04:36:41 user nova-compute[72444]:     <video supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='modelType'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>vga</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>cirrus</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>vmvga</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>qxl</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>none</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>bochs</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>ramfb</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </video>
Aug 03 04:36:41 user nova-compute[72444]:     <hostdev supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='mode'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>subsystem</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='startupPolicy'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>default</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>mandatory</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>requisite</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>optional</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='subsysType'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>usb</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>pci</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>scsi</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='capsType'/>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='pciBackend'/>
Aug 03 04:36:41 user nova-compute[72444]:     </hostdev>
Aug 03 04:36:41 user nova-compute[72444]:     <rng supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='model'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio-transitional</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio-non-transitional</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='backendModel'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>random</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>egd</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>builtin</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </rng>
Aug 03 04:36:41 user nova-compute[72444]:     <filesystem supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='driverType'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>path</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>handle</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtiofs</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </filesystem>
Aug 03 04:36:41 user nova-compute[72444]:     <tpm supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='model'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>tpm-tis</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>tpm-crb</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='backendModel'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>passthrough</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>emulator</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </tpm>
Aug 03 04:36:41 user nova-compute[72444]:   </devices>
Aug 03 04:36:41 user nova-compute[72444]:   <features>
Aug 03 04:36:41 user nova-compute[72444]:     <gic supported='no'/>
Aug 03 04:36:41 user nova-compute[72444]:     <vmcoreinfo supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:     <genid supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:     <backingStoreInput supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:     <backup supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:     <sev supported='no'/>
Aug 03 04:36:41 user nova-compute[72444]:   </features>
Aug 03 04:36:41 user nova-compute[72444]: </domainCapabilities>
Aug 03 04:36:41 user nova-compute[72444]:  {{(pid=72444) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 03 04:36:41 user nova-compute[72444]: <domainCapabilities>
Aug 03 04:36:41 user nova-compute[72444]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 03 04:36:41 user nova-compute[72444]:   <domain>kvm</domain>
Aug 03 04:36:41 user nova-compute[72444]:   <machine>pc-q35-6.2</machine>
Aug 03 04:36:41 user nova-compute[72444]:   <arch>x86_64</arch>
Aug 03 04:36:41 user nova-compute[72444]:   <vcpu max='288'/>
Aug 03 04:36:41 user nova-compute[72444]:   <iothreads supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:   <os supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:     <enum name='firmware'>
Aug 03 04:36:41 user nova-compute[72444]:       <value>efi</value>
Aug 03 04:36:41 user nova-compute[72444]:     </enum>
Aug 03 04:36:41 user nova-compute[72444]:     <loader supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 03 04:36:41 user nova-compute[72444]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 03 04:36:41 user nova-compute[72444]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='type'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>rom</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>pflash</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='readonly'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>yes</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>no</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='secure'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>yes</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>no</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </loader>
Aug 03 04:36:41 user nova-compute[72444]:   </os>
Aug 03 04:36:41 user nova-compute[72444]:   <cpu>
Aug 03 04:36:41 user nova-compute[72444]:     <mode name='host-passthrough' supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='hostPassthroughMigratable'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>on</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>off</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </mode>
Aug 03 04:36:41 user nova-compute[72444]:     <mode name='maximum' supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='maximumMigratable'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>on</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>off</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </mode>
Aug 03 04:36:41 user nova-compute[72444]:     <mode name='host-model' supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <vendor>Intel</vendor>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='ss'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='vmx'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='pcid'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='hypervisor'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='arat'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='tsc_adjust'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='umip'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='md-clear'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='stibp'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='arch-capabilities'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='ssbd'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='invtsc'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='ibpb'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='ibrs'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='amd-stibp'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='amd-ssbd'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='rsba'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='pschange-mc-no'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='disable' name='erms'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='disable' name='xsaveopt'/>
Aug 03 04:36:41 user nova-compute[72444]:     </mode>
Aug 03 04:36:41 user nova-compute[72444]:     <mode name='custom' supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>qemu64</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>qemu32</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>phenom</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>pentium3</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>pentium2</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>pentium</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>n270</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>kvm64</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>kvm32</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>coreduo</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>core2duo</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>athlon</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>Westmere-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>Westmere</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Snowridge</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Server</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Client</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>SandyBridge</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>Penryn</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Opteron_G5</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Opteron_G4</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Opteron_G3</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Opteron_G2</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>Opteron_G1</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>Nehalem</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>IvyBridge</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Icelake-Server</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Haswell-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Haswell-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Haswell</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>EPYC-Rome</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>EPYC-Milan</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>EPYC-IBPB</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>EPYC</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Dhyana</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Cooperlake</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>Conroe</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Cascadelake-Server</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Broadwell-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Broadwell-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Broadwell</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>486</model>
Aug 03 04:36:41 user nova-compute[72444]:     </mode>
Aug 03 04:36:41 user nova-compute[72444]:   </cpu>
Aug 03 04:36:41 user nova-compute[72444]:   <memoryBacking supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:     <enum name='sourceType'>
Aug 03 04:36:41 user nova-compute[72444]:       <value>file</value>
Aug 03 04:36:41 user nova-compute[72444]:       <value>anonymous</value>
Aug 03 04:36:41 user nova-compute[72444]:       <value>memfd</value>
Aug 03 04:36:41 user nova-compute[72444]:     </enum>
Aug 03 04:36:41 user nova-compute[72444]:   </memoryBacking>
Aug 03 04:36:41 user nova-compute[72444]:   <devices>
Aug 03 04:36:41 user nova-compute[72444]:     <disk supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='diskDevice'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>disk</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>cdrom</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>floppy</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>lun</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='bus'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>fdc</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>scsi</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>usb</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>sata</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='model'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio-transitional</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio-non-transitional</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </disk>
Aug 03 04:36:41 user nova-compute[72444]:     <graphics supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='type'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>sdl</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>vnc</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>spice</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>egl-headless</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </graphics>
Aug 03 04:36:41 user nova-compute[72444]:     <video supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='modelType'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>vga</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>cirrus</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>vmvga</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>qxl</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>none</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>bochs</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>ramfb</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </video>
Aug 03 04:36:41 user nova-compute[72444]:     <hostdev supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='mode'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>subsystem</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='startupPolicy'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>default</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>mandatory</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>requisite</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>optional</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='subsysType'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>usb</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>pci</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>scsi</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='capsType'/>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='pciBackend'/>
Aug 03 04:36:41 user nova-compute[72444]:     </hostdev>
Aug 03 04:36:41 user nova-compute[72444]:     <rng supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='model'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio-transitional</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio-non-transitional</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='backendModel'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>random</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>egd</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>builtin</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </rng>
Aug 03 04:36:41 user nova-compute[72444]:     <filesystem supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='driverType'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>path</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>handle</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtiofs</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </filesystem>
Aug 03 04:36:41 user nova-compute[72444]:     <tpm supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='model'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>tpm-tis</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>tpm-crb</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='backendModel'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>passthrough</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>emulator</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </tpm>
Aug 03 04:36:41 user nova-compute[72444]:   </devices>
Aug 03 04:36:41 user nova-compute[72444]:   <features>
Aug 03 04:36:41 user nova-compute[72444]:     <gic supported='no'/>
Aug 03 04:36:41 user nova-compute[72444]:     <vmcoreinfo supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:     <genid supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:     <backingStoreInput supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:     <backup supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:     <sev supported='no'/>
Aug 03 04:36:41 user nova-compute[72444]:   </features>
Aug 03 04:36:41 user nova-compute[72444]: </domainCapabilities>
Aug 03 04:36:41 user nova-compute[72444]:  {{(pid=72444) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 03 04:36:41 user nova-compute[72444]: <domainCapabilities>
Aug 03 04:36:41 user nova-compute[72444]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 03 04:36:41 user nova-compute[72444]:   <domain>kvm</domain>
Aug 03 04:36:41 user nova-compute[72444]:   <machine>pc-i440fx-6.2</machine>
Aug 03 04:36:41 user nova-compute[72444]:   <arch>x86_64</arch>
Aug 03 04:36:41 user nova-compute[72444]:   <vcpu max='255'/>
Aug 03 04:36:41 user nova-compute[72444]:   <iothreads supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:   <os supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:     <enum name='firmware'>
Aug 03 04:36:41 user nova-compute[72444]:       <value>efi</value>
Aug 03 04:36:41 user nova-compute[72444]:     </enum>
Aug 03 04:36:41 user nova-compute[72444]:     <loader supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='type'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>rom</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>pflash</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='readonly'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>yes</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>no</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='secure'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>no</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </loader>
Aug 03 04:36:41 user nova-compute[72444]:   </os>
Aug 03 04:36:41 user nova-compute[72444]:   <cpu>
Aug 03 04:36:41 user nova-compute[72444]:     <mode name='host-passthrough' supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='hostPassthroughMigratable'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>on</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>off</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </mode>
Aug 03 04:36:41 user nova-compute[72444]:     <mode name='maximum' supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='maximumMigratable'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>on</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>off</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </mode>
Aug 03 04:36:41 user nova-compute[72444]:     <mode name='host-model' supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <vendor>Intel</vendor>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='ss'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='vmx'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='pcid'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='hypervisor'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='arat'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='tsc_adjust'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='umip'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='md-clear'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='stibp'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='arch-capabilities'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='ssbd'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='invtsc'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='ibpb'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='ibrs'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='amd-stibp'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='amd-ssbd'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='rsba'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='require' name='pschange-mc-no'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='disable' name='erms'/>
Aug 03 04:36:41 user nova-compute[72444]:       <feature policy='disable' name='xsaveopt'/>
Aug 03 04:36:41 user nova-compute[72444]:     </mode>
Aug 03 04:36:41 user nova-compute[72444]:     <mode name='custom' supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>qemu64</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>qemu32</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>phenom</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>pentium3</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>pentium2</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>pentium</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>n270</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>kvm64</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>kvm32</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>coreduo</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>core2duo</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>athlon</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>Westmere-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>Westmere</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Snowridge</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Server</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Skylake-Client</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>SandyBridge</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>Penryn</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Opteron_G5</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Opteron_G4</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Opteron_G3</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Opteron_G2</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>Opteron_G1</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>Nehalem</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>IvyBridge</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Icelake-Server</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Haswell-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Haswell-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Haswell</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>EPYC-Rome</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>EPYC-Milan</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>EPYC-IBPB</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>EPYC</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Dhyana</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Cooperlake</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>Conroe</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Cascadelake-Server</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Broadwell-noTSX</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Broadwell-IBRS</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='no'>Broadwell</model>
Aug 03 04:36:41 user nova-compute[72444]:       <model usable='yes'>486</model>
Aug 03 04:36:41 user nova-compute[72444]:     </mode>
Aug 03 04:36:41 user nova-compute[72444]:   </cpu>
Aug 03 04:36:41 user nova-compute[72444]:   <memoryBacking supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:     <enum name='sourceType'>
Aug 03 04:36:41 user nova-compute[72444]:       <value>file</value>
Aug 03 04:36:41 user nova-compute[72444]:       <value>anonymous</value>
Aug 03 04:36:41 user nova-compute[72444]:       <value>memfd</value>
Aug 03 04:36:41 user nova-compute[72444]:     </enum>
Aug 03 04:36:41 user nova-compute[72444]:   </memoryBacking>
Aug 03 04:36:41 user nova-compute[72444]:   <devices>
Aug 03 04:36:41 user nova-compute[72444]:     <disk supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='diskDevice'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>disk</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>cdrom</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>floppy</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>lun</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='bus'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>ide</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>fdc</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>scsi</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>usb</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>sata</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='model'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio-transitional</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio-non-transitional</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </disk>
Aug 03 04:36:41 user nova-compute[72444]:     <graphics supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='type'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>sdl</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>vnc</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>spice</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>egl-headless</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </graphics>
Aug 03 04:36:41 user nova-compute[72444]:     <video supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='modelType'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>vga</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>cirrus</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>vmvga</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>qxl</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>none</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>bochs</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>ramfb</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </video>
Aug 03 04:36:41 user nova-compute[72444]:     <hostdev supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='mode'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>subsystem</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='startupPolicy'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>default</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>mandatory</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>requisite</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>optional</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='subsysType'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>usb</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>pci</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>scsi</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='capsType'/>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='pciBackend'/>
Aug 03 04:36:41 user nova-compute[72444]:     </hostdev>
Aug 03 04:36:41 user nova-compute[72444]:     <rng supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='model'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio-transitional</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtio-non-transitional</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='backendModel'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>random</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>egd</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>builtin</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </rng>
Aug 03 04:36:41 user nova-compute[72444]:     <filesystem supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='driverType'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>path</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>handle</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>virtiofs</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </filesystem>
Aug 03 04:36:41 user nova-compute[72444]:     <tpm supported='yes'>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='model'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>tpm-tis</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>tpm-crb</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:       <enum name='backendModel'>
Aug 03 04:36:41 user nova-compute[72444]:         <value>passthrough</value>
Aug 03 04:36:41 user nova-compute[72444]:         <value>emulator</value>
Aug 03 04:36:41 user nova-compute[72444]:       </enum>
Aug 03 04:36:41 user nova-compute[72444]:     </tpm>
Aug 03 04:36:41 user nova-compute[72444]:   </devices>
Aug 03 04:36:41 user nova-compute[72444]:   <features>
Aug 03 04:36:41 user nova-compute[72444]:     <gic supported='no'/>
Aug 03 04:36:41 user nova-compute[72444]:     <vmcoreinfo supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:     <genid supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:     <backingStoreInput supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:     <backup supported='yes'/>
Aug 03 04:36:41 user nova-compute[72444]:     <sev supported='no'/>
Aug 03 04:36:41 user nova-compute[72444]:   </features>
Aug 03 04:36:41 user nova-compute[72444]: </domainCapabilities>
Aug 03 04:36:41 user nova-compute[72444]:  {{(pid=72444) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72444) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72444) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72444) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72444) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Checking secure boot support for host arch (x86_64) {{(pid=72444) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 03 04:36:41 user nova-compute[72444]: INFO nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Secure Boot support detected
Aug 03 04:36:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] cpu compare xml: <cpu match="exact">
Aug 03 04:36:41 user nova-compute[72444]:   <model>Nehalem</model>
Aug 03 04:36:41 user nova-compute[72444]: </cpu>
Aug 03 04:36:41 user nova-compute[72444]:  {{(pid=72444) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 03 04:36:41 user nova-compute[72444]: INFO nova.virt.node [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Generated node identity b624a913-bb6b-4a17-8cd7-7b0950cff161
Aug 03 04:36:41 user nova-compute[72444]: INFO nova.virt.node [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Wrote node identity b624a913-bb6b-4a17-8cd7-7b0950cff161 to /opt/stack/data/nova/compute_id
Aug 03 04:36:41 user nova-compute[72444]: WARNING nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Compute nodes ['b624a913-bb6b-4a17-8cd7-7b0950cff161'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 03 04:36:41 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 03 04:36:42 user nova-compute[72444]: WARNING nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 03 04:36:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:36:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:36:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:36:42 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 04:36:42 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:36:42 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:36:42 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Hypervisor/Node resource view: name=user free_ram=10879MB free_disk=26.456241607666016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 04:36:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:36:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:36:42 user nova-compute[72444]: WARNING nova.compute.resource_tracker [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] No compute node record for user:b624a913-bb6b-4a17-8cd7-7b0950cff161: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host b624a913-bb6b-4a17-8cd7-7b0950cff161 could not be found.
Aug 03 04:36:42 user nova-compute[72444]: INFO nova.compute.resource_tracker [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Compute node record created for user:user with uuid: b624a913-bb6b-4a17-8cd7-7b0950cff161
Aug 03 04:36:42 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 04:36:42 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 04:36:42 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [req-a6e6c227-7122-4f16-b99d-71238829ebfa] Created resource provider record via placement API for resource provider with UUID b624a913-bb6b-4a17-8cd7-7b0950cff161 and name user.
Aug 03 04:36:42 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72444) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 03 04:36:42 user nova-compute[72444]: INFO nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] kernel doesn't support AMD SEV
Aug 03 04:36:42 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Updating inventory in ProviderTree for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 03 04:36:42 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:36:42 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Libvirt baseline CPU <cpu>
Aug 03 04:36:42 user nova-compute[72444]:   <arch>x86_64</arch>
Aug 03 04:36:42 user nova-compute[72444]:   <model>Nehalem</model>
Aug 03 04:36:42 user nova-compute[72444]:   <vendor>Intel</vendor>
Aug 03 04:36:42 user nova-compute[72444]:   <topology sockets="6" cores="1" threads="1"/>
Aug 03 04:36:42 user nova-compute[72444]: </cpu>
Aug 03 04:36:42 user nova-compute[72444]:  {{(pid=72444) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 03 04:36:42 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Updated inventory for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 03 04:36:42 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Updating resource provider b624a913-bb6b-4a17-8cd7-7b0950cff161 generation from 0 to 1 during operation: update_inventory {{(pid=72444) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 03 04:36:42 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Updating inventory in ProviderTree for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 03 04:36:42 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Updating resource provider b624a913-bb6b-4a17-8cd7-7b0950cff161 generation from 1 to 2 during operation: update_traits {{(pid=72444) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 03 04:36:42 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 04:36:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.594s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:36:42 user nova-compute[72444]: DEBUG nova.service [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Creating RPC server for service compute {{(pid=72444) start /opt/stack/nova/nova/service.py:182}}
Aug 03 04:36:42 user nova-compute[72444]: DEBUG nova.service [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Join ServiceGroup membership for this service compute {{(pid=72444) start /opt/stack/nova/nova/service.py:199}}
Aug 03 04:36:42 user nova-compute[72444]: DEBUG nova.servicegroup.drivers.db [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72444) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 03 04:37:24 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:37:25 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:37:33 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:37:33 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:37:33 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 04:37:33 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Rebuilding the list of instances to heal {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 04:37:33 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Didn't find any instances for network info cache update. {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 03 04:37:33 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:37:33 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:37:33 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:37:33 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:37:33 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:37:33 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:37:33 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 04:37:33 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:37:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:37:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:37:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:37:33 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 04:37:34 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:37:34 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:37:34 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=10235MB free_disk=26.35991668701172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 04:37:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:37:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:37:34 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 04:37:34 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 04:37:34 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:37:34 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:37:34 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 04:37:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.121s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:38:34 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:38:34 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:38:34 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:38:34 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:38:34 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 04:38:34 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Rebuilding the list of instances to heal {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 04:38:34 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Didn't find any instances for network info cache update. {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 03 04:38:34 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:38:34 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:38:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:38:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:38:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:38:34 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 04:38:35 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:38:35 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:38:35 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=10215MB free_disk=26.40500259399414GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 04:38:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:38:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:38:35 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 04:38:35 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 04:38:35 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:38:35 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:38:35 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 04:38:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.122s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:38:36 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:38:36 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:38:36 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:38:36 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:38:36 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 04:39:34 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:39:34 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:39:35 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:39:35 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 04:39:36 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:39:36 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 04:39:36 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Rebuilding the list of instances to heal {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 04:39:36 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Didn't find any instances for network info cache update. {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 03 04:39:36 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:39:36 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:39:36 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:39:36 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:39:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:39:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:39:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:39:36 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 04:39:37 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:39:37 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:39:37 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=10182MB free_disk=26.179019927978516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 04:39:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:39:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:39:37 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 04:39:37 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 04:39:37 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:39:37 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:39:37 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 04:39:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:39:38 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:40:34 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:40:34 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:40:35 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:40:35 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:40:35 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 04:40:36 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:40:36 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:40:37 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:40:37 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:40:37 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:40:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:40:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:40:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:40:38 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 04:40:38 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:40:38 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:40:38 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=9457MB free_disk=26.201385498046875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 04:40:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:40:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:40:38 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 04:40:38 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 04:40:38 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:40:38 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:40:38 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 04:40:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.124s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:40:39 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:40:39 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 04:40:39 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Rebuilding the list of instances to heal {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 04:40:39 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Didn't find any instances for network info cache update. {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 03 04:40:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:40:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:40:41 user nova-compute[72444]: DEBUG nova.compute.manager [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 04:40:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:40:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:40:41 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 04:40:41 user nova-compute[72444]: INFO nova.compute.claims [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Claim successful on node user
Aug 03 04:40:42 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:40:42 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:40:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.321s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:40:42 user nova-compute[72444]: DEBUG nova.compute.manager [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 04:40:42 user nova-compute[72444]: DEBUG nova.compute.manager [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 04:40:42 user nova-compute[72444]: DEBUG nova.network.neutron [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 04:40:42 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 04:40:42 user nova-compute[72444]: DEBUG nova.compute.manager [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 04:40:42 user nova-compute[72444]: DEBUG nova.compute.manager [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 04:40:42 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 04:40:42 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Creating image(s)
Aug 03 04:40:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "/opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:40:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "/opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:40:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "/opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:40:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:40:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:40:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "81725845-6158-4e34-bedb-6e41219bc227" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:40:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "81725845-6158-4e34-bedb-6e41219bc227" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:40:42 user nova-compute[72444]: DEBUG nova.compute.manager [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 04:40:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:40:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:40:42 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 04:40:42 user nova-compute[72444]: INFO nova.compute.claims [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Claim successful on node user
Aug 03 04:40:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e.part --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:40:43 user nova-compute[72444]: DEBUG nova.policy [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '07e8b540c9194e1195cb898ad08acaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a2a64796f4b87a44383014f0af3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 04:40:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e.part --force-share --output=json" returned: 0 in 0.131s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:40:43 user nova-compute[72444]: DEBUG nova.virt.images [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] 9a69e530-bd68-45b7-bffb-f7168139ceb0 was qcow2, converting to raw {{(pid=72444) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 03 04:40:43 user nova-compute[72444]: DEBUG nova.privsep.utils [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72444) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 03 04:40:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e.part /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e.converted {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:40:43 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:40:43 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:40:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e.part /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e.converted" returned: 0 in 0.181s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:40:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e.converted --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:40:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.835s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:40:43 user nova-compute[72444]: DEBUG nova.compute.manager [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 04:40:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e.converted --force-share --output=json" returned: 0 in 0.145s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:40:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.208s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:40:43 user nova-compute[72444]: INFO oslo.privsep.daemon [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmprx38iwne/privsep.sock']
Aug 03 04:40:43 user nova-compute[72444]: DEBUG nova.compute.manager [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 04:40:43 user nova-compute[72444]: DEBUG nova.network.neutron [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 04:40:43 user sudo[81593]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmprx38iwne/privsep.sock
Aug 03 04:40:43 user sudo[81593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 03 04:40:43 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 04:40:43 user nova-compute[72444]: DEBUG nova.compute.manager [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 04:40:43 user nova-compute[72444]: DEBUG nova.compute.manager [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 04:40:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 04:40:43 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Creating image(s)
Aug 03 04:40:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "/opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:40:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "/opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:40:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "/opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:40:43 user nova-compute[72444]: DEBUG nova.policy [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ceede92aa3a74060a7f57d29d0d97aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '929fd4a3127b475282426d4412e58def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 04:40:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "b6ed9c42-fa6e-4a0d-8312-588471e157f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:40:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "b6ed9c42-fa6e-4a0d-8312-588471e157f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:40:44 user nova-compute[72444]: DEBUG nova.compute.manager [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 04:40:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:40:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:40:44 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 04:40:44 user nova-compute[72444]: INFO nova.compute.claims [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Claim successful on node user
Aug 03 04:40:45 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:40:45 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:40:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.451s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:40:45 user nova-compute[72444]: DEBUG nova.compute.manager [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 04:40:45 user nova-compute[72444]: DEBUG nova.compute.manager [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 04:40:45 user nova-compute[72444]: DEBUG nova.network.neutron [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 04:40:45 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 04:40:45 user nova-compute[72444]: DEBUG nova.compute.manager [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 04:40:45 user nova-compute[72444]: DEBUG nova.compute.manager [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 04:40:45 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 04:40:45 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Creating image(s)
Aug 03 04:40:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "/opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:40:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "/opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:40:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "/opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:40:45 user sudo[81593]: pam_unix(sudo:session): session closed for user root
Aug 03 04:40:45 user nova-compute[72444]: INFO oslo.privsep.daemon [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Spawned new privsep daemon via rootwrap
Aug 03 04:40:45 user nova-compute[72444]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 03 04:40:45 user nova-compute[72444]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 03 04:40:45 user nova-compute[72444]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 03 04:40:45 user nova-compute[72444]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81603
Aug 03 04:40:45 user nova-compute[72444]: WARNING oslo_privsep.priv_context [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] privsep daemon already running
Aug 03 04:40:45 user nova-compute[72444]: WARNING oslo_privsep.priv_context [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] privsep daemon already running
Aug 03 04:40:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:40:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:40:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:40:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Acquiring lock "85521338-f660-49ab-a3ab-9eb6df7a7353" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:40:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Lock "85521338-f660-49ab-a3ab-9eb6df7a7353" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:40:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.121s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:40:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:40:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:40:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:40:45 user nova-compute[72444]: DEBUG nova.compute.manager [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 04:40:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.145s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:40:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:40:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.135s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:40:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:40:45 user nova-compute[72444]: DEBUG nova.policy [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '07e8b540c9194e1195cb898ad08acaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a2a64796f4b87a44383014f0af3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 04:40:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.143s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:40:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:40:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:40:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:40:45 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 04:40:45 user nova-compute[72444]: INFO nova.compute.claims [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Claim successful on node user
Aug 03 04:40:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk 1073741824" returned: 0 in 0.051s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:40:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:40:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:40:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.180s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:40:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.145s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Checking if we can resize image /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.156s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk 1073741824" returned: 0 in 0.049s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.404s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Cannot resize image /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG nova.objects.instance [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lazy-loading 'migration_context' on Instance uuid 81725845-6158-4e34-bedb-6e41219bc227 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Ensure instance console log exists: /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.122s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG nova.network.neutron [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Successfully created port: d0cfd0c0-ac67-4335-85d2-6f0b956fae5b {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.141s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.471s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG nova.compute.manager [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG nova.network.neutron [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Successfully created port: 9b1b9675-c2df-4b16-ba94-807765bab119 {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk 1073741824" returned: 0 in 0.050s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG nova.compute.manager [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG nova.network.neutron [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 04:40:46 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Cannot resize image /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG nova.objects.instance [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lazy-loading 'migration_context' on Instance uuid b6ed9c42-fa6e-4a0d-8312-588471e157f7 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG nova.compute.manager [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Ensure instance console log exists: /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.144s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG nova.compute.manager [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 04:40:46 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Creating image(s)
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Acquiring lock "/opt/stack/data/nova/instances/85521338-f660-49ab-a3ab-9eb6df7a7353/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Lock "/opt/stack/data/nova/instances/85521338-f660-49ab-a3ab-9eb6df7a7353/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Lock "/opt/stack/data/nova/instances/85521338-f660-49ab-a3ab-9eb6df7a7353/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Cannot resize image /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG nova.objects.instance [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lazy-loading 'migration_context' on Instance uuid 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Ensure instance console log exists: /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.139s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.128s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/85521338-f660-49ab-a3ab-9eb6df7a7353/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/85521338-f660-49ab-a3ab-9eb6df7a7353/disk 1073741824" returned: 0 in 0.046s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.178s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:40:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:40:47 user nova-compute[72444]: DEBUG nova.policy [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9e32c358290a4170be682ac98bf2e17d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67b7c5d89c244a19f95cc3fc4f33695', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 04:40:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.123s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:40:47 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85521338-f660-49ab-a3ab-9eb6df7a7353/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 04:40:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85521338-f660-49ab-a3ab-9eb6df7a7353/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:40:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85521338-f660-49ab-a3ab-9eb6df7a7353/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:40:47 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Cannot resize image /opt/stack/data/nova/instances/85521338-f660-49ab-a3ab-9eb6df7a7353/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 04:40:47 user nova-compute[72444]: DEBUG nova.objects.instance [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Lazy-loading 'migration_context' on Instance uuid 85521338-f660-49ab-a3ab-9eb6df7a7353 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:40:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 04:40:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Ensure instance console log exists: /opt/stack/data/nova/instances/85521338-f660-49ab-a3ab-9eb6df7a7353/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 04:40:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:40:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:40:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:40:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Acquiring lock "e3089887-56df-42de-bc62-88e6db28daf0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:40:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Lock "e3089887-56df-42de-bc62-88e6db28daf0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:40:48 user nova-compute[72444]: DEBUG nova.compute.manager [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 04:40:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:40:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:40:48 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 04:40:48 user nova-compute[72444]: INFO nova.compute.claims [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Claim successful on node user
Aug 03 04:40:48 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:40:48 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:40:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.383s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:40:48 user nova-compute[72444]: DEBUG nova.compute.manager [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 04:40:48 user nova-compute[72444]: DEBUG nova.compute.manager [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 04:40:48 user nova-compute[72444]: DEBUG nova.network.neutron [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: e3089887-56df-42de-bc62-88e6db28daf0] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 04:40:48 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 04:40:48 user nova-compute[72444]: DEBUG nova.compute.manager [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 04:40:48 user nova-compute[72444]: DEBUG nova.compute.manager [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 04:40:48 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 04:40:48 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Creating image(s)
Aug 03 04:40:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Acquiring lock "/opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:40:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Lock "/opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:40:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Lock "/opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:40:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:40:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.135s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:40:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:40:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:40:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:40:49 user nova-compute[72444]: DEBUG nova.policy [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f3d18e55922c4d41bea8cc96c6c7cae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81df940dade241e1a3560045086f8699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 04:40:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.139s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:40:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:40:49 user nova-compute[72444]: DEBUG nova.network.neutron [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Successfully created port: bd9827e6-3c6f-4bb3-8889-1ae45107f6f0 {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:40:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk 1073741824" returned: 0 in 0.047s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:40:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:40:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:40:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.139s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:40:49 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 04:40:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:40:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:40:49 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Cannot resize image /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 04:40:49 user nova-compute[72444]: DEBUG nova.objects.instance [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Lazy-loading 'migration_context' on Instance uuid e3089887-56df-42de-bc62-88e6db28daf0 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:40:49 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 04:40:49 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Ensure instance console log exists: /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 04:40:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:40:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:40:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:40:49 user nova-compute[72444]: DEBUG nova.network.neutron [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Successfully created port: 19cfd924-3dff-4024-97c6-285ac53c1fcd {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:40:50 user nova-compute[72444]: DEBUG nova.network.neutron [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Successfully updated port: d0cfd0c0-ac67-4335-85d2-6f0b956fae5b {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:40:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "refresh_cache-4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:40:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquired lock "refresh_cache-4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:40:50 user nova-compute[72444]: DEBUG nova.network.neutron [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:40:50 user nova-compute[72444]: DEBUG nova.network.neutron [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Successfully updated port: 9b1b9675-c2df-4b16-ba94-807765bab119 {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:40:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "refresh_cache-81725845-6158-4e34-bedb-6e41219bc227" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:40:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquired lock "refresh_cache-81725845-6158-4e34-bedb-6e41219bc227" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:40:50 user nova-compute[72444]: DEBUG nova.network.neutron [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:40:50 user nova-compute[72444]: DEBUG nova.network.neutron [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:40:50 user nova-compute[72444]: DEBUG nova.compute.manager [req-47b10181-0eaf-41a2-8f30-54c2cd082241 req-7706e260-533f-4f38-a312-79ca375b1033 service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Received event network-changed-d0cfd0c0-ac67-4335-85d2-6f0b956fae5b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:40:50 user nova-compute[72444]: DEBUG nova.compute.manager [req-47b10181-0eaf-41a2-8f30-54c2cd082241 req-7706e260-533f-4f38-a312-79ca375b1033 service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Refreshing instance network info cache due to event network-changed-d0cfd0c0-ac67-4335-85d2-6f0b956fae5b. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:40:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-47b10181-0eaf-41a2-8f30-54c2cd082241 req-7706e260-533f-4f38-a312-79ca375b1033 service nova] Acquiring lock "refresh_cache-4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:40:50 user nova-compute[72444]: DEBUG nova.network.neutron [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:40:51 user nova-compute[72444]: DEBUG nova.compute.manager [req-0171d73d-a28d-45d9-ba0b-994ad177b36e req-4d47b701-1370-4469-9548-7a9afa9188c9 service nova] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Received event network-changed-9b1b9675-c2df-4b16-ba94-807765bab119 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:40:51 user nova-compute[72444]: DEBUG nova.compute.manager [req-0171d73d-a28d-45d9-ba0b-994ad177b36e req-4d47b701-1370-4469-9548-7a9afa9188c9 service nova] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Refreshing instance network info cache due to event network-changed-9b1b9675-c2df-4b16-ba94-807765bab119. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:40:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0171d73d-a28d-45d9-ba0b-994ad177b36e req-4d47b701-1370-4469-9548-7a9afa9188c9 service nova] Acquiring lock "refresh_cache-81725845-6158-4e34-bedb-6e41219bc227" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.network.neutron [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Successfully updated port: bd9827e6-3c6f-4bb3-8889-1ae45107f6f0 {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "refresh_cache-b6ed9c42-fa6e-4a0d-8312-588471e157f7" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquired lock "refresh_cache-b6ed9c42-fa6e-4a0d-8312-588471e157f7" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.network.neutron [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.network.neutron [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Updating instance_info_cache with network_info: [{"id": "d0cfd0c0-ac67-4335-85d2-6f0b956fae5b", "address": "fa:16:3e:e0:f6:85", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cfd0c0-ac", "ovs_interfaceid": "d0cfd0c0-ac67-4335-85d2-6f0b956fae5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Releasing lock "refresh_cache-4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.compute.manager [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Instance network_info: |[{"id": "d0cfd0c0-ac67-4335-85d2-6f0b956fae5b", "address": "fa:16:3e:e0:f6:85", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cfd0c0-ac", "ovs_interfaceid": "d0cfd0c0-ac67-4335-85d2-6f0b956fae5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.network.neutron [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Successfully created port: 6eadddef-1b9b-4a34-8217-dc485697332f {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-47b10181-0eaf-41a2-8f30-54c2cd082241 req-7706e260-533f-4f38-a312-79ca375b1033 service nova] Acquired lock "refresh_cache-4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.network.neutron [req-47b10181-0eaf-41a2-8f30-54c2cd082241 req-7706e260-533f-4f38-a312-79ca375b1033 service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Refreshing network info cache for port d0cfd0c0-ac67-4335-85d2-6f0b956fae5b {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Start _get_guest_xml network_info=[{"id": "d0cfd0c0-ac67-4335-85d2-6f0b956fae5b", "address": "fa:16:3e:e0:f6:85", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cfd0c0-ac", "ovs_interfaceid": "d0cfd0c0-ac67-4335-85d2-6f0b956fae5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:40:52 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:40:52 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.privsep.utils [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72444) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:40:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-394752472',display_name='tempest-ServerRescueNegativeTestJSON-server-394752472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-394752472',id=1,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='063a2a64796f4b87a44383014f0af3dc',ramdisk_id='',reservation_id='r-5uc5v2n5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-665683708',owner_user_name='tempest-ServerRescueNegativeTestJSON-665683708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:40:42Z,user_data=None,user_id='07e8b540c9194e1195cb898ad08acaa0',uuid=4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0cfd0c0-ac67-4335-85d2-6f0b956fae5b", "address": "fa:16:3e:e0:f6:85", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cfd0c0-ac", "ovs_interfaceid": "d0cfd0c0-ac67-4335-85d2-6f0b956fae5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Converting VIF {"id": "d0cfd0c0-ac67-4335-85d2-6f0b956fae5b", "address": "fa:16:3e:e0:f6:85", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cfd0c0-ac", "ovs_interfaceid": "d0cfd0c0-ac67-4335-85d2-6f0b956fae5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:f6:85,bridge_name='br-int',has_traffic_filtering=True,id=d0cfd0c0-ac67-4335-85d2-6f0b956fae5b,network=Network(bc85da72-7764-4b65-a071-aec46e3a2398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0cfd0c0-ac') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.objects.instance [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.network.neutron [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.network.neutron [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Updating instance_info_cache with network_info: [{"id": "9b1b9675-c2df-4b16-ba94-807765bab119", "address": "fa:16:3e:e6:7a:2e", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b1b9675-c2", "ovs_interfaceid": "9b1b9675-c2df-4b16-ba94-807765bab119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.compute.manager [req-f681117e-b004-4111-a3b5-972ba78dc93e req-9dba3539-b9cf-4070-82aa-9422df63ddbc service nova] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Received event network-changed-bd9827e6-3c6f-4bb3-8889-1ae45107f6f0 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.compute.manager [req-f681117e-b004-4111-a3b5-972ba78dc93e req-9dba3539-b9cf-4070-82aa-9422df63ddbc service nova] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Refreshing instance network info cache due to event network-changed-bd9827e6-3c6f-4bb3-8889-1ae45107f6f0. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f681117e-b004-4111-a3b5-972ba78dc93e req-9dba3539-b9cf-4070-82aa-9422df63ddbc service nova] Acquiring lock "refresh_cache-b6ed9c42-fa6e-4a0d-8312-588471e157f7" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:40:52 user nova-compute[72444]:   <uuid>4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0</uuid>
Aug 03 04:40:52 user nova-compute[72444]:   <name>instance-00000001</name>
Aug 03 04:40:52 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:40:52 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:40:52 user nova-compute[72444]:   <metadata>
Aug 03 04:40:52 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:40:52 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:40:52 user nova-compute[72444]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-394752472</nova:name>
Aug 03 04:40:52 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:40:52</nova:creationTime>
Aug 03 04:40:52 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:40:52 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:40:52 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:40:52 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:40:52 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:40:52 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:40:52 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:40:52 user nova-compute[72444]:       <nova:owner>
Aug 03 04:40:52 user nova-compute[72444]:         <nova:user uuid="07e8b540c9194e1195cb898ad08acaa0">tempest-ServerRescueNegativeTestJSON-665683708-project-member</nova:user>
Aug 03 04:40:52 user nova-compute[72444]:         <nova:project uuid="063a2a64796f4b87a44383014f0af3dc">tempest-ServerRescueNegativeTestJSON-665683708</nova:project>
Aug 03 04:40:52 user nova-compute[72444]:       </nova:owner>
Aug 03 04:40:52 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:40:52 user nova-compute[72444]:       <nova:ports>
Aug 03 04:40:52 user nova-compute[72444]:         <nova:port uuid="d0cfd0c0-ac67-4335-85d2-6f0b956fae5b">
Aug 03 04:40:52 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 03 04:40:52 user nova-compute[72444]:         </nova:port>
Aug 03 04:40:52 user nova-compute[72444]:       </nova:ports>
Aug 03 04:40:52 user nova-compute[72444]:     </nova:instance>
Aug 03 04:40:52 user nova-compute[72444]:   </metadata>
Aug 03 04:40:52 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:40:52 user nova-compute[72444]:     <system>
Aug 03 04:40:52 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:40:52 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:40:52 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:40:52 user nova-compute[72444]:       <entry name="serial">4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0</entry>
Aug 03 04:40:52 user nova-compute[72444]:       <entry name="uuid">4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0</entry>
Aug 03 04:40:52 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:40:52 user nova-compute[72444]:     </system>
Aug 03 04:40:52 user nova-compute[72444]:   </sysinfo>
Aug 03 04:40:52 user nova-compute[72444]:   <os>
Aug 03 04:40:52 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:40:52 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:40:52 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:40:52 user nova-compute[72444]:   </os>
Aug 03 04:40:52 user nova-compute[72444]:   <features>
Aug 03 04:40:52 user nova-compute[72444]:     <acpi/>
Aug 03 04:40:52 user nova-compute[72444]:     <apic/>
Aug 03 04:40:52 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:40:52 user nova-compute[72444]:   </features>
Aug 03 04:40:52 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:40:52 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:40:52 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:40:52 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:40:52 user nova-compute[72444]:   </clock>
Aug 03 04:40:52 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:40:52 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:40:52 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:40:52 user nova-compute[72444]:   </cpu>
Aug 03 04:40:52 user nova-compute[72444]:   <devices>
Aug 03 04:40:52 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:40:52 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:40:52 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk"/>
Aug 03 04:40:52 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:40:52 user nova-compute[72444]:     </disk>
Aug 03 04:40:52 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:40:52 user nova-compute[72444]:       <mac address="fa:16:3e:e0:f6:85"/>
Aug 03 04:40:52 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:40:52 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:40:52 user nova-compute[72444]:       <target dev="tapd0cfd0c0-ac"/>
Aug 03 04:40:52 user nova-compute[72444]:     </interface>
Aug 03 04:40:52 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:40:52 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/console.log" append="off"/>
Aug 03 04:40:52 user nova-compute[72444]:     </serial>
Aug 03 04:40:52 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:40:52 user nova-compute[72444]:     <video>
Aug 03 04:40:52 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:40:52 user nova-compute[72444]:     </video>
Aug 03 04:40:52 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:40:52 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:40:52 user nova-compute[72444]:     </rng>
Aug 03 04:40:52 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:40:52 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:40:52 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:40:52 user nova-compute[72444]:     </memballoon>
Aug 03 04:40:52 user nova-compute[72444]:   </devices>
Aug 03 04:40:52 user nova-compute[72444]: </domain>
Aug 03 04:40:52 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:40:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-394752472',display_name='tempest-ServerRescueNegativeTestJSON-server-394752472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-394752472',id=1,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='063a2a64796f4b87a44383014f0af3dc',ramdisk_id='',reservation_id='r-5uc5v2n5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-665683708',owner_user_name='tempest-ServerRescueNegativeTestJSON-665683708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:40:42Z,user_data=None,user_id='07e8b540c9194e1195cb898ad08acaa0',uuid=4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0cfd0c0-ac67-4335-85d2-6f0b956fae5b", "address": "fa:16:3e:e0:f6:85", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cfd0c0-ac", "ovs_interfaceid": "d0cfd0c0-ac67-4335-85d2-6f0b956fae5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Converting VIF {"id": "d0cfd0c0-ac67-4335-85d2-6f0b956fae5b", "address": "fa:16:3e:e0:f6:85", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cfd0c0-ac", "ovs_interfaceid": "d0cfd0c0-ac67-4335-85d2-6f0b956fae5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:f6:85,bridge_name='br-int',has_traffic_filtering=True,id=d0cfd0c0-ac67-4335-85d2-6f0b956fae5b,network=Network(bc85da72-7764-4b65-a071-aec46e3a2398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0cfd0c0-ac') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG os_vif [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:f6:85,bridge_name='br-int',has_traffic_filtering=True,id=d0cfd0c0-ac67-4335-85d2-6f0b956fae5b,network=Network(bc85da72-7764-4b65-a071-aec46e3a2398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0cfd0c0-ac') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Created schema index Interface.name {{(pid=72444) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Created schema index Port.name {{(pid=72444) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Created schema index Bridge.name {{(pid=72444) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [POLLOUT] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:40:52 user nova-compute[72444]: INFO oslo.privsep.daemon [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpklp25i47/privsep.sock']
Aug 03 04:40:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Releasing lock "refresh_cache-81725845-6158-4e34-bedb-6e41219bc227" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.compute.manager [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Instance network_info: |[{"id": "9b1b9675-c2df-4b16-ba94-807765bab119", "address": "fa:16:3e:e6:7a:2e", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b1b9675-c2", "ovs_interfaceid": "9b1b9675-c2df-4b16-ba94-807765bab119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0171d73d-a28d-45d9-ba0b-994ad177b36e req-4d47b701-1370-4469-9548-7a9afa9188c9 service nova] Acquired lock "refresh_cache-81725845-6158-4e34-bedb-6e41219bc227" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:40:52 user sudo[81686]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpklp25i47/privsep.sock
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.network.neutron [req-0171d73d-a28d-45d9-ba0b-994ad177b36e req-4d47b701-1370-4469-9548-7a9afa9188c9 service nova] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Refreshing network info cache for port 9b1b9675-c2df-4b16-ba94-807765bab119 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:40:52 user sudo[81686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Start _get_guest_xml network_info=[{"id": "9b1b9675-c2df-4b16-ba94-807765bab119", "address": "fa:16:3e:e6:7a:2e", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b1b9675-c2", "ovs_interfaceid": "9b1b9675-c2df-4b16-ba94-807765bab119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:40:52 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:40:52 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:40:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-703918171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-703918171',id=2,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='929fd4a3127b475282426d4412e58def',ramdisk_id='',reservation_id='r-zxan9wua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1082770125',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:40:44Z,user_data=None,user_id='ceede92aa3a74060a7f57d29d0d97aee',uuid=81725845-6158-4e34-bedb-6e41219bc227,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b1b9675-c2df-4b16-ba94-807765bab119", "address": "fa:16:3e:e6:7a:2e", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b1b9675-c2", "ovs_interfaceid": "9b1b9675-c2df-4b16-ba94-807765bab119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Converting VIF {"id": "9b1b9675-c2df-4b16-ba94-807765bab119", "address": "fa:16:3e:e6:7a:2e", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b1b9675-c2", "ovs_interfaceid": "9b1b9675-c2df-4b16-ba94-807765bab119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:7a:2e,bridge_name='br-int',has_traffic_filtering=True,id=9b1b9675-c2df-4b16-ba94-807765bab119,network=Network(0e8b3ddd-e35a-45eb-a34c-614654c25549),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b1b9675-c2') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.objects.instance [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lazy-loading 'pci_devices' on Instance uuid 81725845-6158-4e34-bedb-6e41219bc227 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:40:52 user nova-compute[72444]:   <uuid>81725845-6158-4e34-bedb-6e41219bc227</uuid>
Aug 03 04:40:52 user nova-compute[72444]:   <name>instance-00000002</name>
Aug 03 04:40:52 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:40:52 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:40:52 user nova-compute[72444]:   <metadata>
Aug 03 04:40:52 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:40:52 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:40:52 user nova-compute[72444]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-703918171</nova:name>
Aug 03 04:40:52 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:40:52</nova:creationTime>
Aug 03 04:40:52 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:40:52 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:40:52 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:40:52 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:40:52 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:40:52 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:40:52 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:40:52 user nova-compute[72444]:       <nova:owner>
Aug 03 04:40:52 user nova-compute[72444]:         <nova:user uuid="ceede92aa3a74060a7f57d29d0d97aee">tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member</nova:user>
Aug 03 04:40:52 user nova-compute[72444]:         <nova:project uuid="929fd4a3127b475282426d4412e58def">tempest-ServerBootFromVolumeStableRescueTest-1082770125</nova:project>
Aug 03 04:40:52 user nova-compute[72444]:       </nova:owner>
Aug 03 04:40:52 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:40:52 user nova-compute[72444]:       <nova:ports>
Aug 03 04:40:52 user nova-compute[72444]:         <nova:port uuid="9b1b9675-c2df-4b16-ba94-807765bab119">
Aug 03 04:40:52 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 03 04:40:52 user nova-compute[72444]:         </nova:port>
Aug 03 04:40:52 user nova-compute[72444]:       </nova:ports>
Aug 03 04:40:52 user nova-compute[72444]:     </nova:instance>
Aug 03 04:40:52 user nova-compute[72444]:   </metadata>
Aug 03 04:40:52 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:40:52 user nova-compute[72444]:     <system>
Aug 03 04:40:52 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:40:52 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:40:52 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:40:52 user nova-compute[72444]:       <entry name="serial">81725845-6158-4e34-bedb-6e41219bc227</entry>
Aug 03 04:40:52 user nova-compute[72444]:       <entry name="uuid">81725845-6158-4e34-bedb-6e41219bc227</entry>
Aug 03 04:40:52 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:40:52 user nova-compute[72444]:     </system>
Aug 03 04:40:52 user nova-compute[72444]:   </sysinfo>
Aug 03 04:40:52 user nova-compute[72444]:   <os>
Aug 03 04:40:52 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:40:52 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:40:52 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:40:52 user nova-compute[72444]:   </os>
Aug 03 04:40:52 user nova-compute[72444]:   <features>
Aug 03 04:40:52 user nova-compute[72444]:     <acpi/>
Aug 03 04:40:52 user nova-compute[72444]:     <apic/>
Aug 03 04:40:52 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:40:52 user nova-compute[72444]:   </features>
Aug 03 04:40:52 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:40:52 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:40:52 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:40:52 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:40:52 user nova-compute[72444]:   </clock>
Aug 03 04:40:52 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:40:52 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:40:52 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:40:52 user nova-compute[72444]:   </cpu>
Aug 03 04:40:52 user nova-compute[72444]:   <devices>
Aug 03 04:40:52 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:40:52 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:40:52 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk"/>
Aug 03 04:40:52 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:40:52 user nova-compute[72444]:     </disk>
Aug 03 04:40:52 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:40:52 user nova-compute[72444]:       <mac address="fa:16:3e:e6:7a:2e"/>
Aug 03 04:40:52 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:40:52 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:40:52 user nova-compute[72444]:       <target dev="tap9b1b9675-c2"/>
Aug 03 04:40:52 user nova-compute[72444]:     </interface>
Aug 03 04:40:52 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:40:52 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/console.log" append="off"/>
Aug 03 04:40:52 user nova-compute[72444]:     </serial>
Aug 03 04:40:52 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:40:52 user nova-compute[72444]:     <video>
Aug 03 04:40:52 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:40:52 user nova-compute[72444]:     </video>
Aug 03 04:40:52 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:40:52 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:40:52 user nova-compute[72444]:     </rng>
Aug 03 04:40:52 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:40:52 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:40:52 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:40:52 user nova-compute[72444]:     </memballoon>
Aug 03 04:40:52 user nova-compute[72444]:   </devices>
Aug 03 04:40:52 user nova-compute[72444]: </domain>
Aug 03 04:40:52 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:40:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-703918171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-703918171',id=2,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='929fd4a3127b475282426d4412e58def',ramdisk_id='',reservation_id='r-zxan9wua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1082770125',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:40:44Z,user_data=None,user_id='ceede92aa3a74060a7f57d29d0d97aee',uuid=81725845-6158-4e34-bedb-6e41219bc227,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b1b9675-c2df-4b16-ba94-807765bab119", "address": "fa:16:3e:e6:7a:2e", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b1b9675-c2", "ovs_interfaceid": "9b1b9675-c2df-4b16-ba94-807765bab119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Converting VIF {"id": "9b1b9675-c2df-4b16-ba94-807765bab119", "address": "fa:16:3e:e6:7a:2e", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b1b9675-c2", "ovs_interfaceid": "9b1b9675-c2df-4b16-ba94-807765bab119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:7a:2e,bridge_name='br-int',has_traffic_filtering=True,id=9b1b9675-c2df-4b16-ba94-807765bab119,network=Network(0e8b3ddd-e35a-45eb-a34c-614654c25549),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b1b9675-c2') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG os_vif [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:7a:2e,bridge_name='br-int',has_traffic_filtering=True,id=9b1b9675-c2df-4b16-ba94-807765bab119,network=Network(0e8b3ddd-e35a-45eb-a34c-614654c25549),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b1b9675-c2') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:40:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG nova.network.neutron [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Successfully updated port: 19cfd924-3dff-4024-97c6-285ac53c1fcd {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Acquiring lock "refresh_cache-85521338-f660-49ab-a3ab-9eb6df7a7353" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Acquired lock "refresh_cache-85521338-f660-49ab-a3ab-9eb6df7a7353" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG nova.network.neutron [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG nova.compute.manager [req-20eb961a-8161-47aa-ae51-43d351b0c1bd req-a44dc602-9108-4480-ba21-14a3383a4d0f service nova] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Received event network-changed-19cfd924-3dff-4024-97c6-285ac53c1fcd {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG nova.compute.manager [req-20eb961a-8161-47aa-ae51-43d351b0c1bd req-a44dc602-9108-4480-ba21-14a3383a4d0f service nova] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Refreshing instance network info cache due to event network-changed-19cfd924-3dff-4024-97c6-285ac53c1fcd. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-20eb961a-8161-47aa-ae51-43d351b0c1bd req-a44dc602-9108-4480-ba21-14a3383a4d0f service nova] Acquiring lock "refresh_cache-85521338-f660-49ab-a3ab-9eb6df7a7353" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG nova.network.neutron [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG nova.network.neutron [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Updating instance_info_cache with network_info: [{"id": "bd9827e6-3c6f-4bb3-8889-1ae45107f6f0", "address": "fa:16:3e:61:54:b7", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd9827e6-3c", "ovs_interfaceid": "bd9827e6-3c6f-4bb3-8889-1ae45107f6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Releasing lock "refresh_cache-b6ed9c42-fa6e-4a0d-8312-588471e157f7" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG nova.compute.manager [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Instance network_info: |[{"id": "bd9827e6-3c6f-4bb3-8889-1ae45107f6f0", "address": "fa:16:3e:61:54:b7", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd9827e6-3c", "ovs_interfaceid": "bd9827e6-3c6f-4bb3-8889-1ae45107f6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f681117e-b004-4111-a3b5-972ba78dc93e req-9dba3539-b9cf-4070-82aa-9422df63ddbc service nova] Acquired lock "refresh_cache-b6ed9c42-fa6e-4a0d-8312-588471e157f7" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG nova.network.neutron [req-f681117e-b004-4111-a3b5-972ba78dc93e req-9dba3539-b9cf-4070-82aa-9422df63ddbc service nova] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Refreshing network info cache for port bd9827e6-3c6f-4bb3-8889-1ae45107f6f0 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Start _get_guest_xml network_info=[{"id": "bd9827e6-3c6f-4bb3-8889-1ae45107f6f0", "address": "fa:16:3e:61:54:b7", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd9827e6-3c", "ovs_interfaceid": "bd9827e6-3c6f-4bb3-8889-1ae45107f6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:40:53 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:40:53 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:40:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:40:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-418117262',display_name='tempest-ServerRescueNegativeTestJSON-server-418117262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-418117262',id=3,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='063a2a64796f4b87a44383014f0af3dc',ramdisk_id='',reservation_id='r-791q0qth',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-665683708',owner_user_name='tempest-ServerRescueNegativeTestJSON-665683708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:40:45Z,user_data=None,user_id='07e8b540c9194e1195cb898ad08acaa0',uuid=b6ed9c42-fa6e-4a0d-8312-588471e157f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd9827e6-3c6f-4bb3-8889-1ae45107f6f0", "address": "fa:16:3e:61:54:b7", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd9827e6-3c", "ovs_interfaceid": "bd9827e6-3c6f-4bb3-8889-1ae45107f6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Converting VIF {"id": "bd9827e6-3c6f-4bb3-8889-1ae45107f6f0", "address": "fa:16:3e:61:54:b7", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd9827e6-3c", "ovs_interfaceid": "bd9827e6-3c6f-4bb3-8889-1ae45107f6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:54:b7,bridge_name='br-int',has_traffic_filtering=True,id=bd9827e6-3c6f-4bb3-8889-1ae45107f6f0,network=Network(bc85da72-7764-4b65-a071-aec46e3a2398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd9827e6-3c') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG nova.objects.instance [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lazy-loading 'pci_devices' on Instance uuid b6ed9c42-fa6e-4a0d-8312-588471e157f7 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:40:53 user nova-compute[72444]:   <uuid>b6ed9c42-fa6e-4a0d-8312-588471e157f7</uuid>
Aug 03 04:40:53 user nova-compute[72444]:   <name>instance-00000003</name>
Aug 03 04:40:53 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:40:53 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:40:53 user nova-compute[72444]:   <metadata>
Aug 03 04:40:53 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:40:53 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:40:53 user nova-compute[72444]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-418117262</nova:name>
Aug 03 04:40:53 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:40:53</nova:creationTime>
Aug 03 04:40:53 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:40:53 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:40:53 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:40:53 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:40:53 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:40:53 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:40:53 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:40:53 user nova-compute[72444]:       <nova:owner>
Aug 03 04:40:53 user nova-compute[72444]:         <nova:user uuid="07e8b540c9194e1195cb898ad08acaa0">tempest-ServerRescueNegativeTestJSON-665683708-project-member</nova:user>
Aug 03 04:40:53 user nova-compute[72444]:         <nova:project uuid="063a2a64796f4b87a44383014f0af3dc">tempest-ServerRescueNegativeTestJSON-665683708</nova:project>
Aug 03 04:40:53 user nova-compute[72444]:       </nova:owner>
Aug 03 04:40:53 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:40:53 user nova-compute[72444]:       <nova:ports>
Aug 03 04:40:53 user nova-compute[72444]:         <nova:port uuid="bd9827e6-3c6f-4bb3-8889-1ae45107f6f0">
Aug 03 04:40:53 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 03 04:40:53 user nova-compute[72444]:         </nova:port>
Aug 03 04:40:53 user nova-compute[72444]:       </nova:ports>
Aug 03 04:40:53 user nova-compute[72444]:     </nova:instance>
Aug 03 04:40:53 user nova-compute[72444]:   </metadata>
Aug 03 04:40:53 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:40:53 user nova-compute[72444]:     <system>
Aug 03 04:40:53 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:40:53 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:40:53 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:40:53 user nova-compute[72444]:       <entry name="serial">b6ed9c42-fa6e-4a0d-8312-588471e157f7</entry>
Aug 03 04:40:53 user nova-compute[72444]:       <entry name="uuid">b6ed9c42-fa6e-4a0d-8312-588471e157f7</entry>
Aug 03 04:40:53 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:40:53 user nova-compute[72444]:     </system>
Aug 03 04:40:53 user nova-compute[72444]:   </sysinfo>
Aug 03 04:40:53 user nova-compute[72444]:   <os>
Aug 03 04:40:53 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:40:53 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:40:53 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:40:53 user nova-compute[72444]:   </os>
Aug 03 04:40:53 user nova-compute[72444]:   <features>
Aug 03 04:40:53 user nova-compute[72444]:     <acpi/>
Aug 03 04:40:53 user nova-compute[72444]:     <apic/>
Aug 03 04:40:53 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:40:53 user nova-compute[72444]:   </features>
Aug 03 04:40:53 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:40:53 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:40:53 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:40:53 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:40:53 user nova-compute[72444]:   </clock>
Aug 03 04:40:53 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:40:53 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:40:53 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:40:53 user nova-compute[72444]:   </cpu>
Aug 03 04:40:53 user nova-compute[72444]:   <devices>
Aug 03 04:40:53 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:40:53 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:40:53 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk"/>
Aug 03 04:40:53 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:40:53 user nova-compute[72444]:     </disk>
Aug 03 04:40:53 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:40:53 user nova-compute[72444]:       <mac address="fa:16:3e:61:54:b7"/>
Aug 03 04:40:53 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:40:53 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:40:53 user nova-compute[72444]:       <target dev="tapbd9827e6-3c"/>
Aug 03 04:40:53 user nova-compute[72444]:     </interface>
Aug 03 04:40:53 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:40:53 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/console.log" append="off"/>
Aug 03 04:40:53 user nova-compute[72444]:     </serial>
Aug 03 04:40:53 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:40:53 user nova-compute[72444]:     <video>
Aug 03 04:40:53 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:40:53 user nova-compute[72444]:     </video>
Aug 03 04:40:53 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:40:53 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:40:53 user nova-compute[72444]:     </rng>
Aug 03 04:40:53 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:40:53 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:40:53 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:40:53 user nova-compute[72444]:     </memballoon>
Aug 03 04:40:53 user nova-compute[72444]:   </devices>
Aug 03 04:40:53 user nova-compute[72444]: </domain>
Aug 03 04:40:53 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:40:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-418117262',display_name='tempest-ServerRescueNegativeTestJSON-server-418117262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-418117262',id=3,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='063a2a64796f4b87a44383014f0af3dc',ramdisk_id='',reservation_id='r-791q0qth',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-665683708',owner_user_name='tempest-ServerRescueNegativeTestJSON-665683708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:40:45Z,user_data=None,user_id='07e8b540c9194e1195cb898ad08acaa0',uuid=b6ed9c42-fa6e-4a0d-8312-588471e157f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd9827e6-3c6f-4bb3-8889-1ae45107f6f0", "address": "fa:16:3e:61:54:b7", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd9827e6-3c", "ovs_interfaceid": "bd9827e6-3c6f-4bb3-8889-1ae45107f6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Converting VIF {"id": "bd9827e6-3c6f-4bb3-8889-1ae45107f6f0", "address": "fa:16:3e:61:54:b7", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd9827e6-3c", "ovs_interfaceid": "bd9827e6-3c6f-4bb3-8889-1ae45107f6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:54:b7,bridge_name='br-int',has_traffic_filtering=True,id=bd9827e6-3c6f-4bb3-8889-1ae45107f6f0,network=Network(bc85da72-7764-4b65-a071-aec46e3a2398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd9827e6-3c') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG os_vif [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:54:b7,bridge_name='br-int',has_traffic_filtering=True,id=bd9827e6-3c6f-4bb3-8889-1ae45107f6f0,network=Network(bc85da72-7764-4b65-a071-aec46e3a2398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd9827e6-3c') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:40:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:40:54 user sudo[81686]: pam_unix(sudo:session): session closed for user root
Aug 03 04:40:54 user nova-compute[72444]: INFO oslo.privsep.daemon [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Spawned new privsep daemon via rootwrap
Aug 03 04:40:54 user nova-compute[72444]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 03 04:40:54 user nova-compute[72444]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 03 04:40:54 user nova-compute[72444]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 03 04:40:54 user nova-compute[72444]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81689
Aug 03 04:40:54 user nova-compute[72444]: WARNING oslo_privsep.priv_context [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] privsep daemon already running
Aug 03 04:40:54 user nova-compute[72444]: WARNING oslo_privsep.priv_context [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] privsep daemon already running
Aug 03 04:40:54 user nova-compute[72444]: DEBUG nova.network.neutron [req-f681117e-b004-4111-a3b5-972ba78dc93e req-9dba3539-b9cf-4070-82aa-9422df63ddbc service nova] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Updated VIF entry in instance network info cache for port bd9827e6-3c6f-4bb3-8889-1ae45107f6f0. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG nova.network.neutron [req-f681117e-b004-4111-a3b5-972ba78dc93e req-9dba3539-b9cf-4070-82aa-9422df63ddbc service nova] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Updating instance_info_cache with network_info: [{"id": "bd9827e6-3c6f-4bb3-8889-1ae45107f6f0", "address": "fa:16:3e:61:54:b7", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd9827e6-3c", "ovs_interfaceid": "bd9827e6-3c6f-4bb3-8889-1ae45107f6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f681117e-b004-4111-a3b5-972ba78dc93e req-9dba3539-b9cf-4070-82aa-9422df63ddbc service nova] Releasing lock "refresh_cache-b6ed9c42-fa6e-4a0d-8312-588471e157f7" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG nova.network.neutron [req-0171d73d-a28d-45d9-ba0b-994ad177b36e req-4d47b701-1370-4469-9548-7a9afa9188c9 service nova] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Updated VIF entry in instance network info cache for port 9b1b9675-c2df-4b16-ba94-807765bab119. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG nova.network.neutron [req-0171d73d-a28d-45d9-ba0b-994ad177b36e req-4d47b701-1370-4469-9548-7a9afa9188c9 service nova] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Updating instance_info_cache with network_info: [{"id": "9b1b9675-c2df-4b16-ba94-807765bab119", "address": "fa:16:3e:e6:7a:2e", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b1b9675-c2", "ovs_interfaceid": "9b1b9675-c2df-4b16-ba94-807765bab119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0171d73d-a28d-45d9-ba0b-994ad177b36e req-4d47b701-1370-4469-9548-7a9afa9188c9 service nova] Releasing lock "refresh_cache-81725845-6158-4e34-bedb-6e41219bc227" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd9827e6-3c, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbd9827e6-3c, col_values=(('external_ids', {'iface-id': 'bd9827e6-3c6f-4bb3-8889-1ae45107f6f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:54:b7', 'vm-uuid': 'b6ed9c42-fa6e-4a0d-8312-588471e157f7'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:40:54 user nova-compute[72444]: INFO os_vif [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:54:b7,bridge_name='br-int',has_traffic_filtering=True,id=bd9827e6-3c6f-4bb3-8889-1ae45107f6f0,network=Network(bc85da72-7764-4b65-a071-aec46e3a2398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd9827e6-3c')
Aug 03 04:40:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0cfd0c0-ac, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd0cfd0c0-ac, col_values=(('external_ids', {'iface-id': 'd0cfd0c0-ac67-4335-85d2-6f0b956fae5b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:f6:85', 'vm-uuid': '4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:40:54 user nova-compute[72444]: INFO os_vif [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:f6:85,bridge_name='br-int',has_traffic_filtering=True,id=d0cfd0c0-ac67-4335-85d2-6f0b956fae5b,network=Network(bc85da72-7764-4b65-a071-aec46e3a2398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0cfd0c0-ac')
Aug 03 04:40:54 user nova-compute[72444]: DEBUG nova.network.neutron [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Updating instance_info_cache with network_info: [{"id": "19cfd924-3dff-4024-97c6-285ac53c1fcd", "address": "fa:16:3e:cf:20:74", "network": {"id": "5df96f95-b1db-4ea0-af6a-5b52bbed0063", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-562110281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e67b7c5d89c244a19f95cc3fc4f33695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19cfd924-3d", "ovs_interfaceid": "19cfd924-3dff-4024-97c6-285ac53c1fcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b1b9675-c2, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9b1b9675-c2, col_values=(('external_ids', {'iface-id': '9b1b9675-c2df-4b16-ba94-807765bab119', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:7a:2e', 'vm-uuid': '81725845-6158-4e34-bedb-6e41219bc227'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG nova.network.neutron [req-47b10181-0eaf-41a2-8f30-54c2cd082241 req-7706e260-533f-4f38-a312-79ca375b1033 service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Updated VIF entry in instance network info cache for port d0cfd0c0-ac67-4335-85d2-6f0b956fae5b. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG nova.network.neutron [req-47b10181-0eaf-41a2-8f30-54c2cd082241 req-7706e260-533f-4f38-a312-79ca375b1033 service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Updating instance_info_cache with network_info: [{"id": "d0cfd0c0-ac67-4335-85d2-6f0b956fae5b", "address": "fa:16:3e:e0:f6:85", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cfd0c0-ac", "ovs_interfaceid": "d0cfd0c0-ac67-4335-85d2-6f0b956fae5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Releasing lock "refresh_cache-85521338-f660-49ab-a3ab-9eb6df7a7353" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG nova.compute.manager [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Instance network_info: |[{"id": "19cfd924-3dff-4024-97c6-285ac53c1fcd", "address": "fa:16:3e:cf:20:74", "network": {"id": "5df96f95-b1db-4ea0-af6a-5b52bbed0063", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-562110281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e67b7c5d89c244a19f95cc3fc4f33695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19cfd924-3d", "ovs_interfaceid": "19cfd924-3dff-4024-97c6-285ac53c1fcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-20eb961a-8161-47aa-ae51-43d351b0c1bd req-a44dc602-9108-4480-ba21-14a3383a4d0f service nova] Acquired lock "refresh_cache-85521338-f660-49ab-a3ab-9eb6df7a7353" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG nova.network.neutron [req-20eb961a-8161-47aa-ae51-43d351b0c1bd req-a44dc602-9108-4480-ba21-14a3383a4d0f service nova] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Refreshing network info cache for port 19cfd924-3dff-4024-97c6-285ac53c1fcd {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Start _get_guest_xml network_info=[{"id": "19cfd924-3dff-4024-97c6-285ac53c1fcd", "address": "fa:16:3e:cf:20:74", "network": {"id": "5df96f95-b1db-4ea0-af6a-5b52bbed0063", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-562110281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e67b7c5d89c244a19f95cc3fc4f33695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19cfd924-3d", "ovs_interfaceid": "19cfd924-3dff-4024-97c6-285ac53c1fcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-47b10181-0eaf-41a2-8f30-54c2cd082241 req-7706e260-533f-4f38-a312-79ca375b1033 service nova] Releasing lock "refresh_cache-4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:40:54 user nova-compute[72444]: INFO os_vif [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:7a:2e,bridge_name='br-int',has_traffic_filtering=True,id=9b1b9675-c2df-4b16-ba94-807765bab119,network=Network(0e8b3ddd-e35a-45eb-a34c-614654c25549),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b1b9675-c2')
Aug 03 04:40:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] No VIF found with MAC fa:16:3e:61:54:b7, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:40:54 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:40:54 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:40:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:40:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1899651228',display_name='tempest-DeleteServersTestJSON-server-1899651228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1899651228',id=4,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e67b7c5d89c244a19f95cc3fc4f33695',ramdisk_id='',reservation_id='r-c4q9jecn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-96824376',owner_user_name='tempest-DeleteServersTestJSON-96824376-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:40:47Z,user_data=None,user_id='9e32c358290a4170be682ac98bf2e17d',uuid=85521338-f660-49ab-a3ab-9eb6df7a7353,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19cfd924-3dff-4024-97c6-285ac53c1fcd", "address": "fa:16:3e:cf:20:74", "network": {"id": "5df96f95-b1db-4ea0-af6a-5b52bbed0063", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-562110281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e67b7c5d89c244a19f95cc3fc4f33695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19cfd924-3d", "ovs_interfaceid": "19cfd924-3dff-4024-97c6-285ac53c1fcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Converting VIF {"id": "19cfd924-3dff-4024-97c6-285ac53c1fcd", "address": "fa:16:3e:cf:20:74", "network": {"id": "5df96f95-b1db-4ea0-af6a-5b52bbed0063", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-562110281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e67b7c5d89c244a19f95cc3fc4f33695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19cfd924-3d", "ovs_interfaceid": "19cfd924-3dff-4024-97c6-285ac53c1fcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:20:74,bridge_name='br-int',has_traffic_filtering=True,id=19cfd924-3dff-4024-97c6-285ac53c1fcd,network=Network(5df96f95-b1db-4ea0-af6a-5b52bbed0063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19cfd924-3d') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG nova.objects.instance [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Lazy-loading 'pci_devices' on Instance uuid 85521338-f660-49ab-a3ab-9eb6df7a7353 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:40:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] No VIF found with MAC fa:16:3e:e0:f6:85, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:40:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:40:55 user nova-compute[72444]:   <uuid>85521338-f660-49ab-a3ab-9eb6df7a7353</uuid>
Aug 03 04:40:55 user nova-compute[72444]:   <name>instance-00000004</name>
Aug 03 04:40:55 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:40:55 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:40:55 user nova-compute[72444]:   <metadata>
Aug 03 04:40:55 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:40:55 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:40:55 user nova-compute[72444]:       <nova:name>tempest-DeleteServersTestJSON-server-1899651228</nova:name>
Aug 03 04:40:55 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:40:54</nova:creationTime>
Aug 03 04:40:55 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:40:55 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:40:55 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:40:55 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:40:55 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:40:55 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:40:55 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:40:55 user nova-compute[72444]:       <nova:owner>
Aug 03 04:40:55 user nova-compute[72444]:         <nova:user uuid="9e32c358290a4170be682ac98bf2e17d">tempest-DeleteServersTestJSON-96824376-project-member</nova:user>
Aug 03 04:40:55 user nova-compute[72444]:         <nova:project uuid="e67b7c5d89c244a19f95cc3fc4f33695">tempest-DeleteServersTestJSON-96824376</nova:project>
Aug 03 04:40:55 user nova-compute[72444]:       </nova:owner>
Aug 03 04:40:55 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:40:55 user nova-compute[72444]:       <nova:ports>
Aug 03 04:40:55 user nova-compute[72444]:         <nova:port uuid="19cfd924-3dff-4024-97c6-285ac53c1fcd">
Aug 03 04:40:55 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 03 04:40:55 user nova-compute[72444]:         </nova:port>
Aug 03 04:40:55 user nova-compute[72444]:       </nova:ports>
Aug 03 04:40:55 user nova-compute[72444]:     </nova:instance>
Aug 03 04:40:55 user nova-compute[72444]:   </metadata>
Aug 03 04:40:55 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:40:55 user nova-compute[72444]:     <system>
Aug 03 04:40:55 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:40:55 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:40:55 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:40:55 user nova-compute[72444]:       <entry name="serial">85521338-f660-49ab-a3ab-9eb6df7a7353</entry>
Aug 03 04:40:55 user nova-compute[72444]:       <entry name="uuid">85521338-f660-49ab-a3ab-9eb6df7a7353</entry>
Aug 03 04:40:55 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:40:55 user nova-compute[72444]:     </system>
Aug 03 04:40:55 user nova-compute[72444]:   </sysinfo>
Aug 03 04:40:55 user nova-compute[72444]:   <os>
Aug 03 04:40:55 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:40:55 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:40:55 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:40:55 user nova-compute[72444]:   </os>
Aug 03 04:40:55 user nova-compute[72444]:   <features>
Aug 03 04:40:55 user nova-compute[72444]:     <acpi/>
Aug 03 04:40:55 user nova-compute[72444]:     <apic/>
Aug 03 04:40:55 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:40:55 user nova-compute[72444]:   </features>
Aug 03 04:40:55 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:40:55 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:40:55 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:40:55 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:40:55 user nova-compute[72444]:   </clock>
Aug 03 04:40:55 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:40:55 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:40:55 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:40:55 user nova-compute[72444]:   </cpu>
Aug 03 04:40:55 user nova-compute[72444]:   <devices>
Aug 03 04:40:55 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:40:55 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:40:55 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/85521338-f660-49ab-a3ab-9eb6df7a7353/disk"/>
Aug 03 04:40:55 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:40:55 user nova-compute[72444]:     </disk>
Aug 03 04:40:55 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:40:55 user nova-compute[72444]:       <mac address="fa:16:3e:cf:20:74"/>
Aug 03 04:40:55 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:40:55 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:40:55 user nova-compute[72444]:       <target dev="tap19cfd924-3d"/>
Aug 03 04:40:55 user nova-compute[72444]:     </interface>
Aug 03 04:40:55 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:40:55 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/85521338-f660-49ab-a3ab-9eb6df7a7353/console.log" append="off"/>
Aug 03 04:40:55 user nova-compute[72444]:     </serial>
Aug 03 04:40:55 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:40:55 user nova-compute[72444]:     <video>
Aug 03 04:40:55 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:40:55 user nova-compute[72444]:     </video>
Aug 03 04:40:55 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:40:55 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:40:55 user nova-compute[72444]:     </rng>
Aug 03 04:40:55 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:40:55 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:40:55 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:40:55 user nova-compute[72444]:     </memballoon>
Aug 03 04:40:55 user nova-compute[72444]:   </devices>
Aug 03 04:40:55 user nova-compute[72444]: </domain>
Aug 03 04:40:55 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:40:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:40:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1899651228',display_name='tempest-DeleteServersTestJSON-server-1899651228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1899651228',id=4,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e67b7c5d89c244a19f95cc3fc4f33695',ramdisk_id='',reservation_id='r-c4q9jecn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-96824376',owner_user_name='tempest-DeleteServersTestJSON-96824376-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:40:47Z,user_data=None,user_id='9e32c358290a4170be682ac98bf2e17d',uuid=85521338-f660-49ab-a3ab-9eb6df7a7353,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19cfd924-3dff-4024-97c6-285ac53c1fcd", "address": "fa:16:3e:cf:20:74", "network": {"id": "5df96f95-b1db-4ea0-af6a-5b52bbed0063", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-562110281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e67b7c5d89c244a19f95cc3fc4f33695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19cfd924-3d", "ovs_interfaceid": "19cfd924-3dff-4024-97c6-285ac53c1fcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:40:55 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Converting VIF {"id": "19cfd924-3dff-4024-97c6-285ac53c1fcd", "address": "fa:16:3e:cf:20:74", "network": {"id": "5df96f95-b1db-4ea0-af6a-5b52bbed0063", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-562110281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e67b7c5d89c244a19f95cc3fc4f33695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19cfd924-3d", "ovs_interfaceid": "19cfd924-3dff-4024-97c6-285ac53c1fcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:40:55 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:20:74,bridge_name='br-int',has_traffic_filtering=True,id=19cfd924-3dff-4024-97c6-285ac53c1fcd,network=Network(5df96f95-b1db-4ea0-af6a-5b52bbed0063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19cfd924-3d') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:40:55 user nova-compute[72444]: DEBUG os_vif [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:20:74,bridge_name='br-int',has_traffic_filtering=True,id=19cfd924-3dff-4024-97c6-285ac53c1fcd,network=Network(5df96f95-b1db-4ea0-af6a-5b52bbed0063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19cfd924-3d') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:40:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:40:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:40:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:40:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:40:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19cfd924-3d, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:40:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap19cfd924-3d, col_values=(('external_ids', {'iface-id': '19cfd924-3dff-4024-97c6-285ac53c1fcd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:20:74', 'vm-uuid': '85521338-f660-49ab-a3ab-9eb6df7a7353'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:40:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:40:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:40:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:40:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] No VIF found with MAC fa:16:3e:e6:7a:2e, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:40:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:40:55 user nova-compute[72444]: INFO os_vif [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:20:74,bridge_name='br-int',has_traffic_filtering=True,id=19cfd924-3dff-4024-97c6-285ac53c1fcd,network=Network(5df96f95-b1db-4ea0-af6a-5b52bbed0063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19cfd924-3d')
Aug 03 04:40:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:40:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] No VIF found with MAC fa:16:3e:cf:20:74, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:40:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "e2859322-6f99-442d-bee1-65fe49ce6360" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:40:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "e2859322-6f99-442d-bee1-65fe49ce6360" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:40:56 user nova-compute[72444]: DEBUG nova.compute.manager [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 04:40:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:40:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:40:56 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 04:40:56 user nova-compute[72444]: INFO nova.compute.claims [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Claim successful on node user
Aug 03 04:40:56 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:40:56 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:40:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.388s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:40:56 user nova-compute[72444]: DEBUG nova.compute.manager [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 04:40:56 user nova-compute[72444]: DEBUG nova.compute.manager [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 04:40:56 user nova-compute[72444]: DEBUG nova.network.neutron [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 04:40:56 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 04:40:56 user nova-compute[72444]: DEBUG nova.network.neutron [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Successfully updated port: 6eadddef-1b9b-4a34-8217-dc485697332f {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:40:56 user nova-compute[72444]: DEBUG nova.compute.manager [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 04:40:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Acquiring lock "refresh_cache-e3089887-56df-42de-bc62-88e6db28daf0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:40:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Acquired lock "refresh_cache-e3089887-56df-42de-bc62-88e6db28daf0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:40:56 user nova-compute[72444]: DEBUG nova.network.neutron [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:40:56 user nova-compute[72444]: DEBUG nova.compute.manager [req-6bbd2bcb-a74f-43e1-977a-594c29f40b4a req-114d8b46-81fa-478f-b2ca-f6a520c2be9f service nova] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Received event network-changed-6eadddef-1b9b-4a34-8217-dc485697332f {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:40:56 user nova-compute[72444]: DEBUG nova.compute.manager [req-6bbd2bcb-a74f-43e1-977a-594c29f40b4a req-114d8b46-81fa-478f-b2ca-f6a520c2be9f service nova] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Refreshing instance network info cache due to event network-changed-6eadddef-1b9b-4a34-8217-dc485697332f. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:40:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6bbd2bcb-a74f-43e1-977a-594c29f40b4a req-114d8b46-81fa-478f-b2ca-f6a520c2be9f service nova] Acquiring lock "refresh_cache-e3089887-56df-42de-bc62-88e6db28daf0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:40:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:40:57 user nova-compute[72444]: DEBUG nova.network.neutron [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:40:57 user nova-compute[72444]: DEBUG nova.policy [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7120445361dc4363b4cc6c7671a2716e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d17468ddd64dfabba3a2c7b6df71ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 04:40:57 user nova-compute[72444]: DEBUG nova.compute.manager [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 04:40:57 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 04:40:57 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Creating image(s)
Aug 03 04:40:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "/opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:40:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "/opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:40:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "/opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:40:57 user nova-compute[72444]: DEBUG nova.network.neutron [req-20eb961a-8161-47aa-ae51-43d351b0c1bd req-a44dc602-9108-4480-ba21-14a3383a4d0f service nova] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Updated VIF entry in instance network info cache for port 19cfd924-3dff-4024-97c6-285ac53c1fcd. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:40:57 user nova-compute[72444]: DEBUG nova.network.neutron [req-20eb961a-8161-47aa-ae51-43d351b0c1bd req-a44dc602-9108-4480-ba21-14a3383a4d0f service nova] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Updating instance_info_cache with network_info: [{"id": "19cfd924-3dff-4024-97c6-285ac53c1fcd", "address": "fa:16:3e:cf:20:74", "network": {"id": "5df96f95-b1db-4ea0-af6a-5b52bbed0063", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-562110281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e67b7c5d89c244a19f95cc3fc4f33695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19cfd924-3d", "ovs_interfaceid": "19cfd924-3dff-4024-97c6-285ac53c1fcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:40:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:40:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-20eb961a-8161-47aa-ae51-43d351b0c1bd req-a44dc602-9108-4480-ba21-14a3383a4d0f service nova] Releasing lock "refresh_cache-85521338-f660-49ab-a3ab-9eb6df7a7353" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:40:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Acquiring lock "07450ea8-cb80-4318-9fc9-4268944d2cae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:40:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "07450ea8-cb80-4318-9fc9-4268944d2cae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:40:57 user nova-compute[72444]: DEBUG nova.compute.manager [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 04:40:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.144s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:40:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:40:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:40:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:40:57 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:40:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.163s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:40:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:40:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk 1073741824" returned: 0 in 0.046s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:40:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:40:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:40:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:40:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:40:57 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 04:40:57 user nova-compute[72444]: INFO nova.compute.claims [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Claim successful on node user
Aug 03 04:40:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.148s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:40:57 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 04:40:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:40:57 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:40:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:40:57 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Cannot resize image /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 04:40:57 user nova-compute[72444]: DEBUG nova.objects.instance [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lazy-loading 'migration_context' on Instance uuid e2859322-6f99-442d-bee1-65fe49ce6360 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:40:57 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 04:40:57 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Ensure instance console log exists: /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 04:40:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:40:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:40:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.618s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.network.neutron [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Updating instance_info_cache with network_info: [{"id": "6eadddef-1b9b-4a34-8217-dc485697332f", "address": "fa:16:3e:d5:f4:36", "network": {"id": "6ec6c203-3446-4671-84b4-9d6a55757afb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1998429186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81df940dade241e1a3560045086f8699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eadddef-1b", "ovs_interfaceid": "6eadddef-1b9b-4a34-8217-dc485697332f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Releasing lock "refresh_cache-e3089887-56df-42de-bc62-88e6db28daf0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Instance network_info: |[{"id": "6eadddef-1b9b-4a34-8217-dc485697332f", "address": "fa:16:3e:d5:f4:36", "network": {"id": "6ec6c203-3446-4671-84b4-9d6a55757afb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1998429186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81df940dade241e1a3560045086f8699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eadddef-1b", "ovs_interfaceid": "6eadddef-1b9b-4a34-8217-dc485697332f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6bbd2bcb-a74f-43e1-977a-594c29f40b4a req-114d8b46-81fa-478f-b2ca-f6a520c2be9f service nova] Acquired lock "refresh_cache-e3089887-56df-42de-bc62-88e6db28daf0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.network.neutron [req-6bbd2bcb-a74f-43e1-977a-594c29f40b4a req-114d8b46-81fa-478f-b2ca-f6a520c2be9f service nova] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Refreshing network info cache for port 6eadddef-1b9b-4a34-8217-dc485697332f {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Start _get_guest_xml network_info=[{"id": "6eadddef-1b9b-4a34-8217-dc485697332f", "address": "fa:16:3e:d5:f4:36", "network": {"id": "6ec6c203-3446-4671-84b4-9d6a55757afb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1998429186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81df940dade241e1a3560045086f8699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eadddef-1b", "ovs_interfaceid": "6eadddef-1b9b-4a34-8217-dc485697332f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:40:58 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:40:58 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.network.neutron [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:40:58 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:40:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1332468531',display_name='tempest-ServersNegativeTestJSON-server-1332468531',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1332468531',id=5,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81df940dade241e1a3560045086f8699',ramdisk_id='',reservation_id='r-no5u06su',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2144635638',owner_user_name='tempest-ServersNegativeTestJSON-2144635638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:40:49Z,user_data=None,user_id='f3d18e55922c4d41bea8cc96c6c7cae3',uuid=e3089887-56df-42de-bc62-88e6db28daf0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6eadddef-1b9b-4a34-8217-dc485697332f", "address": "fa:16:3e:d5:f4:36", "network": {"id": "6ec6c203-3446-4671-84b4-9d6a55757afb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1998429186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81df940dade241e1a3560045086f8699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eadddef-1b", "ovs_interfaceid": "6eadddef-1b9b-4a34-8217-dc485697332f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Converting VIF {"id": "6eadddef-1b9b-4a34-8217-dc485697332f", "address": "fa:16:3e:d5:f4:36", "network": {"id": "6ec6c203-3446-4671-84b4-9d6a55757afb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1998429186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81df940dade241e1a3560045086f8699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eadddef-1b", "ovs_interfaceid": "6eadddef-1b9b-4a34-8217-dc485697332f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f4:36,bridge_name='br-int',has_traffic_filtering=True,id=6eadddef-1b9b-4a34-8217-dc485697332f,network=Network(6ec6c203-3446-4671-84b4-9d6a55757afb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eadddef-1b') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.objects.instance [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Lazy-loading 'pci_devices' on Instance uuid e3089887-56df-42de-bc62-88e6db28daf0 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: e3089887-56df-42de-bc62-88e6db28daf0] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:40:58 user nova-compute[72444]:   <uuid>e3089887-56df-42de-bc62-88e6db28daf0</uuid>
Aug 03 04:40:58 user nova-compute[72444]:   <name>instance-00000005</name>
Aug 03 04:40:58 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:40:58 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:40:58 user nova-compute[72444]:   <metadata>
Aug 03 04:40:58 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:40:58 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:40:58 user nova-compute[72444]:       <nova:name>tempest-ServersNegativeTestJSON-server-1332468531</nova:name>
Aug 03 04:40:58 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:40:58</nova:creationTime>
Aug 03 04:40:58 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:40:58 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:40:58 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:40:58 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:40:58 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:40:58 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:40:58 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:40:58 user nova-compute[72444]:       <nova:owner>
Aug 03 04:40:58 user nova-compute[72444]:         <nova:user uuid="f3d18e55922c4d41bea8cc96c6c7cae3">tempest-ServersNegativeTestJSON-2144635638-project-member</nova:user>
Aug 03 04:40:58 user nova-compute[72444]:         <nova:project uuid="81df940dade241e1a3560045086f8699">tempest-ServersNegativeTestJSON-2144635638</nova:project>
Aug 03 04:40:58 user nova-compute[72444]:       </nova:owner>
Aug 03 04:40:58 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:40:58 user nova-compute[72444]:       <nova:ports>
Aug 03 04:40:58 user nova-compute[72444]:         <nova:port uuid="6eadddef-1b9b-4a34-8217-dc485697332f">
Aug 03 04:40:58 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 03 04:40:58 user nova-compute[72444]:         </nova:port>
Aug 03 04:40:58 user nova-compute[72444]:       </nova:ports>
Aug 03 04:40:58 user nova-compute[72444]:     </nova:instance>
Aug 03 04:40:58 user nova-compute[72444]:   </metadata>
Aug 03 04:40:58 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:40:58 user nova-compute[72444]:     <system>
Aug 03 04:40:58 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:40:58 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:40:58 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:40:58 user nova-compute[72444]:       <entry name="serial">e3089887-56df-42de-bc62-88e6db28daf0</entry>
Aug 03 04:40:58 user nova-compute[72444]:       <entry name="uuid">e3089887-56df-42de-bc62-88e6db28daf0</entry>
Aug 03 04:40:58 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:40:58 user nova-compute[72444]:     </system>
Aug 03 04:40:58 user nova-compute[72444]:   </sysinfo>
Aug 03 04:40:58 user nova-compute[72444]:   <os>
Aug 03 04:40:58 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:40:58 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:40:58 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:40:58 user nova-compute[72444]:   </os>
Aug 03 04:40:58 user nova-compute[72444]:   <features>
Aug 03 04:40:58 user nova-compute[72444]:     <acpi/>
Aug 03 04:40:58 user nova-compute[72444]:     <apic/>
Aug 03 04:40:58 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:40:58 user nova-compute[72444]:   </features>
Aug 03 04:40:58 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:40:58 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:40:58 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:40:58 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:40:58 user nova-compute[72444]:   </clock>
Aug 03 04:40:58 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:40:58 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:40:58 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:40:58 user nova-compute[72444]:   </cpu>
Aug 03 04:40:58 user nova-compute[72444]:   <devices>
Aug 03 04:40:58 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:40:58 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:40:58 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk"/>
Aug 03 04:40:58 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:40:58 user nova-compute[72444]:     </disk>
Aug 03 04:40:58 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:40:58 user nova-compute[72444]:       <mac address="fa:16:3e:d5:f4:36"/>
Aug 03 04:40:58 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:40:58 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:40:58 user nova-compute[72444]:       <target dev="tap6eadddef-1b"/>
Aug 03 04:40:58 user nova-compute[72444]:     </interface>
Aug 03 04:40:58 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:40:58 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/console.log" append="off"/>
Aug 03 04:40:58 user nova-compute[72444]:     </serial>
Aug 03 04:40:58 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:40:58 user nova-compute[72444]:     <video>
Aug 03 04:40:58 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:40:58 user nova-compute[72444]:     </video>
Aug 03 04:40:58 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:40:58 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:40:58 user nova-compute[72444]:     </rng>
Aug 03 04:40:58 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:40:58 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:40:58 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:40:58 user nova-compute[72444]:     </memballoon>
Aug 03 04:40:58 user nova-compute[72444]:   </devices>
Aug 03 04:40:58 user nova-compute[72444]: </domain>
Aug 03 04:40:58 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:40:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1332468531',display_name='tempest-ServersNegativeTestJSON-server-1332468531',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1332468531',id=5,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81df940dade241e1a3560045086f8699',ramdisk_id='',reservation_id='r-no5u06su',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2144635638',owner_user_name='tempest-ServersNegativeTestJSON-2144635638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:40:49Z,user_data=None,user_id='f3d18e55922c4d41bea8cc96c6c7cae3',uuid=e3089887-56df-42de-bc62-88e6db28daf0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6eadddef-1b9b-4a34-8217-dc485697332f", "address": "fa:16:3e:d5:f4:36", "network": {"id": "6ec6c203-3446-4671-84b4-9d6a55757afb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1998429186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81df940dade241e1a3560045086f8699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eadddef-1b", "ovs_interfaceid": "6eadddef-1b9b-4a34-8217-dc485697332f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Converting VIF {"id": "6eadddef-1b9b-4a34-8217-dc485697332f", "address": "fa:16:3e:d5:f4:36", "network": {"id": "6ec6c203-3446-4671-84b4-9d6a55757afb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1998429186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81df940dade241e1a3560045086f8699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eadddef-1b", "ovs_interfaceid": "6eadddef-1b9b-4a34-8217-dc485697332f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f4:36,bridge_name='br-int',has_traffic_filtering=True,id=6eadddef-1b9b-4a34-8217-dc485697332f,network=Network(6ec6c203-3446-4671-84b4-9d6a55757afb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eadddef-1b') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG os_vif [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f4:36,bridge_name='br-int',has_traffic_filtering=True,id=6eadddef-1b9b-4a34-8217-dc485697332f,network=Network(6ec6c203-3446-4671-84b4-9d6a55757afb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eadddef-1b') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6eadddef-1b, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6eadddef-1b, col_values=(('external_ids', {'iface-id': '6eadddef-1b9b-4a34-8217-dc485697332f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:f4:36', 'vm-uuid': 'e3089887-56df-42de-bc62-88e6db28daf0'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:40:58 user nova-compute[72444]: INFO os_vif [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f4:36,bridge_name='br-int',has_traffic_filtering=True,id=6eadddef-1b9b-4a34-8217-dc485697332f,network=Network(6ec6c203-3446-4671-84b4-9d6a55757afb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eadddef-1b')
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 04:40:58 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Creating image(s)
Aug 03 04:40:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Acquiring lock "/opt/stack/data/nova/instances/07450ea8-cb80-4318-9fc9-4268944d2cae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "/opt/stack/data/nova/instances/07450ea8-cb80-4318-9fc9-4268944d2cae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "/opt/stack/data/nova/instances/07450ea8-cb80-4318-9fc9-4268944d2cae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] No VIF found with MAC fa:16:3e:d5:f4:36, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.policy [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6837fb4f8f04f38a0e429d8905eae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6037670c8c6450bb3663e55b50c6dd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.129s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.153s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/07450ea8-cb80-4318-9fc9-4268944d2cae/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/07450ea8-cb80-4318-9fc9-4268944d2cae/disk 1073741824" returned: 0 in 0.058s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.135s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Checking if we can resize image /opt/stack/data/nova/instances/07450ea8-cb80-4318-9fc9-4268944d2cae/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07450ea8-cb80-4318-9fc9-4268944d2cae/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:40:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:40:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:40:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:40:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07450ea8-cb80-4318-9fc9-4268944d2cae/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:40:59 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Cannot resize image /opt/stack/data/nova/instances/07450ea8-cb80-4318-9fc9-4268944d2cae/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 04:40:59 user nova-compute[72444]: DEBUG nova.objects.instance [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lazy-loading 'migration_context' on Instance uuid 07450ea8-cb80-4318-9fc9-4268944d2cae {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:40:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 04:40:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Ensure instance console log exists: /opt/stack/data/nova/instances/07450ea8-cb80-4318-9fc9-4268944d2cae/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 04:40:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:40:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:40:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:40:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:40:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:40:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:40:59 user nova-compute[72444]: DEBUG nova.network.neutron [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Successfully created port: 269c2e0d-94ee-4084-985a-58c5afed4411 {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:40:59 user nova-compute[72444]: DEBUG nova.compute.manager [req-682c8326-5f1b-4937-9de2-da9ed11adf6a req-c0bc4712-22e2-44ef-b8f8-a8eae3912b6c service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Received event network-vif-plugged-d0cfd0c0-ac67-4335-85d2-6f0b956fae5b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:40:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-682c8326-5f1b-4937-9de2-da9ed11adf6a req-c0bc4712-22e2-44ef-b8f8-a8eae3912b6c service nova] Acquiring lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:40:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-682c8326-5f1b-4937-9de2-da9ed11adf6a req-c0bc4712-22e2-44ef-b8f8-a8eae3912b6c service nova] Lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:40:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-682c8326-5f1b-4937-9de2-da9ed11adf6a req-c0bc4712-22e2-44ef-b8f8-a8eae3912b6c service nova] Lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:40:59 user nova-compute[72444]: DEBUG nova.compute.manager [req-682c8326-5f1b-4937-9de2-da9ed11adf6a req-c0bc4712-22e2-44ef-b8f8-a8eae3912b6c service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] No waiting events found dispatching network-vif-plugged-d0cfd0c0-ac67-4335-85d2-6f0b956fae5b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:40:59 user nova-compute[72444]: WARNING nova.compute.manager [req-682c8326-5f1b-4937-9de2-da9ed11adf6a req-c0bc4712-22e2-44ef-b8f8-a8eae3912b6c service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Received unexpected event network-vif-plugged-d0cfd0c0-ac67-4335-85d2-6f0b956fae5b for instance with vm_state building and task_state spawning.
Aug 03 04:40:59 user nova-compute[72444]: DEBUG nova.network.neutron [req-6bbd2bcb-a74f-43e1-977a-594c29f40b4a req-114d8b46-81fa-478f-b2ca-f6a520c2be9f service nova] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Updated VIF entry in instance network info cache for port 6eadddef-1b9b-4a34-8217-dc485697332f. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:40:59 user nova-compute[72444]: DEBUG nova.network.neutron [req-6bbd2bcb-a74f-43e1-977a-594c29f40b4a req-114d8b46-81fa-478f-b2ca-f6a520c2be9f service nova] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Updating instance_info_cache with network_info: [{"id": "6eadddef-1b9b-4a34-8217-dc485697332f", "address": "fa:16:3e:d5:f4:36", "network": {"id": "6ec6c203-3446-4671-84b4-9d6a55757afb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1998429186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81df940dade241e1a3560045086f8699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eadddef-1b", "ovs_interfaceid": "6eadddef-1b9b-4a34-8217-dc485697332f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:41:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6bbd2bcb-a74f-43e1-977a-594c29f40b4a req-114d8b46-81fa-478f-b2ca-f6a520c2be9f service nova] Releasing lock "refresh_cache-e3089887-56df-42de-bc62-88e6db28daf0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:41:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:00 user nova-compute[72444]: DEBUG nova.compute.manager [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 04:41:00 user nova-compute[72444]: DEBUG nova.compute.manager [req-f65f746e-3577-42d3-922a-dcf93780a7d9 req-2be057bc-eb94-4c5e-9c17-0d06695ff1e4 service nova] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Received event network-vif-plugged-9b1b9675-c2df-4b16-ba94-807765bab119 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:41:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f65f746e-3577-42d3-922a-dcf93780a7d9 req-2be057bc-eb94-4c5e-9c17-0d06695ff1e4 service nova] Acquiring lock "81725845-6158-4e34-bedb-6e41219bc227-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f65f746e-3577-42d3-922a-dcf93780a7d9 req-2be057bc-eb94-4c5e-9c17-0d06695ff1e4 service nova] Lock "81725845-6158-4e34-bedb-6e41219bc227-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f65f746e-3577-42d3-922a-dcf93780a7d9 req-2be057bc-eb94-4c5e-9c17-0d06695ff1e4 service nova] Lock "81725845-6158-4e34-bedb-6e41219bc227-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:00 user nova-compute[72444]: DEBUG nova.compute.manager [req-f65f746e-3577-42d3-922a-dcf93780a7d9 req-2be057bc-eb94-4c5e-9c17-0d06695ff1e4 service nova] [instance: 81725845-6158-4e34-bedb-6e41219bc227] No waiting events found dispatching network-vif-plugged-9b1b9675-c2df-4b16-ba94-807765bab119 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:41:00 user nova-compute[72444]: WARNING nova.compute.manager [req-f65f746e-3577-42d3-922a-dcf93780a7d9 req-2be057bc-eb94-4c5e-9c17-0d06695ff1e4 service nova] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Received unexpected event network-vif-plugged-9b1b9675-c2df-4b16-ba94-807765bab119 for instance with vm_state building and task_state spawning.
Aug 03 04:41:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:01 user nova-compute[72444]: DEBUG nova.network.neutron [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Successfully created port: fcb29ef9-b342-48cf-9fab-165ea205728f {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:41:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:01 user nova-compute[72444]: DEBUG nova.compute.manager [req-d4826a4b-62a0-4f31-a44d-dbeff529a288 req-cbcf495d-2689-4b95-97f3-67ac3b312c03 service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Received event network-vif-plugged-d0cfd0c0-ac67-4335-85d2-6f0b956fae5b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:41:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d4826a4b-62a0-4f31-a44d-dbeff529a288 req-cbcf495d-2689-4b95-97f3-67ac3b312c03 service nova] Acquiring lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d4826a4b-62a0-4f31-a44d-dbeff529a288 req-cbcf495d-2689-4b95-97f3-67ac3b312c03 service nova] Lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d4826a4b-62a0-4f31-a44d-dbeff529a288 req-cbcf495d-2689-4b95-97f3-67ac3b312c03 service nova] Lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:01 user nova-compute[72444]: DEBUG nova.compute.manager [req-d4826a4b-62a0-4f31-a44d-dbeff529a288 req-cbcf495d-2689-4b95-97f3-67ac3b312c03 service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] No waiting events found dispatching network-vif-plugged-d0cfd0c0-ac67-4335-85d2-6f0b956fae5b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:41:01 user nova-compute[72444]: WARNING nova.compute.manager [req-d4826a4b-62a0-4f31-a44d-dbeff529a288 req-cbcf495d-2689-4b95-97f3-67ac3b312c03 service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Received unexpected event network-vif-plugged-d0cfd0c0-ac67-4335-85d2-6f0b956fae5b for instance with vm_state building and task_state spawning.
Aug 03 04:41:01 user nova-compute[72444]: DEBUG nova.compute.manager [req-d4826a4b-62a0-4f31-a44d-dbeff529a288 req-cbcf495d-2689-4b95-97f3-67ac3b312c03 service nova] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Received event network-vif-plugged-bd9827e6-3c6f-4bb3-8889-1ae45107f6f0 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:41:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d4826a4b-62a0-4f31-a44d-dbeff529a288 req-cbcf495d-2689-4b95-97f3-67ac3b312c03 service nova] Acquiring lock "b6ed9c42-fa6e-4a0d-8312-588471e157f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d4826a4b-62a0-4f31-a44d-dbeff529a288 req-cbcf495d-2689-4b95-97f3-67ac3b312c03 service nova] Lock "b6ed9c42-fa6e-4a0d-8312-588471e157f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d4826a4b-62a0-4f31-a44d-dbeff529a288 req-cbcf495d-2689-4b95-97f3-67ac3b312c03 service nova] Lock "b6ed9c42-fa6e-4a0d-8312-588471e157f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:01 user nova-compute[72444]: DEBUG nova.compute.manager [req-d4826a4b-62a0-4f31-a44d-dbeff529a288 req-cbcf495d-2689-4b95-97f3-67ac3b312c03 service nova] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] No waiting events found dispatching network-vif-plugged-bd9827e6-3c6f-4bb3-8889-1ae45107f6f0 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:41:01 user nova-compute[72444]: WARNING nova.compute.manager [req-d4826a4b-62a0-4f31-a44d-dbeff529a288 req-cbcf495d-2689-4b95-97f3-67ac3b312c03 service nova] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Received unexpected event network-vif-plugged-bd9827e6-3c6f-4bb3-8889-1ae45107f6f0 for instance with vm_state building and task_state spawning.
Aug 03 04:41:02 user nova-compute[72444]: DEBUG nova.compute.manager [req-3aa68897-2ef6-41a0-b3f8-602a70aae190 req-b9b3ef5a-d41d-4bb0-ae4a-f6b9ea956370 service nova] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Received event network-vif-plugged-9b1b9675-c2df-4b16-ba94-807765bab119 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:41:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3aa68897-2ef6-41a0-b3f8-602a70aae190 req-b9b3ef5a-d41d-4bb0-ae4a-f6b9ea956370 service nova] Acquiring lock "81725845-6158-4e34-bedb-6e41219bc227-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3aa68897-2ef6-41a0-b3f8-602a70aae190 req-b9b3ef5a-d41d-4bb0-ae4a-f6b9ea956370 service nova] Lock "81725845-6158-4e34-bedb-6e41219bc227-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3aa68897-2ef6-41a0-b3f8-602a70aae190 req-b9b3ef5a-d41d-4bb0-ae4a-f6b9ea956370 service nova] Lock "81725845-6158-4e34-bedb-6e41219bc227-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:02 user nova-compute[72444]: DEBUG nova.compute.manager [req-3aa68897-2ef6-41a0-b3f8-602a70aae190 req-b9b3ef5a-d41d-4bb0-ae4a-f6b9ea956370 service nova] [instance: 81725845-6158-4e34-bedb-6e41219bc227] No waiting events found dispatching network-vif-plugged-9b1b9675-c2df-4b16-ba94-807765bab119 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:41:02 user nova-compute[72444]: WARNING nova.compute.manager [req-3aa68897-2ef6-41a0-b3f8-602a70aae190 req-b9b3ef5a-d41d-4bb0-ae4a-f6b9ea956370 service nova] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Received unexpected event network-vif-plugged-9b1b9675-c2df-4b16-ba94-807765bab119 for instance with vm_state building and task_state spawning.
Aug 03 04:41:02 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:02 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:02 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:02 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:03 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037663.559682, 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:41:03 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] VM Resumed (Lifecycle Event)
Aug 03 04:41:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:41:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 04:41:03 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 04:41:03 user nova-compute[72444]: INFO nova.compute.claims [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Claim successful on node user
Aug 03 04:41:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:41:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 04:41:03 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Instance spawned successfully.
Aug 03 04:41:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 04:41:03 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Instance spawned successfully.
Aug 03 04:41:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 04:41:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:41:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:41:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:03 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:41:03 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037663.579249, 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:41:03 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] VM Started (Lifecycle Event)
Aug 03 04:41:03 user nova-compute[72444]: INFO nova.compute.manager [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Took 19.92 seconds to spawn the instance on the hypervisor.
Aug 03 04:41:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:41:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:41:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:41:03 user nova-compute[72444]: INFO nova.compute.manager [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Took 21.39 seconds to spawn the instance on the hypervisor.
Aug 03 04:41:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:41:03 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:41:03 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037663.5967085, 81725845-6158-4e34-bedb-6e41219bc227 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:41:03 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 81725845-6158-4e34-bedb-6e41219bc227] VM Resumed (Lifecycle Event)
Aug 03 04:41:04 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:41:04 user nova-compute[72444]: INFO nova.compute.manager [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Took 21.31 seconds to build instance.
Aug 03 04:41:04 user nova-compute[72444]: DEBUG nova.network.neutron [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Successfully updated port: fcb29ef9-b342-48cf-9fab-165ea205728f {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:41:04 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:41:04 user nova-compute[72444]: DEBUG nova.compute.manager [req-2ca783ed-a049-4678-9cbf-06e0c88e1fcd req-c1a48489-282c-4c0a-8fce-07b9b3ba5a7d service nova] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Received event network-vif-plugged-bd9827e6-3c6f-4bb3-8889-1ae45107f6f0 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:41:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2ca783ed-a049-4678-9cbf-06e0c88e1fcd req-c1a48489-282c-4c0a-8fce-07b9b3ba5a7d service nova] Acquiring lock "b6ed9c42-fa6e-4a0d-8312-588471e157f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2ca783ed-a049-4678-9cbf-06e0c88e1fcd req-c1a48489-282c-4c0a-8fce-07b9b3ba5a7d service nova] Lock "b6ed9c42-fa6e-4a0d-8312-588471e157f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2ca783ed-a049-4678-9cbf-06e0c88e1fcd req-c1a48489-282c-4c0a-8fce-07b9b3ba5a7d service nova] Lock "b6ed9c42-fa6e-4a0d-8312-588471e157f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:04 user nova-compute[72444]: DEBUG nova.compute.manager [req-2ca783ed-a049-4678-9cbf-06e0c88e1fcd req-c1a48489-282c-4c0a-8fce-07b9b3ba5a7d service nova] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] No waiting events found dispatching network-vif-plugged-bd9827e6-3c6f-4bb3-8889-1ae45107f6f0 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:41:04 user nova-compute[72444]: WARNING nova.compute.manager [req-2ca783ed-a049-4678-9cbf-06e0c88e1fcd req-c1a48489-282c-4c0a-8fce-07b9b3ba5a7d service nova] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Received unexpected event network-vif-plugged-bd9827e6-3c6f-4bb3-8889-1ae45107f6f0 for instance with vm_state building and task_state spawning.
Aug 03 04:41:04 user nova-compute[72444]: DEBUG nova.compute.manager [req-2ca783ed-a049-4678-9cbf-06e0c88e1fcd req-c1a48489-282c-4c0a-8fce-07b9b3ba5a7d service nova] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Received event network-vif-plugged-19cfd924-3dff-4024-97c6-285ac53c1fcd {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:41:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2ca783ed-a049-4678-9cbf-06e0c88e1fcd req-c1a48489-282c-4c0a-8fce-07b9b3ba5a7d service nova] Acquiring lock "85521338-f660-49ab-a3ab-9eb6df7a7353-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2ca783ed-a049-4678-9cbf-06e0c88e1fcd req-c1a48489-282c-4c0a-8fce-07b9b3ba5a7d service nova] Lock "85521338-f660-49ab-a3ab-9eb6df7a7353-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2ca783ed-a049-4678-9cbf-06e0c88e1fcd req-c1a48489-282c-4c0a-8fce-07b9b3ba5a7d service nova] Lock "85521338-f660-49ab-a3ab-9eb6df7a7353-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:04 user nova-compute[72444]: DEBUG nova.compute.manager [req-2ca783ed-a049-4678-9cbf-06e0c88e1fcd req-c1a48489-282c-4c0a-8fce-07b9b3ba5a7d service nova] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] No waiting events found dispatching network-vif-plugged-19cfd924-3dff-4024-97c6-285ac53c1fcd {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:41:04 user nova-compute[72444]: WARNING nova.compute.manager [req-2ca783ed-a049-4678-9cbf-06e0c88e1fcd req-c1a48489-282c-4c0a-8fce-07b9b3ba5a7d service nova] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Received unexpected event network-vif-plugged-19cfd924-3dff-4024-97c6-285ac53c1fcd for instance with vm_state building and task_state spawning.
Aug 03 04:41:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-56a1bdf1-76b5-41bd-a37d-ccca5fe81ef0 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "81725845-6158-4e34-bedb-6e41219bc227" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.493s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:04 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037663.5975244, 81725845-6158-4e34-bedb-6e41219bc227 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:41:04 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 81725845-6158-4e34-bedb-6e41219bc227] VM Started (Lifecycle Event)
Aug 03 04:41:04 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:41:04 user nova-compute[72444]: INFO nova.compute.manager [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Took 22.35 seconds to build instance.
Aug 03 04:41:04 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:41:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Acquiring lock "refresh_cache-07450ea8-cb80-4318-9fc9-4268944d2cae" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:41:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Acquired lock "refresh_cache-07450ea8-cb80-4318-9fc9-4268944d2cae" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:41:04 user nova-compute[72444]: DEBUG nova.network.neutron [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:41:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f596af4c-8d30-44a6-a207-8a3e76c5c6d0 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.584s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:04 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:41:04 user nova-compute[72444]: DEBUG nova.network.neutron [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:41:04 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:41:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 4.116s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:04 user nova-compute[72444]: DEBUG nova.compute.manager [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 04:41:04 user nova-compute[72444]: DEBUG nova.compute.manager [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 04:41:04 user nova-compute[72444]: DEBUG nova.network.neutron [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 04:41:04 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 04:41:04 user nova-compute[72444]: DEBUG nova.compute.manager [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 04:41:04 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037664.6112084, b6ed9c42-fa6e-4a0d-8312-588471e157f7 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:41:04 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] VM Resumed (Lifecycle Event)
Aug 03 04:41:04 user nova-compute[72444]: DEBUG nova.compute.manager [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:41:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 04:41:04 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:41:04 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:41:04 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Instance spawned successfully.
Aug 03 04:41:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 04:41:04 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:41:04 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037664.6113508, b6ed9c42-fa6e-4a0d-8312-588471e157f7 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:41:04 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] VM Started (Lifecycle Event)
Aug 03 04:41:04 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:41:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:04 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:41:04 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:41:04 user nova-compute[72444]: DEBUG nova.compute.manager [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 04:41:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 04:41:04 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Creating image(s)
Aug 03 04:41:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "/opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "/opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "/opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:05 user nova-compute[72444]: INFO nova.compute.manager [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Took 19.66 seconds to spawn the instance on the hypervisor.
Aug 03 04:41:05 user nova-compute[72444]: DEBUG nova.compute.manager [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:41:05 user nova-compute[72444]: DEBUG nova.compute.manager [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:41:05 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 04:41:05 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037665.0400565, 85521338-f660-49ab-a3ab-9eb6df7a7353 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:41:05 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] VM Resumed (Lifecycle Event)
Aug 03 04:41:05 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:41:05 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Instance spawned successfully.
Aug 03 04:41:05 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 04:41:05 user nova-compute[72444]: DEBUG nova.network.neutron [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Successfully updated port: 269c2e0d-94ee-4084-985a-58c5afed4411 {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:41:05 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:41:05 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:05 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:05 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:05 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:05 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:05 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:05 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:41:05 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037665.0401988, 85521338-f660-49ab-a3ab-9eb6df7a7353 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:41:05 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] VM Started (Lifecycle Event)
Aug 03 04:41:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "refresh_cache-e2859322-6f99-442d-bee1-65fe49ce6360" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:41:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquired lock "refresh_cache-e2859322-6f99-442d-bee1-65fe49ce6360" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:41:05 user nova-compute[72444]: DEBUG nova.network.neutron [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:41:05 user nova-compute[72444]: DEBUG nova.compute.manager [req-b9dae194-53fc-4ba3-a65c-d3e27677a5f2 req-45895edf-7437-4fa6-97d6-a899612d6c71 service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Received event network-changed-269c2e0d-94ee-4084-985a-58c5afed4411 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:41:05 user nova-compute[72444]: DEBUG nova.compute.manager [req-b9dae194-53fc-4ba3-a65c-d3e27677a5f2 req-45895edf-7437-4fa6-97d6-a899612d6c71 service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Refreshing instance network info cache due to event network-changed-269c2e0d-94ee-4084-985a-58c5afed4411. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:41:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b9dae194-53fc-4ba3-a65c-d3e27677a5f2 req-45895edf-7437-4fa6-97d6-a899612d6c71 service nova] Acquiring lock "refresh_cache-e2859322-6f99-442d-bee1-65fe49ce6360" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:41:05 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:41:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.343s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:05 user nova-compute[72444]: INFO nova.compute.manager [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Took 20.76 seconds to build instance.
Aug 03 04:41:05 user nova-compute[72444]: DEBUG nova.policy [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e44603a26afa49098e76422420c825c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65efd00e0ac4039bf1d6429787b8595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 04:41:05 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:41:05 user nova-compute[72444]: INFO nova.compute.manager [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Took 18.79 seconds to spawn the instance on the hypervisor.
Aug 03 04:41:05 user nova-compute[72444]: DEBUG nova.compute.manager [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:41:05 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:41:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5a72beba-c7f4-48f1-af66-8b1b60ba097d tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "b6ed9c42-fa6e-4a0d-8312-588471e157f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.932s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:05 user nova-compute[72444]: DEBUG nova.network.neutron [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:41:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.322s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk 1073741824" returned: 0 in 0.092s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.420s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:05 user nova-compute[72444]: INFO nova.compute.manager [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Took 19.86 seconds to build instance.
Aug 03 04:41:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7142ed4d-cdb6-4a92-ace2-d111c03a557b tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Lock "85521338-f660-49ab-a3ab-9eb6df7a7353" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.020s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.203s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:05 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 04:41:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:05 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037665.90226, e3089887-56df-42de-bc62-88e6db28daf0 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:41:05 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: e3089887-56df-42de-bc62-88e6db28daf0] VM Resumed (Lifecycle Event)
Aug 03 04:41:05 user nova-compute[72444]: DEBUG nova.compute.manager [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:41:05 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 04:41:05 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:41:05 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Instance spawned successfully.
Aug 03 04:41:05 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:41:05 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 04:41:05 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: e3089887-56df-42de-bc62-88e6db28daf0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:41:05 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037665.9127753, e3089887-56df-42de-bc62-88e6db28daf0 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:41:05 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: e3089887-56df-42de-bc62-88e6db28daf0] VM Started (Lifecycle Event)
Aug 03 04:41:05 user nova-compute[72444]: DEBUG nova.network.neutron [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Updating instance_info_cache with network_info: [{"id": "fcb29ef9-b342-48cf-9fab-165ea205728f", "address": "fa:16:3e:26:71:73", "network": {"id": "f0b4a33e-e079-4817-8747-412ca56818fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1198621443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6037670c8c6450bb3663e55b50c6dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb29ef9-b3", "ovs_interfaceid": "fcb29ef9-b342-48cf-9fab-165ea205728f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Releasing lock "refresh_cache-07450ea8-cb80-4318-9fc9-4268944d2cae" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.compute.manager [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Instance network_info: |[{"id": "fcb29ef9-b342-48cf-9fab-165ea205728f", "address": "fa:16:3e:26:71:73", "network": {"id": "f0b4a33e-e079-4817-8747-412ca56818fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1198621443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6037670c8c6450bb3663e55b50c6dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb29ef9-b3", "ovs_interfaceid": "fcb29ef9-b342-48cf-9fab-165ea205728f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Start _get_guest_xml network_info=[{"id": "fcb29ef9-b342-48cf-9fab-165ea205728f", "address": "fa:16:3e:26:71:73", "network": {"id": "f0b4a33e-e079-4817-8747-412ca56818fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1198621443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6037670c8c6450bb3663e55b50c6dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb29ef9-b3", "ovs_interfaceid": "fcb29ef9-b342-48cf-9fab-165ea205728f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json" returned: 0 in 0.337s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:06 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: e3089887-56df-42de-bc62-88e6db28daf0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:41:06 user nova-compute[72444]: INFO nova.compute.manager [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Took 17.28 seconds to spawn the instance on the hypervisor.
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.compute.manager [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Cannot resize image /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.objects.instance [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lazy-loading 'migration_context' on Instance uuid 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Ensure instance console log exists: /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:06 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:41:06 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:40:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-747885102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-747885102',id=7,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFo0buMaxWNwdHLG0PZYLL3TeRl0HBq+TBQ2hljJEyZEtGF1M4DacF/MEi7f+iwmSmEgmz3SST3pjWb/tffOZurJMk3tNoT0suNR4yNbRo0+QA4I59cUEShoHlyupzG1XQ==',key_name='tempest-keypair-880955591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6037670c8c6450bb3663e55b50c6dd5',ramdisk_id='',reservation_id='r-ob8r083f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-780888408',owner_user_name='tempest-ServerActionsV293TestJSON-780888408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:40:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6837fb4f8f04f38a0e429d8905eae54',uuid=07450ea8-cb80-4318-9fc9-4268944d2cae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcb29ef9-b342-48cf-9fab-165ea205728f", "address": "fa:16:3e:26:71:73", "network": {"id": "f0b4a33e-e079-4817-8747-412ca56818fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1198621443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6037670c8c6450bb3663e55b50c6dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb29ef9-b3", "ovs_interfaceid": "fcb29ef9-b342-48cf-9fab-165ea205728f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Converting VIF {"id": "fcb29ef9-b342-48cf-9fab-165ea205728f", "address": "fa:16:3e:26:71:73", "network": {"id": "f0b4a33e-e079-4817-8747-412ca56818fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1198621443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6037670c8c6450bb3663e55b50c6dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb29ef9-b3", "ovs_interfaceid": "fcb29ef9-b342-48cf-9fab-165ea205728f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:71:73,bridge_name='br-int',has_traffic_filtering=True,id=fcb29ef9-b342-48cf-9fab-165ea205728f,network=Network(f0b4a33e-e079-4817-8747-412ca56818fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcb29ef9-b3') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.objects.instance [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lazy-loading 'pci_devices' on Instance uuid 07450ea8-cb80-4318-9fc9-4268944d2cae {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.compute.manager [req-7bc90251-8cac-4b7e-a2db-a296d6c29d3e req-867204b2-f2d9-4150-88ec-1acacf76e936 service nova] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Received event network-changed-fcb29ef9-b342-48cf-9fab-165ea205728f {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.compute.manager [req-7bc90251-8cac-4b7e-a2db-a296d6c29d3e req-867204b2-f2d9-4150-88ec-1acacf76e936 service nova] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Refreshing instance network info cache due to event network-changed-fcb29ef9-b342-48cf-9fab-165ea205728f. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7bc90251-8cac-4b7e-a2db-a296d6c29d3e req-867204b2-f2d9-4150-88ec-1acacf76e936 service nova] Acquiring lock "refresh_cache-07450ea8-cb80-4318-9fc9-4268944d2cae" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7bc90251-8cac-4b7e-a2db-a296d6c29d3e req-867204b2-f2d9-4150-88ec-1acacf76e936 service nova] Acquired lock "refresh_cache-07450ea8-cb80-4318-9fc9-4268944d2cae" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.network.neutron [req-7bc90251-8cac-4b7e-a2db-a296d6c29d3e req-867204b2-f2d9-4150-88ec-1acacf76e936 service nova] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Refreshing network info cache for port fcb29ef9-b342-48cf-9fab-165ea205728f {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:41:06 user nova-compute[72444]:   <uuid>07450ea8-cb80-4318-9fc9-4268944d2cae</uuid>
Aug 03 04:41:06 user nova-compute[72444]:   <name>instance-00000007</name>
Aug 03 04:41:06 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:41:06 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:41:06 user nova-compute[72444]:   <metadata>
Aug 03 04:41:06 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:41:06 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:41:06 user nova-compute[72444]:       <nova:name>tempest-ServerActionsV293TestJSON-server-747885102</nova:name>
Aug 03 04:41:06 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:41:06</nova:creationTime>
Aug 03 04:41:06 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:41:06 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:41:06 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:41:06 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:41:06 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:41:06 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:41:06 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:41:06 user nova-compute[72444]:       <nova:owner>
Aug 03 04:41:06 user nova-compute[72444]:         <nova:user uuid="e6837fb4f8f04f38a0e429d8905eae54">tempest-ServerActionsV293TestJSON-780888408-project-member</nova:user>
Aug 03 04:41:06 user nova-compute[72444]:         <nova:project uuid="f6037670c8c6450bb3663e55b50c6dd5">tempest-ServerActionsV293TestJSON-780888408</nova:project>
Aug 03 04:41:06 user nova-compute[72444]:       </nova:owner>
Aug 03 04:41:06 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:41:06 user nova-compute[72444]:       <nova:ports>
Aug 03 04:41:06 user nova-compute[72444]:         <nova:port uuid="fcb29ef9-b342-48cf-9fab-165ea205728f">
Aug 03 04:41:06 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 03 04:41:06 user nova-compute[72444]:         </nova:port>
Aug 03 04:41:06 user nova-compute[72444]:       </nova:ports>
Aug 03 04:41:06 user nova-compute[72444]:     </nova:instance>
Aug 03 04:41:06 user nova-compute[72444]:   </metadata>
Aug 03 04:41:06 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:41:06 user nova-compute[72444]:     <system>
Aug 03 04:41:06 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:41:06 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:41:06 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:41:06 user nova-compute[72444]:       <entry name="serial">07450ea8-cb80-4318-9fc9-4268944d2cae</entry>
Aug 03 04:41:06 user nova-compute[72444]:       <entry name="uuid">07450ea8-cb80-4318-9fc9-4268944d2cae</entry>
Aug 03 04:41:06 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:41:06 user nova-compute[72444]:     </system>
Aug 03 04:41:06 user nova-compute[72444]:   </sysinfo>
Aug 03 04:41:06 user nova-compute[72444]:   <os>
Aug 03 04:41:06 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:41:06 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:41:06 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:41:06 user nova-compute[72444]:   </os>
Aug 03 04:41:06 user nova-compute[72444]:   <features>
Aug 03 04:41:06 user nova-compute[72444]:     <acpi/>
Aug 03 04:41:06 user nova-compute[72444]:     <apic/>
Aug 03 04:41:06 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:41:06 user nova-compute[72444]:   </features>
Aug 03 04:41:06 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:41:06 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:41:06 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:41:06 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:41:06 user nova-compute[72444]:   </clock>
Aug 03 04:41:06 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:41:06 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:41:06 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:41:06 user nova-compute[72444]:   </cpu>
Aug 03 04:41:06 user nova-compute[72444]:   <devices>
Aug 03 04:41:06 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:41:06 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:41:06 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/07450ea8-cb80-4318-9fc9-4268944d2cae/disk"/>
Aug 03 04:41:06 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:41:06 user nova-compute[72444]:     </disk>
Aug 03 04:41:06 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:41:06 user nova-compute[72444]:       <mac address="fa:16:3e:26:71:73"/>
Aug 03 04:41:06 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:41:06 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:41:06 user nova-compute[72444]:       <target dev="tapfcb29ef9-b3"/>
Aug 03 04:41:06 user nova-compute[72444]:     </interface>
Aug 03 04:41:06 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:41:06 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/07450ea8-cb80-4318-9fc9-4268944d2cae/console.log" append="off"/>
Aug 03 04:41:06 user nova-compute[72444]:     </serial>
Aug 03 04:41:06 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:41:06 user nova-compute[72444]:     <video>
Aug 03 04:41:06 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:41:06 user nova-compute[72444]:     </video>
Aug 03 04:41:06 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:41:06 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:41:06 user nova-compute[72444]:     </rng>
Aug 03 04:41:06 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:41:06 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:41:06 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:41:06 user nova-compute[72444]:     </memballoon>
Aug 03 04:41:06 user nova-compute[72444]:   </devices>
Aug 03 04:41:06 user nova-compute[72444]: </domain>
Aug 03 04:41:06 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:40:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-747885102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-747885102',id=7,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFo0buMaxWNwdHLG0PZYLL3TeRl0HBq+TBQ2hljJEyZEtGF1M4DacF/MEi7f+iwmSmEgmz3SST3pjWb/tffOZurJMk3tNoT0suNR4yNbRo0+QA4I59cUEShoHlyupzG1XQ==',key_name='tempest-keypair-880955591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6037670c8c6450bb3663e55b50c6dd5',ramdisk_id='',reservation_id='r-ob8r083f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-780888408',owner_user_name='tempest-ServerActionsV293TestJSON-780888408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:40:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6837fb4f8f04f38a0e429d8905eae54',uuid=07450ea8-cb80-4318-9fc9-4268944d2cae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcb29ef9-b342-48cf-9fab-165ea205728f", "address": "fa:16:3e:26:71:73", "network": {"id": "f0b4a33e-e079-4817-8747-412ca56818fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1198621443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6037670c8c6450bb3663e55b50c6dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb29ef9-b3", "ovs_interfaceid": "fcb29ef9-b342-48cf-9fab-165ea205728f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Converting VIF {"id": "fcb29ef9-b342-48cf-9fab-165ea205728f", "address": "fa:16:3e:26:71:73", "network": {"id": "f0b4a33e-e079-4817-8747-412ca56818fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1198621443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6037670c8c6450bb3663e55b50c6dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb29ef9-b3", "ovs_interfaceid": "fcb29ef9-b342-48cf-9fab-165ea205728f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:71:73,bridge_name='br-int',has_traffic_filtering=True,id=fcb29ef9-b342-48cf-9fab-165ea205728f,network=Network(f0b4a33e-e079-4817-8747-412ca56818fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcb29ef9-b3') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG os_vif [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:71:73,bridge_name='br-int',has_traffic_filtering=True,id=fcb29ef9-b342-48cf-9fab-165ea205728f,network=Network(f0b4a33e-e079-4817-8747-412ca56818fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcb29ef9-b3') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfcb29ef9-b3, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfcb29ef9-b3, col_values=(('external_ids', {'iface-id': 'fcb29ef9-b342-48cf-9fab-165ea205728f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:71:73', 'vm-uuid': '07450ea8-cb80-4318-9fc9-4268944d2cae'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:06 user nova-compute[72444]: INFO os_vif [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:71:73,bridge_name='br-int',has_traffic_filtering=True,id=fcb29ef9-b342-48cf-9fab-165ea205728f,network=Network(f0b4a33e-e079-4817-8747-412ca56818fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcb29ef9-b3')
Aug 03 04:41:06 user nova-compute[72444]: INFO nova.compute.manager [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Took 18.35 seconds to build instance.
Aug 03 04:41:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9ae6b990-2b92-40cd-84d4-fce2e1c54114 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Lock "e3089887-56df-42de-bc62-88e6db28daf0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.473s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:41:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] No VIF found with MAC fa:16:3e:26:71:73, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:41:07 user nova-compute[72444]: DEBUG nova.network.neutron [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Successfully created port: 841a11a2-ffb3-44cf-9e15-c8099578d405 {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:41:07 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:07 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:07 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:07 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:07 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:07 user nova-compute[72444]: DEBUG nova.network.neutron [req-7bc90251-8cac-4b7e-a2db-a296d6c29d3e req-867204b2-f2d9-4150-88ec-1acacf76e936 service nova] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Updated VIF entry in instance network info cache for port fcb29ef9-b342-48cf-9fab-165ea205728f. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:41:07 user nova-compute[72444]: DEBUG nova.network.neutron [req-7bc90251-8cac-4b7e-a2db-a296d6c29d3e req-867204b2-f2d9-4150-88ec-1acacf76e936 service nova] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Updating instance_info_cache with network_info: [{"id": "fcb29ef9-b342-48cf-9fab-165ea205728f", "address": "fa:16:3e:26:71:73", "network": {"id": "f0b4a33e-e079-4817-8747-412ca56818fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1198621443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6037670c8c6450bb3663e55b50c6dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb29ef9-b3", "ovs_interfaceid": "fcb29ef9-b342-48cf-9fab-165ea205728f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:41:07 user nova-compute[72444]: DEBUG nova.network.neutron [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Updating instance_info_cache with network_info: [{"id": "269c2e0d-94ee-4084-985a-58c5afed4411", "address": "fa:16:3e:bd:11:20", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap269c2e0d-94", "ovs_interfaceid": "269c2e0d-94ee-4084-985a-58c5afed4411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Releasing lock "refresh_cache-e2859322-6f99-442d-bee1-65fe49ce6360" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG nova.compute.manager [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Instance network_info: |[{"id": "269c2e0d-94ee-4084-985a-58c5afed4411", "address": "fa:16:3e:bd:11:20", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap269c2e0d-94", "ovs_interfaceid": "269c2e0d-94ee-4084-985a-58c5afed4411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b9dae194-53fc-4ba3-a65c-d3e27677a5f2 req-45895edf-7437-4fa6-97d6-a899612d6c71 service nova] Acquired lock "refresh_cache-e2859322-6f99-442d-bee1-65fe49ce6360" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG nova.network.neutron [req-b9dae194-53fc-4ba3-a65c-d3e27677a5f2 req-45895edf-7437-4fa6-97d6-a899612d6c71 service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Refreshing network info cache for port 269c2e0d-94ee-4084-985a-58c5afed4411 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Start _get_guest_xml network_info=[{"id": "269c2e0d-94ee-4084-985a-58c5afed4411", "address": "fa:16:3e:bd:11:20", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap269c2e0d-94", "ovs_interfaceid": "269c2e0d-94ee-4084-985a-58c5afed4411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7bc90251-8cac-4b7e-a2db-a296d6c29d3e req-867204b2-f2d9-4150-88ec-1acacf76e936 service nova] Releasing lock "refresh_cache-07450ea8-cb80-4318-9fc9-4268944d2cae" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG nova.compute.manager [req-7bc90251-8cac-4b7e-a2db-a296d6c29d3e req-867204b2-f2d9-4150-88ec-1acacf76e936 service nova] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Received event network-vif-plugged-19cfd924-3dff-4024-97c6-285ac53c1fcd {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7bc90251-8cac-4b7e-a2db-a296d6c29d3e req-867204b2-f2d9-4150-88ec-1acacf76e936 service nova] Acquiring lock "85521338-f660-49ab-a3ab-9eb6df7a7353-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7bc90251-8cac-4b7e-a2db-a296d6c29d3e req-867204b2-f2d9-4150-88ec-1acacf76e936 service nova] Lock "85521338-f660-49ab-a3ab-9eb6df7a7353-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7bc90251-8cac-4b7e-a2db-a296d6c29d3e req-867204b2-f2d9-4150-88ec-1acacf76e936 service nova] Lock "85521338-f660-49ab-a3ab-9eb6df7a7353-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG nova.compute.manager [req-7bc90251-8cac-4b7e-a2db-a296d6c29d3e req-867204b2-f2d9-4150-88ec-1acacf76e936 service nova] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] No waiting events found dispatching network-vif-plugged-19cfd924-3dff-4024-97c6-285ac53c1fcd {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:41:08 user nova-compute[72444]: WARNING nova.compute.manager [req-7bc90251-8cac-4b7e-a2db-a296d6c29d3e req-867204b2-f2d9-4150-88ec-1acacf76e936 service nova] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Received unexpected event network-vif-plugged-19cfd924-3dff-4024-97c6-285ac53c1fcd for instance with vm_state active and task_state None.
Aug 03 04:41:08 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:41:08 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:41:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:40:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-809781841',display_name='tempest-ServerActionsTestOtherA-server-809781841',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-809781841',id=6,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDRHy6esW1Y8XjdGq8kBFPOjS8VFKeCY2PZq9mP7iSJL6lEWXDaTZRjD+kixW9a+QL5lbang2hEmB7Vd5YkTr9lWHW5QxoFRm5vUQ48SZ1Yf+s27SIuqNanyEMadE17HUA==',key_name='tempest-keypair-1657293229',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56d17468ddd64dfabba3a2c7b6df71ef',ramdisk_id='',reservation_id='r-msbwrlvq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1629114222',owner_user_name='tempest-ServerActionsTestOtherA-1629114222-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:40:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7120445361dc4363b4cc6c7671a2716e',uuid=e2859322-6f99-442d-bee1-65fe49ce6360,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "269c2e0d-94ee-4084-985a-58c5afed4411", "address": "fa:16:3e:bd:11:20", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap269c2e0d-94", "ovs_interfaceid": "269c2e0d-94ee-4084-985a-58c5afed4411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Converting VIF {"id": "269c2e0d-94ee-4084-985a-58c5afed4411", "address": "fa:16:3e:bd:11:20", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap269c2e0d-94", "ovs_interfaceid": "269c2e0d-94ee-4084-985a-58c5afed4411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:11:20,bridge_name='br-int',has_traffic_filtering=True,id=269c2e0d-94ee-4084-985a-58c5afed4411,network=Network(95b97be9-d6db-45e9-b0f1-a72fc90b69d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap269c2e0d-94') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG nova.objects.instance [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lazy-loading 'pci_devices' on Instance uuid e2859322-6f99-442d-bee1-65fe49ce6360 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:41:08 user nova-compute[72444]:   <uuid>e2859322-6f99-442d-bee1-65fe49ce6360</uuid>
Aug 03 04:41:08 user nova-compute[72444]:   <name>instance-00000006</name>
Aug 03 04:41:08 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:41:08 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:41:08 user nova-compute[72444]:   <metadata>
Aug 03 04:41:08 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:41:08 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:41:08 user nova-compute[72444]:       <nova:name>tempest-ServerActionsTestOtherA-server-809781841</nova:name>
Aug 03 04:41:08 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:41:08</nova:creationTime>
Aug 03 04:41:08 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:41:08 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:41:08 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:41:08 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:41:08 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:41:08 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:41:08 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:41:08 user nova-compute[72444]:       <nova:owner>
Aug 03 04:41:08 user nova-compute[72444]:         <nova:user uuid="7120445361dc4363b4cc6c7671a2716e">tempest-ServerActionsTestOtherA-1629114222-project-member</nova:user>
Aug 03 04:41:08 user nova-compute[72444]:         <nova:project uuid="56d17468ddd64dfabba3a2c7b6df71ef">tempest-ServerActionsTestOtherA-1629114222</nova:project>
Aug 03 04:41:08 user nova-compute[72444]:       </nova:owner>
Aug 03 04:41:08 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:41:08 user nova-compute[72444]:       <nova:ports>
Aug 03 04:41:08 user nova-compute[72444]:         <nova:port uuid="269c2e0d-94ee-4084-985a-58c5afed4411">
Aug 03 04:41:08 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 03 04:41:08 user nova-compute[72444]:         </nova:port>
Aug 03 04:41:08 user nova-compute[72444]:       </nova:ports>
Aug 03 04:41:08 user nova-compute[72444]:     </nova:instance>
Aug 03 04:41:08 user nova-compute[72444]:   </metadata>
Aug 03 04:41:08 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:41:08 user nova-compute[72444]:     <system>
Aug 03 04:41:08 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:41:08 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:41:08 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:41:08 user nova-compute[72444]:       <entry name="serial">e2859322-6f99-442d-bee1-65fe49ce6360</entry>
Aug 03 04:41:08 user nova-compute[72444]:       <entry name="uuid">e2859322-6f99-442d-bee1-65fe49ce6360</entry>
Aug 03 04:41:08 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:41:08 user nova-compute[72444]:     </system>
Aug 03 04:41:08 user nova-compute[72444]:   </sysinfo>
Aug 03 04:41:08 user nova-compute[72444]:   <os>
Aug 03 04:41:08 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:41:08 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:41:08 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:41:08 user nova-compute[72444]:   </os>
Aug 03 04:41:08 user nova-compute[72444]:   <features>
Aug 03 04:41:08 user nova-compute[72444]:     <acpi/>
Aug 03 04:41:08 user nova-compute[72444]:     <apic/>
Aug 03 04:41:08 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:41:08 user nova-compute[72444]:   </features>
Aug 03 04:41:08 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:41:08 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:41:08 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:41:08 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:41:08 user nova-compute[72444]:   </clock>
Aug 03 04:41:08 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:41:08 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:41:08 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:41:08 user nova-compute[72444]:   </cpu>
Aug 03 04:41:08 user nova-compute[72444]:   <devices>
Aug 03 04:41:08 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:41:08 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:41:08 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk"/>
Aug 03 04:41:08 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:41:08 user nova-compute[72444]:     </disk>
Aug 03 04:41:08 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:41:08 user nova-compute[72444]:       <mac address="fa:16:3e:bd:11:20"/>
Aug 03 04:41:08 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:41:08 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:41:08 user nova-compute[72444]:       <target dev="tap269c2e0d-94"/>
Aug 03 04:41:08 user nova-compute[72444]:     </interface>
Aug 03 04:41:08 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:41:08 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/console.log" append="off"/>
Aug 03 04:41:08 user nova-compute[72444]:     </serial>
Aug 03 04:41:08 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:41:08 user nova-compute[72444]:     <video>
Aug 03 04:41:08 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:41:08 user nova-compute[72444]:     </video>
Aug 03 04:41:08 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:41:08 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:41:08 user nova-compute[72444]:     </rng>
Aug 03 04:41:08 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:41:08 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:41:08 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:41:08 user nova-compute[72444]:     </memballoon>
Aug 03 04:41:08 user nova-compute[72444]:   </devices>
Aug 03 04:41:08 user nova-compute[72444]: </domain>
Aug 03 04:41:08 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:40:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-809781841',display_name='tempest-ServerActionsTestOtherA-server-809781841',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-809781841',id=6,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDRHy6esW1Y8XjdGq8kBFPOjS8VFKeCY2PZq9mP7iSJL6lEWXDaTZRjD+kixW9a+QL5lbang2hEmB7Vd5YkTr9lWHW5QxoFRm5vUQ48SZ1Yf+s27SIuqNanyEMadE17HUA==',key_name='tempest-keypair-1657293229',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56d17468ddd64dfabba3a2c7b6df71ef',ramdisk_id='',reservation_id='r-msbwrlvq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1629114222',owner_user_name='tempest-ServerActionsTestOtherA-1629114222-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:40:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7120445361dc4363b4cc6c7671a2716e',uuid=e2859322-6f99-442d-bee1-65fe49ce6360,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "269c2e0d-94ee-4084-985a-58c5afed4411", "address": "fa:16:3e:bd:11:20", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap269c2e0d-94", "ovs_interfaceid": "269c2e0d-94ee-4084-985a-58c5afed4411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Converting VIF {"id": "269c2e0d-94ee-4084-985a-58c5afed4411", "address": "fa:16:3e:bd:11:20", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap269c2e0d-94", "ovs_interfaceid": "269c2e0d-94ee-4084-985a-58c5afed4411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:11:20,bridge_name='br-int',has_traffic_filtering=True,id=269c2e0d-94ee-4084-985a-58c5afed4411,network=Network(95b97be9-d6db-45e9-b0f1-a72fc90b69d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap269c2e0d-94') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG os_vif [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:11:20,bridge_name='br-int',has_traffic_filtering=True,id=269c2e0d-94ee-4084-985a-58c5afed4411,network=Network(95b97be9-d6db-45e9-b0f1-a72fc90b69d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap269c2e0d-94') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap269c2e0d-94, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap269c2e0d-94, col_values=(('external_ids', {'iface-id': '269c2e0d-94ee-4084-985a-58c5afed4411', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:11:20', 'vm-uuid': 'e2859322-6f99-442d-bee1-65fe49ce6360'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:08 user nova-compute[72444]: INFO os_vif [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:11:20,bridge_name='br-int',has_traffic_filtering=True,id=269c2e0d-94ee-4084-985a-58c5afed4411,network=Network(95b97be9-d6db-45e9-b0f1-a72fc90b69d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap269c2e0d-94')
Aug 03 04:41:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] No VIF found with MAC fa:16:3e:bd:11:20, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG nova.network.neutron [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Successfully updated port: 841a11a2-ffb3-44cf-9e15-c8099578d405 {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "refresh_cache-7daab2c6-8768-46ed-a7bb-0ffbd107cf82" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquired lock "refresh_cache-7daab2c6-8768-46ed-a7bb-0ffbd107cf82" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG nova.network.neutron [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG nova.compute.manager [req-df0610f1-4e0c-4165-bb42-49eb939d56fc req-3d572e67-cffe-485d-8a70-552238c300d6 service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Received event network-changed-841a11a2-ffb3-44cf-9e15-c8099578d405 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG nova.compute.manager [req-df0610f1-4e0c-4165-bb42-49eb939d56fc req-3d572e67-cffe-485d-8a70-552238c300d6 service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Refreshing instance network info cache due to event network-changed-841a11a2-ffb3-44cf-9e15-c8099578d405. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-df0610f1-4e0c-4165-bb42-49eb939d56fc req-3d572e67-cffe-485d-8a70-552238c300d6 service nova] Acquiring lock "refresh_cache-7daab2c6-8768-46ed-a7bb-0ffbd107cf82" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:41:08 user nova-compute[72444]: DEBUG nova.network.neutron [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:41:09 user nova-compute[72444]: DEBUG nova.compute.manager [req-5afb3457-155d-4862-850e-853507bf7e19 req-f9204c6b-c2e2-4f80-a975-a6da4880c06b service nova] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Received event network-vif-plugged-6eadddef-1b9b-4a34-8217-dc485697332f {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:41:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5afb3457-155d-4862-850e-853507bf7e19 req-f9204c6b-c2e2-4f80-a975-a6da4880c06b service nova] Acquiring lock "e3089887-56df-42de-bc62-88e6db28daf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5afb3457-155d-4862-850e-853507bf7e19 req-f9204c6b-c2e2-4f80-a975-a6da4880c06b service nova] Lock "e3089887-56df-42de-bc62-88e6db28daf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5afb3457-155d-4862-850e-853507bf7e19 req-f9204c6b-c2e2-4f80-a975-a6da4880c06b service nova] Lock "e3089887-56df-42de-bc62-88e6db28daf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:09 user nova-compute[72444]: DEBUG nova.compute.manager [req-5afb3457-155d-4862-850e-853507bf7e19 req-f9204c6b-c2e2-4f80-a975-a6da4880c06b service nova] [instance: e3089887-56df-42de-bc62-88e6db28daf0] No waiting events found dispatching network-vif-plugged-6eadddef-1b9b-4a34-8217-dc485697332f {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:41:09 user nova-compute[72444]: WARNING nova.compute.manager [req-5afb3457-155d-4862-850e-853507bf7e19 req-f9204c6b-c2e2-4f80-a975-a6da4880c06b service nova] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Received unexpected event network-vif-plugged-6eadddef-1b9b-4a34-8217-dc485697332f for instance with vm_state active and task_state None.
Aug 03 04:41:09 user nova-compute[72444]: DEBUG nova.network.neutron [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Updating instance_info_cache with network_info: [{"id": "841a11a2-ffb3-44cf-9e15-c8099578d405", "address": "fa:16:3e:12:4d:37", "network": {"id": "628fbd1c-7104-4911-9eb9-1f38c394bebd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-366258398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a65efd00e0ac4039bf1d6429787b8595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841a11a2-ff", "ovs_interfaceid": "841a11a2-ffb3-44cf-9e15-c8099578d405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:41:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Releasing lock "refresh_cache-7daab2c6-8768-46ed-a7bb-0ffbd107cf82" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:41:09 user nova-compute[72444]: DEBUG nova.compute.manager [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Instance network_info: |[{"id": "841a11a2-ffb3-44cf-9e15-c8099578d405", "address": "fa:16:3e:12:4d:37", "network": {"id": "628fbd1c-7104-4911-9eb9-1f38c394bebd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-366258398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a65efd00e0ac4039bf1d6429787b8595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841a11a2-ff", "ovs_interfaceid": "841a11a2-ffb3-44cf-9e15-c8099578d405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 04:41:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-df0610f1-4e0c-4165-bb42-49eb939d56fc req-3d572e67-cffe-485d-8a70-552238c300d6 service nova] Acquired lock "refresh_cache-7daab2c6-8768-46ed-a7bb-0ffbd107cf82" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:41:09 user nova-compute[72444]: DEBUG nova.network.neutron [req-df0610f1-4e0c-4165-bb42-49eb939d56fc req-3d572e67-cffe-485d-8a70-552238c300d6 service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Refreshing network info cache for port 841a11a2-ffb3-44cf-9e15-c8099578d405 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:41:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Start _get_guest_xml network_info=[{"id": "841a11a2-ffb3-44cf-9e15-c8099578d405", "address": "fa:16:3e:12:4d:37", "network": {"id": "628fbd1c-7104-4911-9eb9-1f38c394bebd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-366258398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a65efd00e0ac4039bf1d6429787b8595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841a11a2-ff", "ovs_interfaceid": "841a11a2-ffb3-44cf-9e15-c8099578d405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:41:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:09 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:41:09 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:41:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:41:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:41:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:41:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:41:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:41:09 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:41:09 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:41:09 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:41:09 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:41:09 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:41:09 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:41:09 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:41:09 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:41:09 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:41:09 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:41:09 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:41:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1937092257',display_name='tempest-AttachVolumeTestJSON-server-1937092257',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1937092257',id=8,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4GYonfRcDLCfzVaxO6+Z3h0SUoVfhhQmBtRpHMqljFVb2ikupLBIuKrpUkeWbdkWIlD6P8Fdx/ixyrvXF+8nK0TaaJy2ZUXJb0m3JpcoPOM4+0nQ1vkeu15aXRWeoGNg==',key_name='tempest-keypair-142269823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a65efd00e0ac4039bf1d6429787b8595',ramdisk_id='',reservation_id='r-gcoy75p0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1814863301',owner_user_name='tempest-AttachVolumeTestJSON-1814863301-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:41:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e44603a26afa49098e76422420c825c2',uuid=7daab2c6-8768-46ed-a7bb-0ffbd107cf82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "841a11a2-ffb3-44cf-9e15-c8099578d405", "address": "fa:16:3e:12:4d:37", "network": {"id": "628fbd1c-7104-4911-9eb9-1f38c394bebd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-366258398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a65efd00e0ac4039bf1d6429787b8595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841a11a2-ff", "ovs_interfaceid": "841a11a2-ffb3-44cf-9e15-c8099578d405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:41:09 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Converting VIF {"id": "841a11a2-ffb3-44cf-9e15-c8099578d405", "address": "fa:16:3e:12:4d:37", "network": {"id": "628fbd1c-7104-4911-9eb9-1f38c394bebd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-366258398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a65efd00e0ac4039bf1d6429787b8595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841a11a2-ff", "ovs_interfaceid": "841a11a2-ffb3-44cf-9e15-c8099578d405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:41:09 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:4d:37,bridge_name='br-int',has_traffic_filtering=True,id=841a11a2-ffb3-44cf-9e15-c8099578d405,network=Network(628fbd1c-7104-4911-9eb9-1f38c394bebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841a11a2-ff') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:41:09 user nova-compute[72444]: DEBUG nova.objects.instance [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lazy-loading 'pci_devices' on Instance uuid 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:41:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:41:09 user nova-compute[72444]:   <uuid>7daab2c6-8768-46ed-a7bb-0ffbd107cf82</uuid>
Aug 03 04:41:09 user nova-compute[72444]:   <name>instance-00000008</name>
Aug 03 04:41:09 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:41:09 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:41:09 user nova-compute[72444]:   <metadata>
Aug 03 04:41:09 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:41:09 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:41:09 user nova-compute[72444]:       <nova:name>tempest-AttachVolumeTestJSON-server-1937092257</nova:name>
Aug 03 04:41:09 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:41:09</nova:creationTime>
Aug 03 04:41:09 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:41:09 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:41:09 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:41:09 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:41:09 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:41:09 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:41:09 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:41:09 user nova-compute[72444]:       <nova:owner>
Aug 03 04:41:09 user nova-compute[72444]:         <nova:user uuid="e44603a26afa49098e76422420c825c2">tempest-AttachVolumeTestJSON-1814863301-project-member</nova:user>
Aug 03 04:41:09 user nova-compute[72444]:         <nova:project uuid="a65efd00e0ac4039bf1d6429787b8595">tempest-AttachVolumeTestJSON-1814863301</nova:project>
Aug 03 04:41:09 user nova-compute[72444]:       </nova:owner>
Aug 03 04:41:09 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:41:09 user nova-compute[72444]:       <nova:ports>
Aug 03 04:41:09 user nova-compute[72444]:         <nova:port uuid="841a11a2-ffb3-44cf-9e15-c8099578d405">
Aug 03 04:41:09 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 03 04:41:09 user nova-compute[72444]:         </nova:port>
Aug 03 04:41:09 user nova-compute[72444]:       </nova:ports>
Aug 03 04:41:09 user nova-compute[72444]:     </nova:instance>
Aug 03 04:41:09 user nova-compute[72444]:   </metadata>
Aug 03 04:41:09 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:41:09 user nova-compute[72444]:     <system>
Aug 03 04:41:09 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:41:09 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:41:09 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:41:09 user nova-compute[72444]:       <entry name="serial">7daab2c6-8768-46ed-a7bb-0ffbd107cf82</entry>
Aug 03 04:41:09 user nova-compute[72444]:       <entry name="uuid">7daab2c6-8768-46ed-a7bb-0ffbd107cf82</entry>
Aug 03 04:41:09 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:41:09 user nova-compute[72444]:     </system>
Aug 03 04:41:09 user nova-compute[72444]:   </sysinfo>
Aug 03 04:41:09 user nova-compute[72444]:   <os>
Aug 03 04:41:09 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:41:09 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:41:09 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:41:09 user nova-compute[72444]:   </os>
Aug 03 04:41:09 user nova-compute[72444]:   <features>
Aug 03 04:41:09 user nova-compute[72444]:     <acpi/>
Aug 03 04:41:09 user nova-compute[72444]:     <apic/>
Aug 03 04:41:09 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:41:09 user nova-compute[72444]:   </features>
Aug 03 04:41:09 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:41:09 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:41:09 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:41:09 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:41:09 user nova-compute[72444]:   </clock>
Aug 03 04:41:09 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:41:09 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:41:09 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:41:09 user nova-compute[72444]:   </cpu>
Aug 03 04:41:09 user nova-compute[72444]:   <devices>
Aug 03 04:41:09 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:41:09 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:41:09 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk"/>
Aug 03 04:41:09 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:41:09 user nova-compute[72444]:     </disk>
Aug 03 04:41:09 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:41:09 user nova-compute[72444]:       <mac address="fa:16:3e:12:4d:37"/>
Aug 03 04:41:09 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:41:09 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:41:09 user nova-compute[72444]:       <target dev="tap841a11a2-ff"/>
Aug 03 04:41:09 user nova-compute[72444]:     </interface>
Aug 03 04:41:09 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:41:09 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/console.log" append="off"/>
Aug 03 04:41:09 user nova-compute[72444]:     </serial>
Aug 03 04:41:09 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:41:09 user nova-compute[72444]:     <video>
Aug 03 04:41:09 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:41:09 user nova-compute[72444]:     </video>
Aug 03 04:41:09 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:41:09 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:41:09 user nova-compute[72444]:     </rng>
Aug 03 04:41:09 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:41:09 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:41:09 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:41:09 user nova-compute[72444]:     </memballoon>
Aug 03 04:41:09 user nova-compute[72444]:   </devices>
Aug 03 04:41:09 user nova-compute[72444]: </domain>
Aug 03 04:41:09 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:41:10 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1937092257',display_name='tempest-AttachVolumeTestJSON-server-1937092257',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1937092257',id=8,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4GYonfRcDLCfzVaxO6+Z3h0SUoVfhhQmBtRpHMqljFVb2ikupLBIuKrpUkeWbdkWIlD6P8Fdx/ixyrvXF+8nK0TaaJy2ZUXJb0m3JpcoPOM4+0nQ1vkeu15aXRWeoGNg==',key_name='tempest-keypair-142269823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a65efd00e0ac4039bf1d6429787b8595',ramdisk_id='',reservation_id='r-gcoy75p0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1814863301',owner_user_name='tempest-AttachVolumeTestJSON-1814863301-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:41:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e44603a26afa49098e76422420c825c2',uuid=7daab2c6-8768-46ed-a7bb-0ffbd107cf82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "841a11a2-ffb3-44cf-9e15-c8099578d405", "address": "fa:16:3e:12:4d:37", "network": {"id": "628fbd1c-7104-4911-9eb9-1f38c394bebd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-366258398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a65efd00e0ac4039bf1d6429787b8595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841a11a2-ff", "ovs_interfaceid": "841a11a2-ffb3-44cf-9e15-c8099578d405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:41:10 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Converting VIF {"id": "841a11a2-ffb3-44cf-9e15-c8099578d405", "address": "fa:16:3e:12:4d:37", "network": {"id": "628fbd1c-7104-4911-9eb9-1f38c394bebd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-366258398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a65efd00e0ac4039bf1d6429787b8595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841a11a2-ff", "ovs_interfaceid": "841a11a2-ffb3-44cf-9e15-c8099578d405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:41:10 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:4d:37,bridge_name='br-int',has_traffic_filtering=True,id=841a11a2-ffb3-44cf-9e15-c8099578d405,network=Network(628fbd1c-7104-4911-9eb9-1f38c394bebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841a11a2-ff') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:41:10 user nova-compute[72444]: DEBUG os_vif [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:4d:37,bridge_name='br-int',has_traffic_filtering=True,id=841a11a2-ffb3-44cf-9e15-c8099578d405,network=Network(628fbd1c-7104-4911-9eb9-1f38c394bebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841a11a2-ff') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:41:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:41:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:41:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap841a11a2-ff, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:41:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap841a11a2-ff, col_values=(('external_ids', {'iface-id': '841a11a2-ffb3-44cf-9e15-c8099578d405', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:4d:37', 'vm-uuid': '7daab2c6-8768-46ed-a7bb-0ffbd107cf82'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:41:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:41:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:10 user nova-compute[72444]: INFO os_vif [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:4d:37,bridge_name='br-int',has_traffic_filtering=True,id=841a11a2-ffb3-44cf-9e15-c8099578d405,network=Network(628fbd1c-7104-4911-9eb9-1f38c394bebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841a11a2-ff')
Aug 03 04:41:10 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:41:10 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] No VIF found with MAC fa:16:3e:12:4d:37, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:41:10 user nova-compute[72444]: DEBUG nova.network.neutron [req-df0610f1-4e0c-4165-bb42-49eb939d56fc req-3d572e67-cffe-485d-8a70-552238c300d6 service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Updated VIF entry in instance network info cache for port 841a11a2-ffb3-44cf-9e15-c8099578d405. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:41:10 user nova-compute[72444]: DEBUG nova.network.neutron [req-df0610f1-4e0c-4165-bb42-49eb939d56fc req-3d572e67-cffe-485d-8a70-552238c300d6 service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Updating instance_info_cache with network_info: [{"id": "841a11a2-ffb3-44cf-9e15-c8099578d405", "address": "fa:16:3e:12:4d:37", "network": {"id": "628fbd1c-7104-4911-9eb9-1f38c394bebd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-366258398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a65efd00e0ac4039bf1d6429787b8595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841a11a2-ff", "ovs_interfaceid": "841a11a2-ffb3-44cf-9e15-c8099578d405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:41:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-df0610f1-4e0c-4165-bb42-49eb939d56fc req-3d572e67-cffe-485d-8a70-552238c300d6 service nova] Releasing lock "refresh_cache-7daab2c6-8768-46ed-a7bb-0ffbd107cf82" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:41:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:12 user nova-compute[72444]: DEBUG nova.network.neutron [req-b9dae194-53fc-4ba3-a65c-d3e27677a5f2 req-45895edf-7437-4fa6-97d6-a899612d6c71 service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Updated VIF entry in instance network info cache for port 269c2e0d-94ee-4084-985a-58c5afed4411. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:41:12 user nova-compute[72444]: DEBUG nova.network.neutron [req-b9dae194-53fc-4ba3-a65c-d3e27677a5f2 req-45895edf-7437-4fa6-97d6-a899612d6c71 service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Updating instance_info_cache with network_info: [{"id": "269c2e0d-94ee-4084-985a-58c5afed4411", "address": "fa:16:3e:bd:11:20", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap269c2e0d-94", "ovs_interfaceid": "269c2e0d-94ee-4084-985a-58c5afed4411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:41:12 user nova-compute[72444]: DEBUG nova.compute.manager [req-8467cde1-136d-4288-a28d-bcdb281e4601 req-6775dca4-928e-4862-afbc-7b9a942be5cb service nova] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Received event network-vif-plugged-6eadddef-1b9b-4a34-8217-dc485697332f {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:41:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8467cde1-136d-4288-a28d-bcdb281e4601 req-6775dca4-928e-4862-afbc-7b9a942be5cb service nova] Acquiring lock "e3089887-56df-42de-bc62-88e6db28daf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8467cde1-136d-4288-a28d-bcdb281e4601 req-6775dca4-928e-4862-afbc-7b9a942be5cb service nova] Lock "e3089887-56df-42de-bc62-88e6db28daf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8467cde1-136d-4288-a28d-bcdb281e4601 req-6775dca4-928e-4862-afbc-7b9a942be5cb service nova] Lock "e3089887-56df-42de-bc62-88e6db28daf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:12 user nova-compute[72444]: DEBUG nova.compute.manager [req-8467cde1-136d-4288-a28d-bcdb281e4601 req-6775dca4-928e-4862-afbc-7b9a942be5cb service nova] [instance: e3089887-56df-42de-bc62-88e6db28daf0] No waiting events found dispatching network-vif-plugged-6eadddef-1b9b-4a34-8217-dc485697332f {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:41:12 user nova-compute[72444]: WARNING nova.compute.manager [req-8467cde1-136d-4288-a28d-bcdb281e4601 req-6775dca4-928e-4862-afbc-7b9a942be5cb service nova] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Received unexpected event network-vif-plugged-6eadddef-1b9b-4a34-8217-dc485697332f for instance with vm_state active and task_state None.
Aug 03 04:41:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b9dae194-53fc-4ba3-a65c-d3e27677a5f2 req-45895edf-7437-4fa6-97d6-a899612d6c71 service nova] Releasing lock "refresh_cache-e2859322-6f99-442d-bee1-65fe49ce6360" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:41:12 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:12 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:12 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:12 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:12 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:13 user nova-compute[72444]: DEBUG nova.compute.manager [req-6dc3a62e-7a50-403a-ba52-5971dd116368 req-108d518e-4b17-42cd-b4bd-1f5ec87eb202 service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Received event network-vif-plugged-269c2e0d-94ee-4084-985a-58c5afed4411 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:41:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6dc3a62e-7a50-403a-ba52-5971dd116368 req-108d518e-4b17-42cd-b4bd-1f5ec87eb202 service nova] Acquiring lock "e2859322-6f99-442d-bee1-65fe49ce6360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6dc3a62e-7a50-403a-ba52-5971dd116368 req-108d518e-4b17-42cd-b4bd-1f5ec87eb202 service nova] Lock "e2859322-6f99-442d-bee1-65fe49ce6360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6dc3a62e-7a50-403a-ba52-5971dd116368 req-108d518e-4b17-42cd-b4bd-1f5ec87eb202 service nova] Lock "e2859322-6f99-442d-bee1-65fe49ce6360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:13 user nova-compute[72444]: DEBUG nova.compute.manager [req-6dc3a62e-7a50-403a-ba52-5971dd116368 req-108d518e-4b17-42cd-b4bd-1f5ec87eb202 service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] No waiting events found dispatching network-vif-plugged-269c2e0d-94ee-4084-985a-58c5afed4411 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:41:13 user nova-compute[72444]: WARNING nova.compute.manager [req-6dc3a62e-7a50-403a-ba52-5971dd116368 req-108d518e-4b17-42cd-b4bd-1f5ec87eb202 service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Received unexpected event network-vif-plugged-269c2e0d-94ee-4084-985a-58c5afed4411 for instance with vm_state building and task_state spawning.
Aug 03 04:41:14 user nova-compute[72444]: DEBUG nova.compute.manager [req-d4346ab2-fe36-4671-a826-5a2e316d6ac1 req-6c8b6dae-82a9-49ac-92b2-13b4515f26d0 service nova] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Received event network-vif-plugged-fcb29ef9-b342-48cf-9fab-165ea205728f {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:41:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d4346ab2-fe36-4671-a826-5a2e316d6ac1 req-6c8b6dae-82a9-49ac-92b2-13b4515f26d0 service nova] Acquiring lock "07450ea8-cb80-4318-9fc9-4268944d2cae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d4346ab2-fe36-4671-a826-5a2e316d6ac1 req-6c8b6dae-82a9-49ac-92b2-13b4515f26d0 service nova] Lock "07450ea8-cb80-4318-9fc9-4268944d2cae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d4346ab2-fe36-4671-a826-5a2e316d6ac1 req-6c8b6dae-82a9-49ac-92b2-13b4515f26d0 service nova] Lock "07450ea8-cb80-4318-9fc9-4268944d2cae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:14 user nova-compute[72444]: DEBUG nova.compute.manager [req-d4346ab2-fe36-4671-a826-5a2e316d6ac1 req-6c8b6dae-82a9-49ac-92b2-13b4515f26d0 service nova] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] No waiting events found dispatching network-vif-plugged-fcb29ef9-b342-48cf-9fab-165ea205728f {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:41:14 user nova-compute[72444]: WARNING nova.compute.manager [req-d4346ab2-fe36-4671-a826-5a2e316d6ac1 req-6c8b6dae-82a9-49ac-92b2-13b4515f26d0 service nova] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Received unexpected event network-vif-plugged-fcb29ef9-b342-48cf-9fab-165ea205728f for instance with vm_state building and task_state spawning.
Aug 03 04:41:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:14 user nova-compute[72444]: DEBUG nova.compute.manager [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:41:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 04:41:14 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037674.9244225, 07450ea8-cb80-4318-9fc9-4268944d2cae => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:41:14 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] VM Resumed (Lifecycle Event)
Aug 03 04:41:14 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Instance spawned successfully.
Aug 03 04:41:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 04:41:14 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:41:15 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:15 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:15 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:15 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:15 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:15 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:15 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:41:15 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:41:15 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037674.9259117, 07450ea8-cb80-4318-9fc9-4268944d2cae => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:41:15 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] VM Started (Lifecycle Event)
Aug 03 04:41:15 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:41:15 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:41:15 user nova-compute[72444]: INFO nova.compute.manager [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Took 16.83 seconds to spawn the instance on the hypervisor.
Aug 03 04:41:15 user nova-compute[72444]: DEBUG nova.compute.manager [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:41:15 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:41:15 user nova-compute[72444]: INFO nova.compute.manager [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Took 18.17 seconds to build instance.
Aug 03 04:41:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-dd773f7c-ec9e-4d9a-a545-4ef18bf5ec04 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "07450ea8-cb80-4318-9fc9-4268944d2cae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.475s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:16 user nova-compute[72444]: DEBUG nova.compute.manager [req-9749e503-3fe1-4b08-ad86-a8dcbc3f2c2f req-c52cc247-b1b8-4f04-8ea4-0b6dec1d1fb5 service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Received event network-vif-plugged-269c2e0d-94ee-4084-985a-58c5afed4411 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:41:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9749e503-3fe1-4b08-ad86-a8dcbc3f2c2f req-c52cc247-b1b8-4f04-8ea4-0b6dec1d1fb5 service nova] Acquiring lock "e2859322-6f99-442d-bee1-65fe49ce6360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9749e503-3fe1-4b08-ad86-a8dcbc3f2c2f req-c52cc247-b1b8-4f04-8ea4-0b6dec1d1fb5 service nova] Lock "e2859322-6f99-442d-bee1-65fe49ce6360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9749e503-3fe1-4b08-ad86-a8dcbc3f2c2f req-c52cc247-b1b8-4f04-8ea4-0b6dec1d1fb5 service nova] Lock "e2859322-6f99-442d-bee1-65fe49ce6360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:16 user nova-compute[72444]: DEBUG nova.compute.manager [req-9749e503-3fe1-4b08-ad86-a8dcbc3f2c2f req-c52cc247-b1b8-4f04-8ea4-0b6dec1d1fb5 service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] No waiting events found dispatching network-vif-plugged-269c2e0d-94ee-4084-985a-58c5afed4411 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:41:16 user nova-compute[72444]: WARNING nova.compute.manager [req-9749e503-3fe1-4b08-ad86-a8dcbc3f2c2f req-c52cc247-b1b8-4f04-8ea4-0b6dec1d1fb5 service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Received unexpected event network-vif-plugged-269c2e0d-94ee-4084-985a-58c5afed4411 for instance with vm_state building and task_state spawning.
Aug 03 04:41:16 user nova-compute[72444]: DEBUG nova.compute.manager [req-4b5a4653-5881-4030-b449-21a2db66bb61 req-5315eba9-6700-4722-889e-10df7bf38f15 service nova] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Received event network-vif-plugged-fcb29ef9-b342-48cf-9fab-165ea205728f {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:41:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4b5a4653-5881-4030-b449-21a2db66bb61 req-5315eba9-6700-4722-889e-10df7bf38f15 service nova] Acquiring lock "07450ea8-cb80-4318-9fc9-4268944d2cae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4b5a4653-5881-4030-b449-21a2db66bb61 req-5315eba9-6700-4722-889e-10df7bf38f15 service nova] Lock "07450ea8-cb80-4318-9fc9-4268944d2cae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4b5a4653-5881-4030-b449-21a2db66bb61 req-5315eba9-6700-4722-889e-10df7bf38f15 service nova] Lock "07450ea8-cb80-4318-9fc9-4268944d2cae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:16 user nova-compute[72444]: DEBUG nova.compute.manager [req-4b5a4653-5881-4030-b449-21a2db66bb61 req-5315eba9-6700-4722-889e-10df7bf38f15 service nova] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] No waiting events found dispatching network-vif-plugged-fcb29ef9-b342-48cf-9fab-165ea205728f {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:41:16 user nova-compute[72444]: WARNING nova.compute.manager [req-4b5a4653-5881-4030-b449-21a2db66bb61 req-5315eba9-6700-4722-889e-10df7bf38f15 service nova] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Received unexpected event network-vif-plugged-fcb29ef9-b342-48cf-9fab-165ea205728f for instance with vm_state active and task_state None.
Aug 03 04:41:16 user nova-compute[72444]: DEBUG nova.compute.manager [req-4b5a4653-5881-4030-b449-21a2db66bb61 req-5315eba9-6700-4722-889e-10df7bf38f15 service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Received event network-vif-plugged-841a11a2-ffb3-44cf-9e15-c8099578d405 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:41:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4b5a4653-5881-4030-b449-21a2db66bb61 req-5315eba9-6700-4722-889e-10df7bf38f15 service nova] Acquiring lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4b5a4653-5881-4030-b449-21a2db66bb61 req-5315eba9-6700-4722-889e-10df7bf38f15 service nova] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4b5a4653-5881-4030-b449-21a2db66bb61 req-5315eba9-6700-4722-889e-10df7bf38f15 service nova] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:16 user nova-compute[72444]: DEBUG nova.compute.manager [req-4b5a4653-5881-4030-b449-21a2db66bb61 req-5315eba9-6700-4722-889e-10df7bf38f15 service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] No waiting events found dispatching network-vif-plugged-841a11a2-ffb3-44cf-9e15-c8099578d405 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:41:16 user nova-compute[72444]: WARNING nova.compute.manager [req-4b5a4653-5881-4030-b449-21a2db66bb61 req-5315eba9-6700-4722-889e-10df7bf38f15 service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Received unexpected event network-vif-plugged-841a11a2-ffb3-44cf-9e15-c8099578d405 for instance with vm_state building and task_state spawning.
Aug 03 04:41:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Acquiring lock "4d5c0324-68e8-4f0a-a740-0b4551e81fac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Lock "4d5c0324-68e8-4f0a-a740-0b4551e81fac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:17 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037677.1222553, 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:41:17 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] VM Resumed (Lifecycle Event)
Aug 03 04:41:17 user nova-compute[72444]: DEBUG nova.compute.manager [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:41:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 04:41:17 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Instance spawned successfully.
Aug 03 04:41:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 04:41:17 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:41:17 user nova-compute[72444]: DEBUG nova.compute.manager [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 04:41:17 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:41:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:17 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:41:17 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037677.123603, 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:41:17 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] VM Started (Lifecycle Event)
Aug 03 04:41:17 user nova-compute[72444]: DEBUG nova.compute.manager [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:41:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 04:41:17 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Instance spawned successfully.
Aug 03 04:41:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 04:41:17 user nova-compute[72444]: INFO nova.compute.manager [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Took 12.61 seconds to spawn the instance on the hypervisor.
Aug 03 04:41:17 user nova-compute[72444]: DEBUG nova.compute.manager [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:41:17 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:41:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:17 user nova-compute[72444]: INFO nova.compute.manager [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Took 20.66 seconds to spawn the instance on the hypervisor.
Aug 03 04:41:17 user nova-compute[72444]: DEBUG nova.compute.manager [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:41:17 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:41:17 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 04:41:17 user nova-compute[72444]: INFO nova.compute.claims [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Claim successful on node user
Aug 03 04:41:17 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:41:17 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037677.3322647, e2859322-6f99-442d-bee1-65fe49ce6360 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:41:17 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] VM Resumed (Lifecycle Event)
Aug 03 04:41:17 user nova-compute[72444]: INFO nova.compute.manager [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Took 17.68 seconds to build instance.
Aug 03 04:41:17 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:41:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2df2804b-c5ea-4bed-9882-5baa12625609 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.906s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:18 user nova-compute[72444]: INFO nova.compute.manager [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Took 21.68 seconds to build instance.
Aug 03 04:41:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-471a5b1f-6453-4b71-a95c-3b391200c626 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "e2859322-6f99-442d-bee1-65fe49ce6360" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.821s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:18 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:41:18 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037677.3341663, e2859322-6f99-442d-bee1-65fe49ce6360 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:41:18 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] VM Started (Lifecycle Event)
Aug 03 04:41:18 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:41:18 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:41:18 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:41:18 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:41:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.015s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:18 user nova-compute[72444]: DEBUG nova.compute.manager [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 04:41:18 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:18 user nova-compute[72444]: DEBUG nova.compute.manager [req-9aab6de3-de0e-4990-82b3-02d429d074ea req-87eeb5f1-3d80-44c1-9003-b4876145a8c0 service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Received event network-vif-plugged-841a11a2-ffb3-44cf-9e15-c8099578d405 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:41:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9aab6de3-de0e-4990-82b3-02d429d074ea req-87eeb5f1-3d80-44c1-9003-b4876145a8c0 service nova] Acquiring lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9aab6de3-de0e-4990-82b3-02d429d074ea req-87eeb5f1-3d80-44c1-9003-b4876145a8c0 service nova] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9aab6de3-de0e-4990-82b3-02d429d074ea req-87eeb5f1-3d80-44c1-9003-b4876145a8c0 service nova] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:18 user nova-compute[72444]: DEBUG nova.compute.manager [req-9aab6de3-de0e-4990-82b3-02d429d074ea req-87eeb5f1-3d80-44c1-9003-b4876145a8c0 service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] No waiting events found dispatching network-vif-plugged-841a11a2-ffb3-44cf-9e15-c8099578d405 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:41:18 user nova-compute[72444]: WARNING nova.compute.manager [req-9aab6de3-de0e-4990-82b3-02d429d074ea req-87eeb5f1-3d80-44c1-9003-b4876145a8c0 service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Received unexpected event network-vif-plugged-841a11a2-ffb3-44cf-9e15-c8099578d405 for instance with vm_state active and task_state None.
Aug 03 04:41:18 user nova-compute[72444]: DEBUG nova.compute.manager [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 04:41:18 user nova-compute[72444]: DEBUG nova.network.neutron [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 04:41:18 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 03 04:41:18 user nova-compute[72444]: DEBUG nova.compute.manager [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 04:41:19 user nova-compute[72444]: DEBUG nova.policy [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd977491d031344f7b6c9438c99e434dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fef3fddba949838bc580dd71a24f44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 04:41:19 user nova-compute[72444]: DEBUG nova.compute.manager [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 04:41:19 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 04:41:19 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Creating image(s)
Aug 03 04:41:19 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Acquiring lock "/opt/stack/data/nova/instances/4d5c0324-68e8-4f0a-a740-0b4551e81fac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:19 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Lock "/opt/stack/data/nova/instances/4d5c0324-68e8-4f0a-a740-0b4551e81fac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:19 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Lock "/opt/stack/data/nova/instances/4d5c0324-68e8-4f0a-a740-0b4551e81fac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:19 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Acquiring lock "6a8c40599f74054742e318f5913d29f10740fe8a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:19 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Lock "6a8c40599f74054742e318f5913d29f10740fe8a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a8c40599f74054742e318f5913d29f10740fe8a.part --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a8c40599f74054742e318f5913d29f10740fe8a.part --force-share --output=json" returned: 0 in 0.189s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:20 user nova-compute[72444]: DEBUG nova.virt.images [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] e71f545b-f80d-47f1-8b23-7dd1afc643d8 was qcow2, converting to raw {{(pid=72444) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 03 04:41:20 user nova-compute[72444]: DEBUG nova.privsep.utils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72444) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 03 04:41:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6a8c40599f74054742e318f5913d29f10740fe8a.part /opt/stack/data/nova/instances/_base/6a8c40599f74054742e318f5913d29f10740fe8a.converted {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6a8c40599f74054742e318f5913d29f10740fe8a.part /opt/stack/data/nova/instances/_base/6a8c40599f74054742e318f5913d29f10740fe8a.converted" returned: 0 in 0.302s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a8c40599f74054742e318f5913d29f10740fe8a.converted --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a8c40599f74054742e318f5913d29f10740fe8a.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Lock "6a8c40599f74054742e318f5913d29f10740fe8a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.775s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a8c40599f74054742e318f5913d29f10740fe8a --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a8c40599f74054742e318f5913d29f10740fe8a --force-share --output=json" returned: 0 in 0.217s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Acquiring lock "6a8c40599f74054742e318f5913d29f10740fe8a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Lock "6a8c40599f74054742e318f5913d29f10740fe8a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a8c40599f74054742e318f5913d29f10740fe8a --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a8c40599f74054742e318f5913d29f10740fe8a --force-share --output=json" returned: 0 in 0.223s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a8c40599f74054742e318f5913d29f10740fe8a,backing_fmt=raw /opt/stack/data/nova/instances/4d5c0324-68e8-4f0a-a740-0b4551e81fac/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a8c40599f74054742e318f5913d29f10740fe8a,backing_fmt=raw /opt/stack/data/nova/instances/4d5c0324-68e8-4f0a-a740-0b4551e81fac/disk 1073741824" returned: 0 in 0.093s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Lock "6a8c40599f74054742e318f5913d29f10740fe8a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.327s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a8c40599f74054742e318f5913d29f10740fe8a --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a8c40599f74054742e318f5913d29f10740fe8a --force-share --output=json" returned: 0 in 0.198s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:21 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4d5c0324-68e8-4f0a-a740-0b4551e81fac/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 04:41:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d5c0324-68e8-4f0a-a740-0b4551e81fac/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d5c0324-68e8-4f0a-a740-0b4551e81fac/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:21 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Cannot resize image /opt/stack/data/nova/instances/4d5c0324-68e8-4f0a-a740-0b4551e81fac/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 04:41:21 user nova-compute[72444]: DEBUG nova.objects.instance [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Lazy-loading 'migration_context' on Instance uuid 4d5c0324-68e8-4f0a-a740-0b4551e81fac {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:41:22 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 04:41:22 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Ensure instance console log exists: /opt/stack/data/nova/instances/4d5c0324-68e8-4f0a-a740-0b4551e81fac/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 04:41:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:22 user nova-compute[72444]: DEBUG nova.network.neutron [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Successfully created port: d181dc6a-eec0-4611-9f3b-c8c43052c56c {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:41:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Acquiring lock "42f131f8-83ac-4fd4-b056-f8dac3d32c55" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Lock "42f131f8-83ac-4fd4-b056-f8dac3d32c55" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:23 user nova-compute[72444]: DEBUG nova.compute.manager [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 04:41:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:24 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 04:41:24 user nova-compute[72444]: INFO nova.compute.claims [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Claim successful on node user
Aug 03 04:41:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:24 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:41:24 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:41:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.674s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:24 user nova-compute[72444]: DEBUG nova.compute.manager [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 04:41:24 user nova-compute[72444]: DEBUG nova.compute.manager [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 04:41:24 user nova-compute[72444]: DEBUG nova.network.neutron [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 04:41:24 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 04:41:24 user nova-compute[72444]: DEBUG nova.compute.manager [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 04:41:25 user nova-compute[72444]: DEBUG nova.policy [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4bb66f8aaf9d4274890e912fa56778be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5432e4ac5443489a923966c0c85ef140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 04:41:25 user nova-compute[72444]: DEBUG nova.compute.manager [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 04:41:25 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 04:41:25 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Creating image(s)
Aug 03 04:41:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Acquiring lock "/opt/stack/data/nova/instances/42f131f8-83ac-4fd4-b056-f8dac3d32c55/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Lock "/opt/stack/data/nova/instances/42f131f8-83ac-4fd4-b056-f8dac3d32c55/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Lock "/opt/stack/data/nova/instances/42f131f8-83ac-4fd4-b056-f8dac3d32c55/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.212s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.182s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/42f131f8-83ac-4fd4-b056-f8dac3d32c55/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/42f131f8-83ac-4fd4-b056-f8dac3d32c55/disk 1073741824" returned: 0 in 0.078s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.156s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:25 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Checking if we can resize image /opt/stack/data/nova/instances/42f131f8-83ac-4fd4-b056-f8dac3d32c55/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 04:41:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f131f8-83ac-4fd4-b056-f8dac3d32c55/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f131f8-83ac-4fd4-b056-f8dac3d32c55/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:25 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Cannot resize image /opt/stack/data/nova/instances/42f131f8-83ac-4fd4-b056-f8dac3d32c55/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 04:41:25 user nova-compute[72444]: DEBUG nova.objects.instance [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Lazy-loading 'migration_context' on Instance uuid 42f131f8-83ac-4fd4-b056-f8dac3d32c55 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:41:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 04:41:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Ensure instance console log exists: /opt/stack/data/nova/instances/42f131f8-83ac-4fd4-b056-f8dac3d32c55/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 04:41:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:26 user nova-compute[72444]: DEBUG nova.network.neutron [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Successfully updated port: d181dc6a-eec0-4611-9f3b-c8c43052c56c {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:41:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Acquiring lock "refresh_cache-4d5c0324-68e8-4f0a-a740-0b4551e81fac" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:41:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Acquired lock "refresh_cache-4d5c0324-68e8-4f0a-a740-0b4551e81fac" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:41:26 user nova-compute[72444]: DEBUG nova.network.neutron [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:41:26 user nova-compute[72444]: DEBUG nova.compute.manager [req-5638b5bd-c333-47cc-a997-c453879a9251 req-c7cf1506-c1d3-4869-b333-4246830733ec service nova] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Received event network-changed-d181dc6a-eec0-4611-9f3b-c8c43052c56c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:41:26 user nova-compute[72444]: DEBUG nova.compute.manager [req-5638b5bd-c333-47cc-a997-c453879a9251 req-c7cf1506-c1d3-4869-b333-4246830733ec service nova] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Refreshing instance network info cache due to event network-changed-d181dc6a-eec0-4611-9f3b-c8c43052c56c. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:41:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5638b5bd-c333-47cc-a997-c453879a9251 req-c7cf1506-c1d3-4869-b333-4246830733ec service nova] Acquiring lock "refresh_cache-4d5c0324-68e8-4f0a-a740-0b4551e81fac" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:41:26 user nova-compute[72444]: DEBUG nova.network.neutron [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:41:26 user nova-compute[72444]: DEBUG nova.network.neutron [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Successfully created port: 2b3c7303-d2c6-4bab-96ad-a43903c2c28d {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:41:26 user nova-compute[72444]: DEBUG nova.network.neutron [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Updating instance_info_cache with network_info: [{"id": "d181dc6a-eec0-4611-9f3b-c8c43052c56c", "address": "fa:16:3e:05:29:38", "network": {"id": "a7fd7a43-0569-4382-88b3-33e9c55ac8aa", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-134274412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fef3fddba949838bc580dd71a24f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd181dc6a-ee", "ovs_interfaceid": "d181dc6a-eec0-4611-9f3b-c8c43052c56c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Releasing lock "refresh_cache-4d5c0324-68e8-4f0a-a740-0b4551e81fac" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG nova.compute.manager [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Instance network_info: |[{"id": "d181dc6a-eec0-4611-9f3b-c8c43052c56c", "address": "fa:16:3e:05:29:38", "network": {"id": "a7fd7a43-0569-4382-88b3-33e9c55ac8aa", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-134274412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fef3fddba949838bc580dd71a24f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd181dc6a-ee", "ovs_interfaceid": "d181dc6a-eec0-4611-9f3b-c8c43052c56c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5638b5bd-c333-47cc-a997-c453879a9251 req-c7cf1506-c1d3-4869-b333-4246830733ec service nova] Acquired lock "refresh_cache-4d5c0324-68e8-4f0a-a740-0b4551e81fac" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG nova.network.neutron [req-5638b5bd-c333-47cc-a997-c453879a9251 req-c7cf1506-c1d3-4869-b333-4246830733ec service nova] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Refreshing network info cache for port d181dc6a-eec0-4611-9f3b-c8c43052c56c {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Start _get_guest_xml network_info=[{"id": "d181dc6a-eec0-4611-9f3b-c8c43052c56c", "address": "fa:16:3e:05:29:38", "network": {"id": "a7fd7a43-0569-4382-88b3-33e9c55ac8aa", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-134274412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fef3fddba949838bc580dd71a24f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd181dc6a-ee", "ovs_interfaceid": "d181dc6a-eec0-4611-9f3b-c8c43052c56c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:41:06Z,direct_url=<?>,disk_format='qcow2',id=e71f545b-f80d-47f1-8b23-7dd1afc643d8,min_disk=0,min_ram=0,name='',owner='3f3d176e3cbe462aa9f4e0019eb7958a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:41:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_name': '/dev/sda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'scsi', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': 'e71f545b-f80d-47f1-8b23-7dd1afc643d8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:41:27 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:41:27 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:41:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:41:06Z,direct_url=<?>,disk_format='qcow2',id=e71f545b-f80d-47f1-8b23-7dd1afc643d8,min_disk=0,min_ram=0,name='',owner='3f3d176e3cbe462aa9f4e0019eb7958a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:41:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:41:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2110780742',display_name='tempest-AttachSCSIVolumeTestJSON-server-2110780742',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2110780742',id=9,image_ref='e71f545b-f80d-47f1-8b23-7dd1afc643d8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfAYun0VPylzdvojSj/Ol6ebLeUZa6ue0FwjvfnfxdcoJKRj/G2t2j9Hzf8X0TRxqfU5Fd8RNYymYQjHKs1gknPbHxrEW8IKB2nIvtXCurJWFDJdY4NEs0+zkvEgUek9A==',key_name='tempest-keypair-256061458',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63fef3fddba949838bc580dd71a24f44',ramdisk_id='',reservation_id='r-pzwg52yu',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e71f545b-f80d-47f1-8b23-7dd1afc643d8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-636686183',owner_user_name='tempest-AttachSCSIVolumeTestJSON-636686183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:41:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d977491d031344f7b6c9438c99e434dd',uuid=4d5c0324-68e8-4f0a-a740-0b4551e81fac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d181dc6a-eec0-4611-9f3b-c8c43052c56c", "address": "fa:16:3e:05:29:38", "network": {"id": "a7fd7a43-0569-4382-88b3-33e9c55ac8aa", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-134274412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fef3fddba949838bc580dd71a24f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd181dc6a-ee", "ovs_interfaceid": "d181dc6a-eec0-4611-9f3b-c8c43052c56c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Converting VIF {"id": "d181dc6a-eec0-4611-9f3b-c8c43052c56c", "address": "fa:16:3e:05:29:38", "network": {"id": "a7fd7a43-0569-4382-88b3-33e9c55ac8aa", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-134274412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fef3fddba949838bc580dd71a24f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd181dc6a-ee", "ovs_interfaceid": "d181dc6a-eec0-4611-9f3b-c8c43052c56c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:29:38,bridge_name='br-int',has_traffic_filtering=True,id=d181dc6a-eec0-4611-9f3b-c8c43052c56c,network=Network(a7fd7a43-0569-4382-88b3-33e9c55ac8aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd181dc6a-ee') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG nova.objects.instance [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d5c0324-68e8-4f0a-a740-0b4551e81fac {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:41:27 user nova-compute[72444]:   <uuid>4d5c0324-68e8-4f0a-a740-0b4551e81fac</uuid>
Aug 03 04:41:27 user nova-compute[72444]:   <name>instance-00000009</name>
Aug 03 04:41:27 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:41:27 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:41:27 user nova-compute[72444]:   <metadata>
Aug 03 04:41:27 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:41:27 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:41:27 user nova-compute[72444]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-2110780742</nova:name>
Aug 03 04:41:27 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:41:27</nova:creationTime>
Aug 03 04:41:27 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:41:27 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:41:27 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:41:27 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:41:27 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:41:27 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:41:27 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:41:27 user nova-compute[72444]:       <nova:owner>
Aug 03 04:41:27 user nova-compute[72444]:         <nova:user uuid="d977491d031344f7b6c9438c99e434dd">tempest-AttachSCSIVolumeTestJSON-636686183-project-member</nova:user>
Aug 03 04:41:27 user nova-compute[72444]:         <nova:project uuid="63fef3fddba949838bc580dd71a24f44">tempest-AttachSCSIVolumeTestJSON-636686183</nova:project>
Aug 03 04:41:27 user nova-compute[72444]:       </nova:owner>
Aug 03 04:41:27 user nova-compute[72444]:       <nova:root type="image" uuid="e71f545b-f80d-47f1-8b23-7dd1afc643d8"/>
Aug 03 04:41:27 user nova-compute[72444]:       <nova:ports>
Aug 03 04:41:27 user nova-compute[72444]:         <nova:port uuid="d181dc6a-eec0-4611-9f3b-c8c43052c56c">
Aug 03 04:41:27 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 03 04:41:27 user nova-compute[72444]:         </nova:port>
Aug 03 04:41:27 user nova-compute[72444]:       </nova:ports>
Aug 03 04:41:27 user nova-compute[72444]:     </nova:instance>
Aug 03 04:41:27 user nova-compute[72444]:   </metadata>
Aug 03 04:41:27 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:41:27 user nova-compute[72444]:     <system>
Aug 03 04:41:27 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:41:27 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:41:27 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:41:27 user nova-compute[72444]:       <entry name="serial">4d5c0324-68e8-4f0a-a740-0b4551e81fac</entry>
Aug 03 04:41:27 user nova-compute[72444]:       <entry name="uuid">4d5c0324-68e8-4f0a-a740-0b4551e81fac</entry>
Aug 03 04:41:27 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:41:27 user nova-compute[72444]:     </system>
Aug 03 04:41:27 user nova-compute[72444]:   </sysinfo>
Aug 03 04:41:27 user nova-compute[72444]:   <os>
Aug 03 04:41:27 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:41:27 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:41:27 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:41:27 user nova-compute[72444]:   </os>
Aug 03 04:41:27 user nova-compute[72444]:   <features>
Aug 03 04:41:27 user nova-compute[72444]:     <acpi/>
Aug 03 04:41:27 user nova-compute[72444]:     <apic/>
Aug 03 04:41:27 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:41:27 user nova-compute[72444]:   </features>
Aug 03 04:41:27 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:41:27 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:41:27 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:41:27 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:41:27 user nova-compute[72444]:   </clock>
Aug 03 04:41:27 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:41:27 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:41:27 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:41:27 user nova-compute[72444]:   </cpu>
Aug 03 04:41:27 user nova-compute[72444]:   <devices>
Aug 03 04:41:27 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:41:27 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:41:27 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/4d5c0324-68e8-4f0a-a740-0b4551e81fac/disk"/>
Aug 03 04:41:27 user nova-compute[72444]:       <target dev="sda" bus="scsi"/>
Aug 03 04:41:27 user nova-compute[72444]:       <address type="drive" controller="0" unit="0"/>
Aug 03 04:41:27 user nova-compute[72444]:     </disk>
Aug 03 04:41:27 user nova-compute[72444]:     <disk type="file" device="cdrom">
Aug 03 04:41:27 user nova-compute[72444]:       <driver name="qemu" type="raw" cache="none"/>
Aug 03 04:41:27 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/4d5c0324-68e8-4f0a-a740-0b4551e81fac/disk.config"/>
Aug 03 04:41:27 user nova-compute[72444]:       <target dev="sdb" bus="scsi"/>
Aug 03 04:41:27 user nova-compute[72444]:       <address type="drive" controller="0" unit="1"/>
Aug 03 04:41:27 user nova-compute[72444]:     </disk>
Aug 03 04:41:27 user nova-compute[72444]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 03 04:41:27 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:41:27 user nova-compute[72444]:       <mac address="fa:16:3e:05:29:38"/>
Aug 03 04:41:27 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:41:27 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:41:27 user nova-compute[72444]:       <target dev="tapd181dc6a-ee"/>
Aug 03 04:41:27 user nova-compute[72444]:     </interface>
Aug 03 04:41:27 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:41:27 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/4d5c0324-68e8-4f0a-a740-0b4551e81fac/console.log" append="off"/>
Aug 03 04:41:27 user nova-compute[72444]:     </serial>
Aug 03 04:41:27 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:41:27 user nova-compute[72444]:     <video>
Aug 03 04:41:27 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:41:27 user nova-compute[72444]:     </video>
Aug 03 04:41:27 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:41:27 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:41:27 user nova-compute[72444]:     </rng>
Aug 03 04:41:27 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:41:27 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:41:27 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:41:27 user nova-compute[72444]:     </memballoon>
Aug 03 04:41:27 user nova-compute[72444]:   </devices>
Aug 03 04:41:27 user nova-compute[72444]: </domain>
Aug 03 04:41:27 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:41:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2110780742',display_name='tempest-AttachSCSIVolumeTestJSON-server-2110780742',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2110780742',id=9,image_ref='e71f545b-f80d-47f1-8b23-7dd1afc643d8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfAYun0VPylzdvojSj/Ol6ebLeUZa6ue0FwjvfnfxdcoJKRj/G2t2j9Hzf8X0TRxqfU5Fd8RNYymYQjHKs1gknPbHxrEW8IKB2nIvtXCurJWFDJdY4NEs0+zkvEgUek9A==',key_name='tempest-keypair-256061458',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63fef3fddba949838bc580dd71a24f44',ramdisk_id='',reservation_id='r-pzwg52yu',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e71f545b-f80d-47f1-8b23-7dd1afc643d8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-636686183',owner_user_name='tempest-AttachSCSIVolumeTestJSON-636686183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:41:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d977491d031344f7b6c9438c99e434dd',uuid=4d5c0324-68e8-4f0a-a740-0b4551e81fac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d181dc6a-eec0-4611-9f3b-c8c43052c56c", "address": "fa:16:3e:05:29:38", "network": {"id": "a7fd7a43-0569-4382-88b3-33e9c55ac8aa", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-134274412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fef3fddba949838bc580dd71a24f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd181dc6a-ee", "ovs_interfaceid": "d181dc6a-eec0-4611-9f3b-c8c43052c56c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Converting VIF {"id": "d181dc6a-eec0-4611-9f3b-c8c43052c56c", "address": "fa:16:3e:05:29:38", "network": {"id": "a7fd7a43-0569-4382-88b3-33e9c55ac8aa", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-134274412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fef3fddba949838bc580dd71a24f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd181dc6a-ee", "ovs_interfaceid": "d181dc6a-eec0-4611-9f3b-c8c43052c56c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:29:38,bridge_name='br-int',has_traffic_filtering=True,id=d181dc6a-eec0-4611-9f3b-c8c43052c56c,network=Network(a7fd7a43-0569-4382-88b3-33e9c55ac8aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd181dc6a-ee') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG os_vif [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:29:38,bridge_name='br-int',has_traffic_filtering=True,id=d181dc6a-eec0-4611-9f3b-c8c43052c56c,network=Network(a7fd7a43-0569-4382-88b3-33e9c55ac8aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd181dc6a-ee') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd181dc6a-ee, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd181dc6a-ee, col_values=(('external_ids', {'iface-id': 'd181dc6a-eec0-4611-9f3b-c8c43052c56c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:29:38', 'vm-uuid': '4d5c0324-68e8-4f0a-a740-0b4551e81fac'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:27 user nova-compute[72444]: INFO os_vif [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:29:38,bridge_name='br-int',has_traffic_filtering=True,id=d181dc6a-eec0-4611-9f3b-c8c43052c56c,network=Network(a7fd7a43-0569-4382-88b3-33e9c55ac8aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd181dc6a-ee')
Aug 03 04:41:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] No BDM found with device name sda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] No VIF found with MAC fa:16:3e:05:29:38, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:41:27 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Using config drive
Aug 03 04:41:27 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Creating config drive at /opt/stack/data/nova/instances/4d5c0324-68e8-4f0a-a740-0b4551e81fac/disk.config
Aug 03 04:41:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4d5c0324-68e8-4f0a-a740-0b4551e81fac/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp5m_kzwx7 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4d5c0324-68e8-4f0a-a740-0b4551e81fac/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp5m_kzwx7" returned: 0 in 0.057s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG nova.network.neutron [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Successfully updated port: 2b3c7303-d2c6-4bab-96ad-a43903c2c28d {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Acquiring lock "refresh_cache-42f131f8-83ac-4fd4-b056-f8dac3d32c55" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Acquired lock "refresh_cache-42f131f8-83ac-4fd4-b056-f8dac3d32c55" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:41:27 user nova-compute[72444]: DEBUG nova.network.neutron [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG nova.compute.manager [req-5ddd6ee4-0679-4d75-9d63-1054efc43e1e req-47dd2943-f214-4746-a8eb-3eff00da4359 service nova] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Received event network-changed-2b3c7303-d2c6-4bab-96ad-a43903c2c28d {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG nova.compute.manager [req-5ddd6ee4-0679-4d75-9d63-1054efc43e1e req-47dd2943-f214-4746-a8eb-3eff00da4359 service nova] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Refreshing instance network info cache due to event network-changed-2b3c7303-d2c6-4bab-96ad-a43903c2c28d. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5ddd6ee4-0679-4d75-9d63-1054efc43e1e req-47dd2943-f214-4746-a8eb-3eff00da4359 service nova] Acquiring lock "refresh_cache-42f131f8-83ac-4fd4-b056-f8dac3d32c55" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG nova.network.neutron [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG nova.network.neutron [req-5638b5bd-c333-47cc-a997-c453879a9251 req-c7cf1506-c1d3-4869-b333-4246830733ec service nova] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Updated VIF entry in instance network info cache for port d181dc6a-eec0-4611-9f3b-c8c43052c56c. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG nova.network.neutron [req-5638b5bd-c333-47cc-a997-c453879a9251 req-c7cf1506-c1d3-4869-b333-4246830733ec service nova] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Updating instance_info_cache with network_info: [{"id": "d181dc6a-eec0-4611-9f3b-c8c43052c56c", "address": "fa:16:3e:05:29:38", "network": {"id": "a7fd7a43-0569-4382-88b3-33e9c55ac8aa", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-134274412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fef3fddba949838bc580dd71a24f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd181dc6a-ee", "ovs_interfaceid": "d181dc6a-eec0-4611-9f3b-c8c43052c56c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5638b5bd-c333-47cc-a997-c453879a9251 req-c7cf1506-c1d3-4869-b333-4246830733ec service nova] Releasing lock "refresh_cache-4d5c0324-68e8-4f0a-a740-0b4551e81fac" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG nova.network.neutron [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Updating instance_info_cache with network_info: [{"id": "2b3c7303-d2c6-4bab-96ad-a43903c2c28d", "address": "fa:16:3e:72:9e:bf", "network": {"id": "0b4f64f0-db21-4355-ba1c-32275f0d8b34", "bridge": "br-int", "label": "tempest-TestVolumeSwap-815026343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5432e4ac5443489a923966c0c85ef140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3c7303-d2", "ovs_interfaceid": "2b3c7303-d2c6-4bab-96ad-a43903c2c28d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Releasing lock "refresh_cache-42f131f8-83ac-4fd4-b056-f8dac3d32c55" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG nova.compute.manager [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Instance network_info: |[{"id": "2b3c7303-d2c6-4bab-96ad-a43903c2c28d", "address": "fa:16:3e:72:9e:bf", "network": {"id": "0b4f64f0-db21-4355-ba1c-32275f0d8b34", "bridge": "br-int", "label": "tempest-TestVolumeSwap-815026343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5432e4ac5443489a923966c0c85ef140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3c7303-d2", "ovs_interfaceid": "2b3c7303-d2c6-4bab-96ad-a43903c2c28d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5ddd6ee4-0679-4d75-9d63-1054efc43e1e req-47dd2943-f214-4746-a8eb-3eff00da4359 service nova] Acquired lock "refresh_cache-42f131f8-83ac-4fd4-b056-f8dac3d32c55" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG nova.network.neutron [req-5ddd6ee4-0679-4d75-9d63-1054efc43e1e req-47dd2943-f214-4746-a8eb-3eff00da4359 service nova] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Refreshing network info cache for port 2b3c7303-d2c6-4bab-96ad-a43903c2c28d {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Start _get_guest_xml network_info=[{"id": "2b3c7303-d2c6-4bab-96ad-a43903c2c28d", "address": "fa:16:3e:72:9e:bf", "network": {"id": "0b4f64f0-db21-4355-ba1c-32275f0d8b34", "bridge": "br-int", "label": "tempest-TestVolumeSwap-815026343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5432e4ac5443489a923966c0c85ef140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3c7303-d2", "ovs_interfaceid": "2b3c7303-d2c6-4bab-96ad-a43903c2c28d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:41:28 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:41:28 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:41:28 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-929066832',display_name='tempest-TestVolumeSwap-server-929066832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-929066832',id=10,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7z6imjkIlWYfGq7p19wtDVMvC2U8evNKNgz62Mnc3jca8/p8hAkswDV/XSPWqB8py8JC4iZmd/PIBCINsekLfJKeuZCftJa99vNkZU3MTbxsd5XyhWwbCZuNqH4no9Hg==',key_name='tempest-keypair-75219721',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5432e4ac5443489a923966c0c85ef140',ramdisk_id='',reservation_id='r-7x0kr6u2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1765317655',owner_user_name='tempest-TestVolumeSwap-1765317655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:41:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bb66f8aaf9d4274890e912fa56778be',uuid=42f131f8-83ac-4fd4-b056-f8dac3d32c55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b3c7303-d2c6-4bab-96ad-a43903c2c28d", "address": "fa:16:3e:72:9e:bf", "network": {"id": "0b4f64f0-db21-4355-ba1c-32275f0d8b34", "bridge": "br-int", "label": "tempest-TestVolumeSwap-815026343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5432e4ac5443489a923966c0c85ef140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3c7303-d2", "ovs_interfaceid": "2b3c7303-d2c6-4bab-96ad-a43903c2c28d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Converting VIF {"id": "2b3c7303-d2c6-4bab-96ad-a43903c2c28d", "address": "fa:16:3e:72:9e:bf", "network": {"id": "0b4f64f0-db21-4355-ba1c-32275f0d8b34", "bridge": "br-int", "label": "tempest-TestVolumeSwap-815026343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5432e4ac5443489a923966c0c85ef140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3c7303-d2", "ovs_interfaceid": "2b3c7303-d2c6-4bab-96ad-a43903c2c28d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:9e:bf,bridge_name='br-int',has_traffic_filtering=True,id=2b3c7303-d2c6-4bab-96ad-a43903c2c28d,network=Network(0b4f64f0-db21-4355-ba1c-32275f0d8b34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b3c7303-d2') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG nova.objects.instance [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Lazy-loading 'pci_devices' on Instance uuid 42f131f8-83ac-4fd4-b056-f8dac3d32c55 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:41:28 user nova-compute[72444]:   <uuid>42f131f8-83ac-4fd4-b056-f8dac3d32c55</uuid>
Aug 03 04:41:28 user nova-compute[72444]:   <name>instance-0000000a</name>
Aug 03 04:41:28 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:41:28 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:41:28 user nova-compute[72444]:   <metadata>
Aug 03 04:41:28 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:41:28 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:41:28 user nova-compute[72444]:       <nova:name>tempest-TestVolumeSwap-server-929066832</nova:name>
Aug 03 04:41:28 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:41:28</nova:creationTime>
Aug 03 04:41:28 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:41:28 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:41:28 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:41:28 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:41:28 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:41:28 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:41:28 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:41:28 user nova-compute[72444]:       <nova:owner>
Aug 03 04:41:28 user nova-compute[72444]:         <nova:user uuid="4bb66f8aaf9d4274890e912fa56778be">tempest-TestVolumeSwap-1765317655-project-member</nova:user>
Aug 03 04:41:28 user nova-compute[72444]:         <nova:project uuid="5432e4ac5443489a923966c0c85ef140">tempest-TestVolumeSwap-1765317655</nova:project>
Aug 03 04:41:28 user nova-compute[72444]:       </nova:owner>
Aug 03 04:41:28 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:41:28 user nova-compute[72444]:       <nova:ports>
Aug 03 04:41:28 user nova-compute[72444]:         <nova:port uuid="2b3c7303-d2c6-4bab-96ad-a43903c2c28d">
Aug 03 04:41:28 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 03 04:41:28 user nova-compute[72444]:         </nova:port>
Aug 03 04:41:28 user nova-compute[72444]:       </nova:ports>
Aug 03 04:41:28 user nova-compute[72444]:     </nova:instance>
Aug 03 04:41:28 user nova-compute[72444]:   </metadata>
Aug 03 04:41:28 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:41:28 user nova-compute[72444]:     <system>
Aug 03 04:41:28 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:41:28 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:41:28 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:41:28 user nova-compute[72444]:       <entry name="serial">42f131f8-83ac-4fd4-b056-f8dac3d32c55</entry>
Aug 03 04:41:28 user nova-compute[72444]:       <entry name="uuid">42f131f8-83ac-4fd4-b056-f8dac3d32c55</entry>
Aug 03 04:41:28 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:41:28 user nova-compute[72444]:     </system>
Aug 03 04:41:28 user nova-compute[72444]:   </sysinfo>
Aug 03 04:41:28 user nova-compute[72444]:   <os>
Aug 03 04:41:28 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:41:28 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:41:28 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:41:28 user nova-compute[72444]:   </os>
Aug 03 04:41:28 user nova-compute[72444]:   <features>
Aug 03 04:41:28 user nova-compute[72444]:     <acpi/>
Aug 03 04:41:28 user nova-compute[72444]:     <apic/>
Aug 03 04:41:28 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:41:28 user nova-compute[72444]:   </features>
Aug 03 04:41:28 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:41:28 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:41:28 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:41:28 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:41:28 user nova-compute[72444]:   </clock>
Aug 03 04:41:28 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:41:28 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:41:28 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:41:28 user nova-compute[72444]:   </cpu>
Aug 03 04:41:28 user nova-compute[72444]:   <devices>
Aug 03 04:41:28 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:41:28 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:41:28 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/42f131f8-83ac-4fd4-b056-f8dac3d32c55/disk"/>
Aug 03 04:41:28 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:41:28 user nova-compute[72444]:     </disk>
Aug 03 04:41:28 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:41:28 user nova-compute[72444]:       <mac address="fa:16:3e:72:9e:bf"/>
Aug 03 04:41:28 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:41:28 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:41:28 user nova-compute[72444]:       <target dev="tap2b3c7303-d2"/>
Aug 03 04:41:28 user nova-compute[72444]:     </interface>
Aug 03 04:41:28 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:41:28 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/42f131f8-83ac-4fd4-b056-f8dac3d32c55/console.log" append="off"/>
Aug 03 04:41:28 user nova-compute[72444]:     </serial>
Aug 03 04:41:28 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:41:28 user nova-compute[72444]:     <video>
Aug 03 04:41:28 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:41:28 user nova-compute[72444]:     </video>
Aug 03 04:41:28 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:41:28 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:41:28 user nova-compute[72444]:     </rng>
Aug 03 04:41:28 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:41:28 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:41:28 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:41:28 user nova-compute[72444]:     </memballoon>
Aug 03 04:41:28 user nova-compute[72444]:   </devices>
Aug 03 04:41:28 user nova-compute[72444]: </domain>
Aug 03 04:41:28 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-929066832',display_name='tempest-TestVolumeSwap-server-929066832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-929066832',id=10,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7z6imjkIlWYfGq7p19wtDVMvC2U8evNKNgz62Mnc3jca8/p8hAkswDV/XSPWqB8py8JC4iZmd/PIBCINsekLfJKeuZCftJa99vNkZU3MTbxsd5XyhWwbCZuNqH4no9Hg==',key_name='tempest-keypair-75219721',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5432e4ac5443489a923966c0c85ef140',ramdisk_id='',reservation_id='r-7x0kr6u2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1765317655',owner_user_name='tempest-TestVolumeSwap-1765317655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:41:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bb66f8aaf9d4274890e912fa56778be',uuid=42f131f8-83ac-4fd4-b056-f8dac3d32c55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b3c7303-d2c6-4bab-96ad-a43903c2c28d", "address": "fa:16:3e:72:9e:bf", "network": {"id": "0b4f64f0-db21-4355-ba1c-32275f0d8b34", "bridge": "br-int", "label": "tempest-TestVolumeSwap-815026343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5432e4ac5443489a923966c0c85ef140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3c7303-d2", "ovs_interfaceid": "2b3c7303-d2c6-4bab-96ad-a43903c2c28d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Converting VIF {"id": "2b3c7303-d2c6-4bab-96ad-a43903c2c28d", "address": "fa:16:3e:72:9e:bf", "network": {"id": "0b4f64f0-db21-4355-ba1c-32275f0d8b34", "bridge": "br-int", "label": "tempest-TestVolumeSwap-815026343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5432e4ac5443489a923966c0c85ef140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3c7303-d2", "ovs_interfaceid": "2b3c7303-d2c6-4bab-96ad-a43903c2c28d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:9e:bf,bridge_name='br-int',has_traffic_filtering=True,id=2b3c7303-d2c6-4bab-96ad-a43903c2c28d,network=Network(0b4f64f0-db21-4355-ba1c-32275f0d8b34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b3c7303-d2') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG os_vif [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:9e:bf,bridge_name='br-int',has_traffic_filtering=True,id=2b3c7303-d2c6-4bab-96ad-a43903c2c28d,network=Network(0b4f64f0-db21-4355-ba1c-32275f0d8b34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b3c7303-d2') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b3c7303-d2, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2b3c7303-d2, col_values=(('external_ids', {'iface-id': '2b3c7303-d2c6-4bab-96ad-a43903c2c28d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:9e:bf', 'vm-uuid': '42f131f8-83ac-4fd4-b056-f8dac3d32c55'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:28 user nova-compute[72444]: INFO os_vif [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:9e:bf,bridge_name='br-int',has_traffic_filtering=True,id=2b3c7303-d2c6-4bab-96ad-a43903c2c28d,network=Network(0b4f64f0-db21-4355-ba1c-32275f0d8b34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b3c7303-d2')
Aug 03 04:41:28 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:41:28 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] No VIF found with MAC fa:16:3e:72:9e:bf, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:41:29 user nova-compute[72444]: DEBUG nova.network.neutron [req-5ddd6ee4-0679-4d75-9d63-1054efc43e1e req-47dd2943-f214-4746-a8eb-3eff00da4359 service nova] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Updated VIF entry in instance network info cache for port 2b3c7303-d2c6-4bab-96ad-a43903c2c28d. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:41:29 user nova-compute[72444]: DEBUG nova.network.neutron [req-5ddd6ee4-0679-4d75-9d63-1054efc43e1e req-47dd2943-f214-4746-a8eb-3eff00da4359 service nova] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Updating instance_info_cache with network_info: [{"id": "2b3c7303-d2c6-4bab-96ad-a43903c2c28d", "address": "fa:16:3e:72:9e:bf", "network": {"id": "0b4f64f0-db21-4355-ba1c-32275f0d8b34", "bridge": "br-int", "label": "tempest-TestVolumeSwap-815026343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5432e4ac5443489a923966c0c85ef140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3c7303-d2", "ovs_interfaceid": "2b3c7303-d2c6-4bab-96ad-a43903c2c28d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:41:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5ddd6ee4-0679-4d75-9d63-1054efc43e1e req-47dd2943-f214-4746-a8eb-3eff00da4359 service nova] Releasing lock "refresh_cache-42f131f8-83ac-4fd4-b056-f8dac3d32c55" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:41:29 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:29 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:29 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:29 user nova-compute[72444]: DEBUG nova.compute.manager [req-24305a07-9cf6-4d18-a0ff-ab4fdebcae28 req-82339bfe-5c26-424a-9176-6c9b4fd590c0 service nova] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Received event network-vif-plugged-d181dc6a-eec0-4611-9f3b-c8c43052c56c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:41:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-24305a07-9cf6-4d18-a0ff-ab4fdebcae28 req-82339bfe-5c26-424a-9176-6c9b4fd590c0 service nova] Acquiring lock "4d5c0324-68e8-4f0a-a740-0b4551e81fac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-24305a07-9cf6-4d18-a0ff-ab4fdebcae28 req-82339bfe-5c26-424a-9176-6c9b4fd590c0 service nova] Lock "4d5c0324-68e8-4f0a-a740-0b4551e81fac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-24305a07-9cf6-4d18-a0ff-ab4fdebcae28 req-82339bfe-5c26-424a-9176-6c9b4fd590c0 service nova] Lock "4d5c0324-68e8-4f0a-a740-0b4551e81fac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:29 user nova-compute[72444]: DEBUG nova.compute.manager [req-24305a07-9cf6-4d18-a0ff-ab4fdebcae28 req-82339bfe-5c26-424a-9176-6c9b4fd590c0 service nova] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] No waiting events found dispatching network-vif-plugged-d181dc6a-eec0-4611-9f3b-c8c43052c56c {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:41:29 user nova-compute[72444]: WARNING nova.compute.manager [req-24305a07-9cf6-4d18-a0ff-ab4fdebcae28 req-82339bfe-5c26-424a-9176-6c9b4fd590c0 service nova] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Received unexpected event network-vif-plugged-d181dc6a-eec0-4611-9f3b-c8c43052c56c for instance with vm_state building and task_state spawning.
Aug 03 04:41:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Acquiring lock "ba81117e-fef4-4b0d-89ba-ba16aaeaf124" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Lock "ba81117e-fef4-4b0d-89ba-ba16aaeaf124" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:30 user nova-compute[72444]: DEBUG nova.compute.manager [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 04:41:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:31 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 04:41:31 user nova-compute[72444]: INFO nova.compute.claims [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Claim successful on node user
Aug 03 04:41:31 user nova-compute[72444]: DEBUG nova.compute.manager [req-771d8278-93a1-4cd6-a4db-cab18e55e562 req-56581f7c-caa8-482d-8449-5fad7234d890 service nova] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Received event network-vif-plugged-2b3c7303-d2c6-4bab-96ad-a43903c2c28d {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:41:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-771d8278-93a1-4cd6-a4db-cab18e55e562 req-56581f7c-caa8-482d-8449-5fad7234d890 service nova] Acquiring lock "42f131f8-83ac-4fd4-b056-f8dac3d32c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-771d8278-93a1-4cd6-a4db-cab18e55e562 req-56581f7c-caa8-482d-8449-5fad7234d890 service nova] Lock "42f131f8-83ac-4fd4-b056-f8dac3d32c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-771d8278-93a1-4cd6-a4db-cab18e55e562 req-56581f7c-caa8-482d-8449-5fad7234d890 service nova] Lock "42f131f8-83ac-4fd4-b056-f8dac3d32c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:31 user nova-compute[72444]: DEBUG nova.compute.manager [req-771d8278-93a1-4cd6-a4db-cab18e55e562 req-56581f7c-caa8-482d-8449-5fad7234d890 service nova] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] No waiting events found dispatching network-vif-plugged-2b3c7303-d2c6-4bab-96ad-a43903c2c28d {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:41:31 user nova-compute[72444]: WARNING nova.compute.manager [req-771d8278-93a1-4cd6-a4db-cab18e55e562 req-56581f7c-caa8-482d-8449-5fad7234d890 service nova] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Received unexpected event network-vif-plugged-2b3c7303-d2c6-4bab-96ad-a43903c2c28d for instance with vm_state building and task_state spawning.
Aug 03 04:41:31 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:41:31 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:41:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.798s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:31 user nova-compute[72444]: DEBUG nova.compute.manager [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 04:41:31 user nova-compute[72444]: DEBUG nova.compute.manager [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 04:41:31 user nova-compute[72444]: DEBUG nova.network.neutron [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 04:41:31 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 04:41:31 user nova-compute[72444]: DEBUG nova.compute.manager [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 04:41:31 user nova-compute[72444]: DEBUG nova.compute.manager [req-0902cf26-ac56-4c09-8a59-b89c7844fab9 req-48b9f387-7f84-402f-a89c-17976286b174 service nova] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Received event network-vif-plugged-d181dc6a-eec0-4611-9f3b-c8c43052c56c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:41:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0902cf26-ac56-4c09-8a59-b89c7844fab9 req-48b9f387-7f84-402f-a89c-17976286b174 service nova] Acquiring lock "4d5c0324-68e8-4f0a-a740-0b4551e81fac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0902cf26-ac56-4c09-8a59-b89c7844fab9 req-48b9f387-7f84-402f-a89c-17976286b174 service nova] Lock "4d5c0324-68e8-4f0a-a740-0b4551e81fac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0902cf26-ac56-4c09-8a59-b89c7844fab9 req-48b9f387-7f84-402f-a89c-17976286b174 service nova] Lock "4d5c0324-68e8-4f0a-a740-0b4551e81fac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.015s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:31 user nova-compute[72444]: DEBUG nova.compute.manager [req-0902cf26-ac56-4c09-8a59-b89c7844fab9 req-48b9f387-7f84-402f-a89c-17976286b174 service nova] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] No waiting events found dispatching network-vif-plugged-d181dc6a-eec0-4611-9f3b-c8c43052c56c {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:41:31 user nova-compute[72444]: WARNING nova.compute.manager [req-0902cf26-ac56-4c09-8a59-b89c7844fab9 req-48b9f387-7f84-402f-a89c-17976286b174 service nova] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Received unexpected event network-vif-plugged-d181dc6a-eec0-4611-9f3b-c8c43052c56c for instance with vm_state building and task_state spawning.
Aug 03 04:41:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:32 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:32 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:32 user nova-compute[72444]: DEBUG nova.policy [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f0c63f7ac0ce4389a1c66d104cc1eb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5329f0bac5b64d07afaba5a42c12b537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 04:41:32 user nova-compute[72444]: DEBUG nova.compute.manager [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 04:41:32 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 04:41:32 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Creating image(s)
Aug 03 04:41:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Acquiring lock "/opt/stack/data/nova/instances/ba81117e-fef4-4b0d-89ba-ba16aaeaf124/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Lock "/opt/stack/data/nova/instances/ba81117e-fef4-4b0d-89ba-ba16aaeaf124/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Lock "/opt/stack/data/nova/instances/ba81117e-fef4-4b0d-89ba-ba16aaeaf124/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.284s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.168s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/ba81117e-fef4-4b0d-89ba-ba16aaeaf124/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/ba81117e-fef4-4b0d-89ba-ba16aaeaf124/disk 1073741824" returned: 0 in 0.077s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:32 user nova-compute[72444]: DEBUG nova.network.neutron [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Successfully created port: fec9c34d-38ef-46e3-ad2d-47ec3e0895e1 {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:41:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.211s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:32 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ba81117e-fef4-4b0d-89ba-ba16aaeaf124/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 04:41:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba81117e-fef4-4b0d-89ba-ba16aaeaf124/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba81117e-fef4-4b0d-89ba-ba16aaeaf124/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:33 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Cannot resize image /opt/stack/data/nova/instances/ba81117e-fef4-4b0d-89ba-ba16aaeaf124/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 04:41:33 user nova-compute[72444]: DEBUG nova.objects.instance [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Lazy-loading 'migration_context' on Instance uuid ba81117e-fef4-4b0d-89ba-ba16aaeaf124 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:41:33 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 04:41:33 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Ensure instance console log exists: /opt/stack/data/nova/instances/ba81117e-fef4-4b0d-89ba-ba16aaeaf124/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 04:41:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:33 user nova-compute[72444]: DEBUG nova.compute.manager [req-ec3736a3-b995-41c8-925b-8ccfacfbac42 req-bcf0acdd-211e-4d7b-8975-bae33dfa3c97 service nova] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Received event network-vif-plugged-2b3c7303-d2c6-4bab-96ad-a43903c2c28d {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:41:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ec3736a3-b995-41c8-925b-8ccfacfbac42 req-bcf0acdd-211e-4d7b-8975-bae33dfa3c97 service nova] Acquiring lock "42f131f8-83ac-4fd4-b056-f8dac3d32c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ec3736a3-b995-41c8-925b-8ccfacfbac42 req-bcf0acdd-211e-4d7b-8975-bae33dfa3c97 service nova] Lock "42f131f8-83ac-4fd4-b056-f8dac3d32c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ec3736a3-b995-41c8-925b-8ccfacfbac42 req-bcf0acdd-211e-4d7b-8975-bae33dfa3c97 service nova] Lock "42f131f8-83ac-4fd4-b056-f8dac3d32c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.022s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:33 user nova-compute[72444]: DEBUG nova.compute.manager [req-ec3736a3-b995-41c8-925b-8ccfacfbac42 req-bcf0acdd-211e-4d7b-8975-bae33dfa3c97 service nova] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] No waiting events found dispatching network-vif-plugged-2b3c7303-d2c6-4bab-96ad-a43903c2c28d {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:41:33 user nova-compute[72444]: WARNING nova.compute.manager [req-ec3736a3-b995-41c8-925b-8ccfacfbac42 req-bcf0acdd-211e-4d7b-8975-bae33dfa3c97 service nova] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Received unexpected event network-vif-plugged-2b3c7303-d2c6-4bab-96ad-a43903c2c28d for instance with vm_state building and task_state spawning.
Aug 03 04:41:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:33 user nova-compute[72444]: DEBUG nova.network.neutron [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Successfully updated port: fec9c34d-38ef-46e3-ad2d-47ec3e0895e1 {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:41:33 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037693.7350032, 42f131f8-83ac-4fd4-b056-f8dac3d32c55 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:41:33 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] VM Resumed (Lifecycle Event)
Aug 03 04:41:33 user nova-compute[72444]: DEBUG nova.compute.manager [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:41:33 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 04:41:33 user nova-compute[72444]: DEBUG nova.compute.manager [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:41:33 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 04:41:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Acquiring lock "refresh_cache-ba81117e-fef4-4b0d-89ba-ba16aaeaf124" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:41:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Acquired lock "refresh_cache-ba81117e-fef4-4b0d-89ba-ba16aaeaf124" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:41:33 user nova-compute[72444]: DEBUG nova.network.neutron [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:41:33 user nova-compute[72444]: DEBUG nova.compute.manager [req-f4eb0bd1-ade2-4929-a37a-b9997fc3047c req-f08809e5-f7eb-44ea-8e00-53bda3a50147 service nova] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Received event network-changed-fec9c34d-38ef-46e3-ad2d-47ec3e0895e1 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:41:33 user nova-compute[72444]: DEBUG nova.compute.manager [req-f4eb0bd1-ade2-4929-a37a-b9997fc3047c req-f08809e5-f7eb-44ea-8e00-53bda3a50147 service nova] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Refreshing instance network info cache due to event network-changed-fec9c34d-38ef-46e3-ad2d-47ec3e0895e1. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:41:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f4eb0bd1-ade2-4929-a37a-b9997fc3047c req-f08809e5-f7eb-44ea-8e00-53bda3a50147 service nova] Acquiring lock "refresh_cache-ba81117e-fef4-4b0d-89ba-ba16aaeaf124" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:41:33 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Instance spawned successfully.
Aug 03 04:41:33 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:41:33 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Cleaning up deleted instances {{(pid=72444) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 03 04:41:33 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 04:41:33 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:41:33 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Instance spawned successfully.
Aug 03 04:41:33 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 04:41:33 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] There are 0 instances to clean {{(pid=72444) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 03 04:41:33 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:41:33 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72444) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.network.neutron [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:41:34 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037693.7351878, 42f131f8-83ac-4fd4-b056-f8dac3d32c55 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:41:34 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] VM Started (Lifecycle Event)
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:41:34 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037693.7571847, 4d5c0324-68e8-4f0a-a740-0b4551e81fac => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:41:34 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] VM Resumed (Lifecycle Event)
Aug 03 04:41:34 user nova-compute[72444]: INFO nova.compute.manager [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Took 14.99 seconds to spawn the instance on the hypervisor.
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.compute.manager [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:41:34 user nova-compute[72444]: INFO nova.compute.manager [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Took 9.09 seconds to spawn the instance on the hypervisor.
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.compute.manager [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:41:34 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037693.7628393, 4d5c0324-68e8-4f0a-a740-0b4551e81fac => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:41:34 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] VM Started (Lifecycle Event)
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:41:34 user nova-compute[72444]: INFO nova.compute.manager [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Took 10.55 seconds to build instance.
Aug 03 04:41:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-45029416-ca76-4469-9bfe-522f1c7298cb tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Lock "42f131f8-83ac-4fd4-b056-f8dac3d32c55" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.801s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:34 user nova-compute[72444]: INFO nova.compute.manager [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Took 16.96 seconds to build instance.
Aug 03 04:41:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4b8ad814-f69f-4d4c-a8fd-bc75af24382a tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Lock "4d5c0324-68e8-4f0a-a740-0b4551e81fac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.439s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.network.neutron [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Updating instance_info_cache with network_info: [{"id": "fec9c34d-38ef-46e3-ad2d-47ec3e0895e1", "address": "fa:16:3e:3c:ac:bc", "network": {"id": "944e9ac7-5ec1-4834-894d-7c1dcc63277f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2126179557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5329f0bac5b64d07afaba5a42c12b537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec9c34d-38", "ovs_interfaceid": "fec9c34d-38ef-46e3-ad2d-47ec3e0895e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Releasing lock "refresh_cache-ba81117e-fef4-4b0d-89ba-ba16aaeaf124" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.compute.manager [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Instance network_info: |[{"id": "fec9c34d-38ef-46e3-ad2d-47ec3e0895e1", "address": "fa:16:3e:3c:ac:bc", "network": {"id": "944e9ac7-5ec1-4834-894d-7c1dcc63277f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2126179557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5329f0bac5b64d07afaba5a42c12b537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec9c34d-38", "ovs_interfaceid": "fec9c34d-38ef-46e3-ad2d-47ec3e0895e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f4eb0bd1-ade2-4929-a37a-b9997fc3047c req-f08809e5-f7eb-44ea-8e00-53bda3a50147 service nova] Acquired lock "refresh_cache-ba81117e-fef4-4b0d-89ba-ba16aaeaf124" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.network.neutron [req-f4eb0bd1-ade2-4929-a37a-b9997fc3047c req-f08809e5-f7eb-44ea-8e00-53bda3a50147 service nova] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Refreshing network info cache for port fec9c34d-38ef-46e3-ad2d-47ec3e0895e1 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Start _get_guest_xml network_info=[{"id": "fec9c34d-38ef-46e3-ad2d-47ec3e0895e1", "address": "fa:16:3e:3c:ac:bc", "network": {"id": "944e9ac7-5ec1-4834-894d-7c1dcc63277f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2126179557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5329f0bac5b64d07afaba5a42c12b537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec9c34d-38", "ovs_interfaceid": "fec9c34d-38ef-46e3-ad2d-47ec3e0895e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:41:34 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:41:34 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:41:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-739885277',display_name='tempest-VolumesActionsTest-instance-739885277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-739885277',id=11,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5329f0bac5b64d07afaba5a42c12b537',ramdisk_id='',reservation_id='r-jf05yl94',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1012112512',owner_user_name='tempest-VolumesActionsTest-1012112512-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:41:32Z,user_data=None,user_id='f0c63f7ac0ce4389a1c66d104cc1eb67',uuid=ba81117e-fef4-4b0d-89ba-ba16aaeaf124,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fec9c34d-38ef-46e3-ad2d-47ec3e0895e1", "address": "fa:16:3e:3c:ac:bc", "network": {"id": "944e9ac7-5ec1-4834-894d-7c1dcc63277f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2126179557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5329f0bac5b64d07afaba5a42c12b537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec9c34d-38", "ovs_interfaceid": "fec9c34d-38ef-46e3-ad2d-47ec3e0895e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Converting VIF {"id": "fec9c34d-38ef-46e3-ad2d-47ec3e0895e1", "address": "fa:16:3e:3c:ac:bc", "network": {"id": "944e9ac7-5ec1-4834-894d-7c1dcc63277f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2126179557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5329f0bac5b64d07afaba5a42c12b537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec9c34d-38", "ovs_interfaceid": "fec9c34d-38ef-46e3-ad2d-47ec3e0895e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:ac:bc,bridge_name='br-int',has_traffic_filtering=True,id=fec9c34d-38ef-46e3-ad2d-47ec3e0895e1,network=Network(944e9ac7-5ec1-4834-894d-7c1dcc63277f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec9c34d-38') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.objects.instance [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Lazy-loading 'pci_devices' on Instance uuid ba81117e-fef4-4b0d-89ba-ba16aaeaf124 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:41:34 user nova-compute[72444]:   <uuid>ba81117e-fef4-4b0d-89ba-ba16aaeaf124</uuid>
Aug 03 04:41:34 user nova-compute[72444]:   <name>instance-0000000b</name>
Aug 03 04:41:34 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:41:34 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:41:34 user nova-compute[72444]:   <metadata>
Aug 03 04:41:34 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:41:34 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:41:34 user nova-compute[72444]:       <nova:name>tempest-VolumesActionsTest-instance-739885277</nova:name>
Aug 03 04:41:34 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:41:34</nova:creationTime>
Aug 03 04:41:34 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:41:34 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:41:34 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:41:34 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:41:34 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:41:34 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:41:34 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:41:34 user nova-compute[72444]:       <nova:owner>
Aug 03 04:41:34 user nova-compute[72444]:         <nova:user uuid="f0c63f7ac0ce4389a1c66d104cc1eb67">tempest-VolumesActionsTest-1012112512-project-member</nova:user>
Aug 03 04:41:34 user nova-compute[72444]:         <nova:project uuid="5329f0bac5b64d07afaba5a42c12b537">tempest-VolumesActionsTest-1012112512</nova:project>
Aug 03 04:41:34 user nova-compute[72444]:       </nova:owner>
Aug 03 04:41:34 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:41:34 user nova-compute[72444]:       <nova:ports>
Aug 03 04:41:34 user nova-compute[72444]:         <nova:port uuid="fec9c34d-38ef-46e3-ad2d-47ec3e0895e1">
Aug 03 04:41:34 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 03 04:41:34 user nova-compute[72444]:         </nova:port>
Aug 03 04:41:34 user nova-compute[72444]:       </nova:ports>
Aug 03 04:41:34 user nova-compute[72444]:     </nova:instance>
Aug 03 04:41:34 user nova-compute[72444]:   </metadata>
Aug 03 04:41:34 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:41:34 user nova-compute[72444]:     <system>
Aug 03 04:41:34 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:41:34 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:41:34 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:41:34 user nova-compute[72444]:       <entry name="serial">ba81117e-fef4-4b0d-89ba-ba16aaeaf124</entry>
Aug 03 04:41:34 user nova-compute[72444]:       <entry name="uuid">ba81117e-fef4-4b0d-89ba-ba16aaeaf124</entry>
Aug 03 04:41:34 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:41:34 user nova-compute[72444]:     </system>
Aug 03 04:41:34 user nova-compute[72444]:   </sysinfo>
Aug 03 04:41:34 user nova-compute[72444]:   <os>
Aug 03 04:41:34 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:41:34 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:41:34 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:41:34 user nova-compute[72444]:   </os>
Aug 03 04:41:34 user nova-compute[72444]:   <features>
Aug 03 04:41:34 user nova-compute[72444]:     <acpi/>
Aug 03 04:41:34 user nova-compute[72444]:     <apic/>
Aug 03 04:41:34 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:41:34 user nova-compute[72444]:   </features>
Aug 03 04:41:34 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:41:34 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:41:34 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:41:34 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:41:34 user nova-compute[72444]:   </clock>
Aug 03 04:41:34 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:41:34 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:41:34 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:41:34 user nova-compute[72444]:   </cpu>
Aug 03 04:41:34 user nova-compute[72444]:   <devices>
Aug 03 04:41:34 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:41:34 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:41:34 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/ba81117e-fef4-4b0d-89ba-ba16aaeaf124/disk"/>
Aug 03 04:41:34 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:41:34 user nova-compute[72444]:     </disk>
Aug 03 04:41:34 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:41:34 user nova-compute[72444]:       <mac address="fa:16:3e:3c:ac:bc"/>
Aug 03 04:41:34 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:41:34 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:41:34 user nova-compute[72444]:       <target dev="tapfec9c34d-38"/>
Aug 03 04:41:34 user nova-compute[72444]:     </interface>
Aug 03 04:41:34 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:41:34 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/ba81117e-fef4-4b0d-89ba-ba16aaeaf124/console.log" append="off"/>
Aug 03 04:41:34 user nova-compute[72444]:     </serial>
Aug 03 04:41:34 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:41:34 user nova-compute[72444]:     <video>
Aug 03 04:41:34 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:41:34 user nova-compute[72444]:     </video>
Aug 03 04:41:34 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:41:34 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:41:34 user nova-compute[72444]:     </rng>
Aug 03 04:41:34 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:41:34 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:41:34 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:41:34 user nova-compute[72444]:     </memballoon>
Aug 03 04:41:34 user nova-compute[72444]:   </devices>
Aug 03 04:41:34 user nova-compute[72444]: </domain>
Aug 03 04:41:34 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:41:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-739885277',display_name='tempest-VolumesActionsTest-instance-739885277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-739885277',id=11,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5329f0bac5b64d07afaba5a42c12b537',ramdisk_id='',reservation_id='r-jf05yl94',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1012112512',owner_user_name='tempest-VolumesActionsTest-1012112512-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:41:32Z,user_data=None,user_id='f0c63f7ac0ce4389a1c66d104cc1eb67',uuid=ba81117e-fef4-4b0d-89ba-ba16aaeaf124,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fec9c34d-38ef-46e3-ad2d-47ec3e0895e1", "address": "fa:16:3e:3c:ac:bc", "network": {"id": "944e9ac7-5ec1-4834-894d-7c1dcc63277f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2126179557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5329f0bac5b64d07afaba5a42c12b537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec9c34d-38", "ovs_interfaceid": "fec9c34d-38ef-46e3-ad2d-47ec3e0895e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:41:34 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Converting VIF {"id": "fec9c34d-38ef-46e3-ad2d-47ec3e0895e1", "address": "fa:16:3e:3c:ac:bc", "network": {"id": "944e9ac7-5ec1-4834-894d-7c1dcc63277f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2126179557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5329f0bac5b64d07afaba5a42c12b537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec9c34d-38", "ovs_interfaceid": "fec9c34d-38ef-46e3-ad2d-47ec3e0895e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:41:35 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:ac:bc,bridge_name='br-int',has_traffic_filtering=True,id=fec9c34d-38ef-46e3-ad2d-47ec3e0895e1,network=Network(944e9ac7-5ec1-4834-894d-7c1dcc63277f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec9c34d-38') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:41:35 user nova-compute[72444]: DEBUG os_vif [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:ac:bc,bridge_name='br-int',has_traffic_filtering=True,id=fec9c34d-38ef-46e3-ad2d-47ec3e0895e1,network=Network(944e9ac7-5ec1-4834-894d-7c1dcc63277f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec9c34d-38') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:41:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:41:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:41:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfec9c34d-38, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:41:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfec9c34d-38, col_values=(('external_ids', {'iface-id': 'fec9c34d-38ef-46e3-ad2d-47ec3e0895e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:ac:bc', 'vm-uuid': 'ba81117e-fef4-4b0d-89ba-ba16aaeaf124'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:41:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:41:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:35 user nova-compute[72444]: INFO os_vif [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:ac:bc,bridge_name='br-int',has_traffic_filtering=True,id=fec9c34d-38ef-46e3-ad2d-47ec3e0895e1,network=Network(944e9ac7-5ec1-4834-894d-7c1dcc63277f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec9c34d-38')
Aug 03 04:41:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:41:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] No VIF found with MAC fa:16:3e:3c:ac:bc, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:41:35 user nova-compute[72444]: DEBUG nova.network.neutron [req-f4eb0bd1-ade2-4929-a37a-b9997fc3047c req-f08809e5-f7eb-44ea-8e00-53bda3a50147 service nova] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Updated VIF entry in instance network info cache for port fec9c34d-38ef-46e3-ad2d-47ec3e0895e1. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:41:35 user nova-compute[72444]: DEBUG nova.network.neutron [req-f4eb0bd1-ade2-4929-a37a-b9997fc3047c req-f08809e5-f7eb-44ea-8e00-53bda3a50147 service nova] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Updating instance_info_cache with network_info: [{"id": "fec9c34d-38ef-46e3-ad2d-47ec3e0895e1", "address": "fa:16:3e:3c:ac:bc", "network": {"id": "944e9ac7-5ec1-4834-894d-7c1dcc63277f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2126179557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5329f0bac5b64d07afaba5a42c12b537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec9c34d-38", "ovs_interfaceid": "fec9c34d-38ef-46e3-ad2d-47ec3e0895e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:41:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f4eb0bd1-ade2-4929-a37a-b9997fc3047c req-f08809e5-f7eb-44ea-8e00-53bda3a50147 service nova] Releasing lock "refresh_cache-ba81117e-fef4-4b0d-89ba-ba16aaeaf124" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:41:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:37 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:41:37 user nova-compute[72444]: DEBUG nova.compute.manager [req-e1bdc822-e66a-47ae-a28f-2c7626fc9fbf req-ad9f42f3-9dba-4176-9996-d2edd7bcfb3a service nova] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Received event network-vif-plugged-fec9c34d-38ef-46e3-ad2d-47ec3e0895e1 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:41:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e1bdc822-e66a-47ae-a28f-2c7626fc9fbf req-ad9f42f3-9dba-4176-9996-d2edd7bcfb3a service nova] Acquiring lock "ba81117e-fef4-4b0d-89ba-ba16aaeaf124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e1bdc822-e66a-47ae-a28f-2c7626fc9fbf req-ad9f42f3-9dba-4176-9996-d2edd7bcfb3a service nova] Lock "ba81117e-fef4-4b0d-89ba-ba16aaeaf124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e1bdc822-e66a-47ae-a28f-2c7626fc9fbf req-ad9f42f3-9dba-4176-9996-d2edd7bcfb3a service nova] Lock "ba81117e-fef4-4b0d-89ba-ba16aaeaf124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:37 user nova-compute[72444]: DEBUG nova.compute.manager [req-e1bdc822-e66a-47ae-a28f-2c7626fc9fbf req-ad9f42f3-9dba-4176-9996-d2edd7bcfb3a service nova] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] No waiting events found dispatching network-vif-plugged-fec9c34d-38ef-46e3-ad2d-47ec3e0895e1 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:41:37 user nova-compute[72444]: WARNING nova.compute.manager [req-e1bdc822-e66a-47ae-a28f-2c7626fc9fbf req-ad9f42f3-9dba-4176-9996-d2edd7bcfb3a service nova] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Received unexpected event network-vif-plugged-fec9c34d-38ef-46e3-ad2d-47ec3e0895e1 for instance with vm_state building and task_state spawning.
Aug 03 04:41:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:37 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:41:37 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:41:37 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:41:37 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 04:41:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:38 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:41:38 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:41:38 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:41:38 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:41:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:38 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 04:41:39 user nova-compute[72444]: DEBUG nova.compute.manager [req-d19f10b9-1130-4593-ad65-2ff0847846d5 req-bf9d5807-b071-406b-a63f-0e9a1421cc0d service nova] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Received event network-vif-plugged-fec9c34d-38ef-46e3-ad2d-47ec3e0895e1 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:41:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d19f10b9-1130-4593-ad65-2ff0847846d5 req-bf9d5807-b071-406b-a63f-0e9a1421cc0d service nova] Acquiring lock "ba81117e-fef4-4b0d-89ba-ba16aaeaf124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d19f10b9-1130-4593-ad65-2ff0847846d5 req-bf9d5807-b071-406b-a63f-0e9a1421cc0d service nova] Lock "ba81117e-fef4-4b0d-89ba-ba16aaeaf124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d19f10b9-1130-4593-ad65-2ff0847846d5 req-bf9d5807-b071-406b-a63f-0e9a1421cc0d service nova] Lock "ba81117e-fef4-4b0d-89ba-ba16aaeaf124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:39 user nova-compute[72444]: DEBUG nova.compute.manager [req-d19f10b9-1130-4593-ad65-2ff0847846d5 req-bf9d5807-b071-406b-a63f-0e9a1421cc0d service nova] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] No waiting events found dispatching network-vif-plugged-fec9c34d-38ef-46e3-ad2d-47ec3e0895e1 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:41:39 user nova-compute[72444]: WARNING nova.compute.manager [req-d19f10b9-1130-4593-ad65-2ff0847846d5 req-bf9d5807-b071-406b-a63f-0e9a1421cc0d service nova] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Received unexpected event network-vif-plugged-fec9c34d-38ef-46e3-ad2d-47ec3e0895e1 for instance with vm_state building and task_state spawning.
Aug 03 04:41:39 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037699.2493892, ba81117e-fef4-4b0d-89ba-ba16aaeaf124 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:41:39 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] VM Resumed (Lifecycle Event)
Aug 03 04:41:39 user nova-compute[72444]: DEBUG nova.compute.manager [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:41:39 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 04:41:39 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Instance spawned successfully.
Aug 03 04:41:39 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 04:41:39 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:41:39 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:41:39 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:41:39 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037699.2522736, ba81117e-fef4-4b0d-89ba-ba16aaeaf124 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:41:39 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] VM Started (Lifecycle Event)
Aug 03 04:41:39 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:39 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:39 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:39 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:39 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:39 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:41:39 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:41:39 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:41:39 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:41:39 user nova-compute[72444]: INFO nova.compute.manager [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Took 7.31 seconds to spawn the instance on the hypervisor.
Aug 03 04:41:39 user nova-compute[72444]: DEBUG nova.compute.manager [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:41:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:39 user nova-compute[72444]: INFO nova.compute.manager [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Took 8.67 seconds to build instance.
Aug 03 04:41:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8915305c-b9e0-474f-8fc3-8509f25de551 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Lock "ba81117e-fef4-4b0d-89ba-ba16aaeaf124" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.802s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f131f8-83ac-4fd4-b056-f8dac3d32c55/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f131f8-83ac-4fd4-b056-f8dac3d32c55/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f131f8-83ac-4fd4-b056-f8dac3d32c55/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f131f8-83ac-4fd4-b056-f8dac3d32c55/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85521338-f660-49ab-a3ab-9eb6df7a7353/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85521338-f660-49ab-a3ab-9eb6df7a7353/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85521338-f660-49ab-a3ab-9eb6df7a7353/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85521338-f660-49ab-a3ab-9eb6df7a7353/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07450ea8-cb80-4318-9fc9-4268944d2cae/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07450ea8-cb80-4318-9fc9-4268944d2cae/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07450ea8-cb80-4318-9fc9-4268944d2cae/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07450ea8-cb80-4318-9fc9-4268944d2cae/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d5c0324-68e8-4f0a-a740-0b4551e81fac/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d5c0324-68e8-4f0a-a740-0b4551e81fac/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d5c0324-68e8-4f0a-a740-0b4551e81fac/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d5c0324-68e8-4f0a-a740-0b4551e81fac/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba81117e-fef4-4b0d-89ba-ba16aaeaf124/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba81117e-fef4-4b0d-89ba-ba16aaeaf124/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba81117e-fef4-4b0d-89ba-ba16aaeaf124/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:41:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba81117e-fef4-4b0d-89ba-ba16aaeaf124/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:41:43 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:43 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:41:43 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:41:43 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=7082MB free_disk=25.84811019897461GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 04:41:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:41:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:41:44 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:41:44 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 81725845-6158-4e34-bedb-6e41219bc227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:41:44 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance b6ed9c42-fa6e-4a0d-8312-588471e157f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:41:44 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 85521338-f660-49ab-a3ab-9eb6df7a7353 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:41:44 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance e3089887-56df-42de-bc62-88e6db28daf0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:41:44 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance e2859322-6f99-442d-bee1-65fe49ce6360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:41:44 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 07450ea8-cb80-4318-9fc9-4268944d2cae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:41:44 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:41:44 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 4d5c0324-68e8-4f0a-a740-0b4551e81fac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:41:44 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 42f131f8-83ac-4fd4-b056-f8dac3d32c55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:41:44 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance ba81117e-fef4-4b0d-89ba-ba16aaeaf124 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:41:44 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 04:41:44 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 04:41:44 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Refreshing inventories for resource provider b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 03 04:41:44 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Updating ProviderTree inventory for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 03 04:41:44 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Updating inventory in ProviderTree for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 03 04:41:44 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Refreshing aggregate associations for resource provider b624a913-bb6b-4a17-8cd7-7b0950cff161, aggregates: None {{(pid=72444) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 03 04:41:44 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Refreshing trait associations for resource provider b624a913-bb6b-4a17-8cd7-7b0950cff161, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=72444) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 03 04:41:44 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:41:44 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:41:44 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 04:41:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.927s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:41:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:46 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:41:46 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 04:41:46 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Rebuilding the list of instances to heal {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 04:41:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:41:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:41:47 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 04:41:47 user nova-compute[72444]: DEBUG nova.objects.instance [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lazy-loading 'info_cache' on Instance uuid 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:41:47 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Updating instance_info_cache with network_info: [{"id": "d0cfd0c0-ac67-4335-85d2-6f0b956fae5b", "address": "fa:16:3e:e0:f6:85", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cfd0c0-ac", "ovs_interfaceid": "d0cfd0c0-ac67-4335-85d2-6f0b956fae5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:41:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:41:47 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 04:41:48 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:41:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:33 user nova-compute[72444]: DEBUG nova.compute.manager [None req-b89b4925-dafd-4f88-8bde-e76a4ee75d68 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:42:33 user nova-compute[72444]: INFO nova.compute.manager [None req-b89b4925-dafd-4f88-8bde-e76a4ee75d68 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] instance snapshotting
Aug 03 04:42:33 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-b89b4925-dafd-4f88-8bde-e76a4ee75d68 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Beginning live snapshot process
Aug 03 04:42:34 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b89b4925-dafd-4f88-8bde-e76a4ee75d68 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json -f qcow2 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:34 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b89b4925-dafd-4f88-8bde-e76a4ee75d68 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json -f qcow2" returned: 0 in 0.145s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:34 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b89b4925-dafd-4f88-8bde-e76a4ee75d68 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json -f qcow2 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:34 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b89b4925-dafd-4f88-8bde-e76a4ee75d68 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json -f qcow2" returned: 0 in 0.147s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:34 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b89b4925-dafd-4f88-8bde-e76a4ee75d68 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:34 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b89b4925-dafd-4f88-8bde-e76a4ee75d68 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.145s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:34 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b89b4925-dafd-4f88-8bde-e76a4ee75d68 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmph6tnhmw8/c1ce32697665434e8583222d500a33ba.delta 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:34 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b89b4925-dafd-4f88-8bde-e76a4ee75d68 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmph6tnhmw8/c1ce32697665434e8583222d500a33ba.delta 1073741824" returned: 0 in 0.051s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:34 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-b89b4925-dafd-4f88-8bde-e76a4ee75d68 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 03 04:42:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-b89b4925-dafd-4f88-8bde-e76a4ee75d68 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72444) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 03 04:42:34 user nova-compute[72444]: INFO nova.virt.libvirt.host [None req-b89b4925-dafd-4f88-8bde-e76a4ee75d68 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] UEFI support detected
Aug 03 04:42:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:35 user nova-compute[72444]: INFO nova.compute.manager [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Rescuing
Aug 03 04:42:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "refresh_cache-b6ed9c42-fa6e-4a0d-8312-588471e157f7" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:42:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquired lock "refresh_cache-b6ed9c42-fa6e-4a0d-8312-588471e157f7" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:42:35 user nova-compute[72444]: DEBUG nova.network.neutron [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:42:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-b89b4925-dafd-4f88-8bde-e76a4ee75d68 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72444) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 03 04:42:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:35 user nova-compute[72444]: DEBUG nova.network.neutron [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Updating instance_info_cache with network_info: [{"id": "bd9827e6-3c6f-4bb3-8889-1ae45107f6f0", "address": "fa:16:3e:61:54:b7", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd9827e6-3c", "ovs_interfaceid": "bd9827e6-3c6f-4bb3-8889-1ae45107f6f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:42:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Releasing lock "refresh_cache-b6ed9c42-fa6e-4a0d-8312-588471e157f7" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:42:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-b89b4925-dafd-4f88-8bde-e76a4ee75d68 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72444) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 03 04:42:35 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-b89b4925-dafd-4f88-8bde-e76a4ee75d68 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 03 04:42:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:35 user nova-compute[72444]: DEBUG nova.privsep.utils [None req-b89b4925-dafd-4f88-8bde-e76a4ee75d68 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72444) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 03 04:42:35 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b89b4925-dafd-4f88-8bde-e76a4ee75d68 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmph6tnhmw8/c1ce32697665434e8583222d500a33ba.delta /opt/stack/data/nova/instances/snapshots/tmph6tnhmw8/c1ce32697665434e8583222d500a33ba {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:35 user nova-compute[72444]: DEBUG nova.compute.manager [req-e528e6f5-b7c9-440b-9ea9-67781bdedfdd req-b727373c-3a11-4333-b506-f5487da001f0 service nova] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Received event network-vif-unplugged-bd9827e6-3c6f-4bb3-8889-1ae45107f6f0 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:42:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e528e6f5-b7c9-440b-9ea9-67781bdedfdd req-b727373c-3a11-4333-b506-f5487da001f0 service nova] Acquiring lock "b6ed9c42-fa6e-4a0d-8312-588471e157f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:42:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e528e6f5-b7c9-440b-9ea9-67781bdedfdd req-b727373c-3a11-4333-b506-f5487da001f0 service nova] Lock "b6ed9c42-fa6e-4a0d-8312-588471e157f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:42:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e528e6f5-b7c9-440b-9ea9-67781bdedfdd req-b727373c-3a11-4333-b506-f5487da001f0 service nova] Lock "b6ed9c42-fa6e-4a0d-8312-588471e157f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:42:35 user nova-compute[72444]: DEBUG nova.compute.manager [req-e528e6f5-b7c9-440b-9ea9-67781bdedfdd req-b727373c-3a11-4333-b506-f5487da001f0 service nova] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] No waiting events found dispatching network-vif-unplugged-bd9827e6-3c6f-4bb3-8889-1ae45107f6f0 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:42:35 user nova-compute[72444]: WARNING nova.compute.manager [req-e528e6f5-b7c9-440b-9ea9-67781bdedfdd req-b727373c-3a11-4333-b506-f5487da001f0 service nova] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Received unexpected event network-vif-unplugged-bd9827e6-3c6f-4bb3-8889-1ae45107f6f0 for instance with vm_state active and task_state rescuing.
Aug 03 04:42:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b89b4925-dafd-4f88-8bde-e76a4ee75d68 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmph6tnhmw8/c1ce32697665434e8583222d500a33ba.delta /opt/stack/data/nova/instances/snapshots/tmph6tnhmw8/c1ce32697665434e8583222d500a33ba" returned: 0 in 0.252s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:36 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-b89b4925-dafd-4f88-8bde-e76a4ee75d68 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Snapshot extracted, beginning image upload
Aug 03 04:42:36 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Instance destroyed successfully.
Aug 03 04:42:36 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Attempting rescue
Aug 03 04:42:36 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72444) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Instance directory exists: not creating {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 03 04:42:36 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Creating image(s)
Aug 03 04:42:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "/opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "/opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "/opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG nova.objects.instance [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lazy-loading 'trusted_certs' on Instance uuid b6ed9c42-fa6e-4a0d-8312-588471e157f7 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.148s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue" returned: 0 in 0.048s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG nova.objects.instance [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lazy-loading 'migration_context' on Instance uuid b6ed9c42-fa6e-4a0d-8312-588471e157f7 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Start _get_guest_xml network_info=[{"id": "bd9827e6-3c6f-4bb3-8889-1ae45107f6f0", "address": "fa:16:3e:61:54:b7", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "vif_mac": "fa:16:3e:61:54:b7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd9827e6-3c", "ovs_interfaceid": "bd9827e6-3c6f-4bb3-8889-1ae45107f6f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG nova.objects.instance [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lazy-loading 'resources' on Instance uuid b6ed9c42-fa6e-4a0d-8312-588471e157f7 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG nova.objects.instance [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lazy-loading 'numa_topology' on Instance uuid b6ed9c42-fa6e-4a0d-8312-588471e157f7 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:42:36 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:42:36 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:42:36 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG nova.objects.instance [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lazy-loading 'vcpu_model' on Instance uuid b6ed9c42-fa6e-4a0d-8312-588471e157f7 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:40:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-418117262',display_name='tempest-ServerRescueNegativeTestJSON-server-418117262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-418117262',id=3,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:41:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='063a2a64796f4b87a44383014f0af3dc',ramdisk_id='',reservation_id='r-791q0qth',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-665683708',owner_user_name='tempest-ServerRescueNegativeTestJSON-665683708-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:41:05Z,user_data=None,user_id='07e8b540c9194e1195cb898ad08acaa0',uuid=b6ed9c42-fa6e-4a0d-8312-588471e157f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd9827e6-3c6f-4bb3-8889-1ae45107f6f0", "address": "fa:16:3e:61:54:b7", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "vif_mac": "fa:16:3e:61:54:b7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd9827e6-3c", "ovs_interfaceid": "bd9827e6-3c6f-4bb3-8889-1ae45107f6f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Converting VIF {"id": "bd9827e6-3c6f-4bb3-8889-1ae45107f6f0", "address": "fa:16:3e:61:54:b7", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "vif_mac": "fa:16:3e:61:54:b7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd9827e6-3c", "ovs_interfaceid": "bd9827e6-3c6f-4bb3-8889-1ae45107f6f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:54:b7,bridge_name='br-int',has_traffic_filtering=True,id=bd9827e6-3c6f-4bb3-8889-1ae45107f6f0,network=Network(bc85da72-7764-4b65-a071-aec46e3a2398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd9827e6-3c') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG nova.objects.instance [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lazy-loading 'pci_devices' on Instance uuid b6ed9c42-fa6e-4a0d-8312-588471e157f7 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:42:36 user nova-compute[72444]:   <uuid>b6ed9c42-fa6e-4a0d-8312-588471e157f7</uuid>
Aug 03 04:42:36 user nova-compute[72444]:   <name>instance-00000003</name>
Aug 03 04:42:36 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:42:36 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:42:36 user nova-compute[72444]:   <metadata>
Aug 03 04:42:36 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:42:36 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:42:36 user nova-compute[72444]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-418117262</nova:name>
Aug 03 04:42:36 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:42:36</nova:creationTime>
Aug 03 04:42:36 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:42:36 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:42:36 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:42:36 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:42:36 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:42:36 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:42:36 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:42:36 user nova-compute[72444]:       <nova:owner>
Aug 03 04:42:36 user nova-compute[72444]:         <nova:user uuid="07e8b540c9194e1195cb898ad08acaa0">tempest-ServerRescueNegativeTestJSON-665683708-project-member</nova:user>
Aug 03 04:42:36 user nova-compute[72444]:         <nova:project uuid="063a2a64796f4b87a44383014f0af3dc">tempest-ServerRescueNegativeTestJSON-665683708</nova:project>
Aug 03 04:42:36 user nova-compute[72444]:       </nova:owner>
Aug 03 04:42:36 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:42:36 user nova-compute[72444]:       <nova:ports>
Aug 03 04:42:36 user nova-compute[72444]:         <nova:port uuid="bd9827e6-3c6f-4bb3-8889-1ae45107f6f0">
Aug 03 04:42:36 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 03 04:42:36 user nova-compute[72444]:         </nova:port>
Aug 03 04:42:36 user nova-compute[72444]:       </nova:ports>
Aug 03 04:42:36 user nova-compute[72444]:     </nova:instance>
Aug 03 04:42:36 user nova-compute[72444]:   </metadata>
Aug 03 04:42:36 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:42:36 user nova-compute[72444]:     <system>
Aug 03 04:42:36 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:42:36 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:42:36 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:42:36 user nova-compute[72444]:       <entry name="serial">b6ed9c42-fa6e-4a0d-8312-588471e157f7</entry>
Aug 03 04:42:36 user nova-compute[72444]:       <entry name="uuid">b6ed9c42-fa6e-4a0d-8312-588471e157f7</entry>
Aug 03 04:42:36 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:42:36 user nova-compute[72444]:     </system>
Aug 03 04:42:36 user nova-compute[72444]:   </sysinfo>
Aug 03 04:42:36 user nova-compute[72444]:   <os>
Aug 03 04:42:36 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:42:36 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:42:36 user nova-compute[72444]:   </os>
Aug 03 04:42:36 user nova-compute[72444]:   <features>
Aug 03 04:42:36 user nova-compute[72444]:     <acpi/>
Aug 03 04:42:36 user nova-compute[72444]:     <apic/>
Aug 03 04:42:36 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:42:36 user nova-compute[72444]:   </features>
Aug 03 04:42:36 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:42:36 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:42:36 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:42:36 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:42:36 user nova-compute[72444]:   </clock>
Aug 03 04:42:36 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:42:36 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:42:36 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:42:36 user nova-compute[72444]:   </cpu>
Aug 03 04:42:36 user nova-compute[72444]:   <devices>
Aug 03 04:42:36 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:42:36 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:42:36 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue"/>
Aug 03 04:42:36 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:42:36 user nova-compute[72444]:     </disk>
Aug 03 04:42:36 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:42:36 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:42:36 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk"/>
Aug 03 04:42:36 user nova-compute[72444]:       <target dev="vdb" bus="virtio"/>
Aug 03 04:42:36 user nova-compute[72444]:     </disk>
Aug 03 04:42:36 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:42:36 user nova-compute[72444]:       <mac address="fa:16:3e:61:54:b7"/>
Aug 03 04:42:36 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:42:36 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:42:36 user nova-compute[72444]:       <target dev="tapbd9827e6-3c"/>
Aug 03 04:42:36 user nova-compute[72444]:     </interface>
Aug 03 04:42:36 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:42:36 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/console.log" append="off"/>
Aug 03 04:42:36 user nova-compute[72444]:     </serial>
Aug 03 04:42:36 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:42:36 user nova-compute[72444]:     <video>
Aug 03 04:42:36 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:42:36 user nova-compute[72444]:     </video>
Aug 03 04:42:36 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:42:36 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:42:36 user nova-compute[72444]:     </rng>
Aug 03 04:42:36 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:42:36 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:42:36 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:42:36 user nova-compute[72444]:     </memballoon>
Aug 03 04:42:36 user nova-compute[72444]:   </devices>
Aug 03 04:42:36 user nova-compute[72444]: </domain>
Aug 03 04:42:36 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:42:36 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Instance destroyed successfully.
Aug 03 04:42:36 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] No VIF found with MAC fa:16:3e:61:54:b7, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:42:36 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:42:37 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:42:37 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:42:37 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:42:37 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 04:42:38 user nova-compute[72444]: DEBUG nova.compute.manager [req-f2d392df-c073-4ac0-a754-7d8d11ba2299 req-0a97ec60-ae7e-41be-ba2e-8023328e3a31 service nova] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Received event network-vif-plugged-bd9827e6-3c6f-4bb3-8889-1ae45107f6f0 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:42:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f2d392df-c073-4ac0-a754-7d8d11ba2299 req-0a97ec60-ae7e-41be-ba2e-8023328e3a31 service nova] Acquiring lock "b6ed9c42-fa6e-4a0d-8312-588471e157f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:42:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f2d392df-c073-4ac0-a754-7d8d11ba2299 req-0a97ec60-ae7e-41be-ba2e-8023328e3a31 service nova] Lock "b6ed9c42-fa6e-4a0d-8312-588471e157f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:42:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f2d392df-c073-4ac0-a754-7d8d11ba2299 req-0a97ec60-ae7e-41be-ba2e-8023328e3a31 service nova] Lock "b6ed9c42-fa6e-4a0d-8312-588471e157f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:42:38 user nova-compute[72444]: DEBUG nova.compute.manager [req-f2d392df-c073-4ac0-a754-7d8d11ba2299 req-0a97ec60-ae7e-41be-ba2e-8023328e3a31 service nova] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] No waiting events found dispatching network-vif-plugged-bd9827e6-3c6f-4bb3-8889-1ae45107f6f0 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:42:38 user nova-compute[72444]: WARNING nova.compute.manager [req-f2d392df-c073-4ac0-a754-7d8d11ba2299 req-0a97ec60-ae7e-41be-ba2e-8023328e3a31 service nova] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Received unexpected event network-vif-plugged-bd9827e6-3c6f-4bb3-8889-1ae45107f6f0 for instance with vm_state active and task_state rescuing.
Aug 03 04:42:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:38 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-b89b4925-dafd-4f88-8bde-e76a4ee75d68 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Snapshot image upload complete
Aug 03 04:42:38 user nova-compute[72444]: INFO nova.compute.manager [None req-b89b4925-dafd-4f88-8bde-e76a4ee75d68 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Took 4.92 seconds to snapshot the instance on the hypervisor.
Aug 03 04:42:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:38 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:42:38 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:42:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:42:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:42:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:42:38 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 04:42:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Acquiring lock "619ce0f2-51f9-4b87-9709-a736db645218" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:42:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Lock "619ce0f2-51f9-4b87-9709-a736db645218" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:42:39 user nova-compute[72444]: DEBUG nova.compute.manager [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 04:42:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:42:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:42:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:39 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 04:42:39 user nova-compute[72444]: INFO nova.compute.claims [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Claim successful on node user
Aug 03 04:42:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Acquiring lock "85521338-f660-49ab-a3ab-9eb6df7a7353" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:42:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Lock "85521338-f660-49ab-a3ab-9eb6df7a7353" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:42:39 user nova-compute[72444]: DEBUG nova.objects.instance [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Lazy-loading 'flavor' on Instance uuid 85521338-f660-49ab-a3ab-9eb6df7a7353 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:42:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Lock "85521338-f660-49ab-a3ab-9eb6df7a7353" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.153s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG nova.compute.manager [req-edc71d4d-9816-4688-9b04-a26f50da93d0 req-51f567db-4adc-4ab3-ba72-a43a48cb0095 service nova] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Received event network-vif-plugged-bd9827e6-3c6f-4bb3-8889-1ae45107f6f0 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-edc71d4d-9816-4688-9b04-a26f50da93d0 req-51f567db-4adc-4ab3-ba72-a43a48cb0095 service nova] Acquiring lock "b6ed9c42-fa6e-4a0d-8312-588471e157f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-edc71d4d-9816-4688-9b04-a26f50da93d0 req-51f567db-4adc-4ab3-ba72-a43a48cb0095 service nova] Lock "b6ed9c42-fa6e-4a0d-8312-588471e157f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-edc71d4d-9816-4688-9b04-a26f50da93d0 req-51f567db-4adc-4ab3-ba72-a43a48cb0095 service nova] Lock "b6ed9c42-fa6e-4a0d-8312-588471e157f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG nova.compute.manager [req-edc71d4d-9816-4688-9b04-a26f50da93d0 req-51f567db-4adc-4ab3-ba72-a43a48cb0095 service nova] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] No waiting events found dispatching network-vif-plugged-bd9827e6-3c6f-4bb3-8889-1ae45107f6f0 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:42:40 user nova-compute[72444]: WARNING nova.compute.manager [req-edc71d4d-9816-4688-9b04-a26f50da93d0 req-51f567db-4adc-4ab3-ba72-a43a48cb0095 service nova] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Received unexpected event network-vif-plugged-bd9827e6-3c6f-4bb3-8889-1ae45107f6f0 for instance with vm_state active and task_state rescuing.
Aug 03 04:42:40 user nova-compute[72444]: DEBUG nova.compute.manager [req-edc71d4d-9816-4688-9b04-a26f50da93d0 req-51f567db-4adc-4ab3-ba72-a43a48cb0095 service nova] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Received event network-vif-plugged-bd9827e6-3c6f-4bb3-8889-1ae45107f6f0 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-edc71d4d-9816-4688-9b04-a26f50da93d0 req-51f567db-4adc-4ab3-ba72-a43a48cb0095 service nova] Acquiring lock "b6ed9c42-fa6e-4a0d-8312-588471e157f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-edc71d4d-9816-4688-9b04-a26f50da93d0 req-51f567db-4adc-4ab3-ba72-a43a48cb0095 service nova] Lock "b6ed9c42-fa6e-4a0d-8312-588471e157f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-edc71d4d-9816-4688-9b04-a26f50da93d0 req-51f567db-4adc-4ab3-ba72-a43a48cb0095 service nova] Lock "b6ed9c42-fa6e-4a0d-8312-588471e157f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG nova.compute.manager [req-edc71d4d-9816-4688-9b04-a26f50da93d0 req-51f567db-4adc-4ab3-ba72-a43a48cb0095 service nova] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] No waiting events found dispatching network-vif-plugged-bd9827e6-3c6f-4bb3-8889-1ae45107f6f0 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:42:40 user nova-compute[72444]: WARNING nova.compute.manager [req-edc71d4d-9816-4688-9b04-a26f50da93d0 req-51f567db-4adc-4ab3-ba72-a43a48cb0095 service nova] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Received unexpected event network-vif-plugged-bd9827e6-3c6f-4bb3-8889-1ae45107f6f0 for instance with vm_state active and task_state rescuing.
Aug 03 04:42:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f131f8-83ac-4fd4-b056-f8dac3d32c55/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f131f8-83ac-4fd4-b056-f8dac3d32c55/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f131f8-83ac-4fd4-b056-f8dac3d32c55/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Acquiring lock "85521338-f660-49ab-a3ab-9eb6df7a7353" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Lock "85521338-f660-49ab-a3ab-9eb6df7a7353" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:42:40 user nova-compute[72444]: INFO nova.compute.manager [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Attaching volume a912316e-c202-4d71-86b9-ca39e5d88702 to /dev/vdb
Aug 03 04:42:40 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Removed pending event for b6ed9c42-fa6e-4a0d-8312-588471e157f7 due to event {{(pid=72444) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037760.4542801, b6ed9c42-fa6e-4a0d-8312-588471e157f7 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:42:40 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] VM Resumed (Lifecycle Event)
Aug 03 04:42:40 user nova-compute[72444]: DEBUG nova.compute.manager [None req-8d7cc885-5bea-4512-8275-96acff860959 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f131f8-83ac-4fd4-b056-f8dac3d32c55/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG os_brick.utils [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:42:40 user nova-compute[72444]: INFO oslo.privsep.daemon [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpekwot7ol/privsep.sock']
Aug 03 04:42:40 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:42:40 user sudo[84210]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpekwot7ol/privsep.sock
Aug 03 04:42:40 user sudo[84210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 03 04:42:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.774s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG nova.compute.manager [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:42:40 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 03 04:42:40 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037760.45494, b6ed9c42-fa6e-4a0d-8312-588471e157f7 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:42:40 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] VM Started (Lifecycle Event)
Aug 03 04:42:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Acquiring lock "445ab78e-a1f6-4a4c-bd63-44d149f88b35" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Lock "445ab78e-a1f6-4a4c-bd63-44d149f88b35" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG nova.compute.manager [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG nova.network.neutron [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG nova.compute.manager [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:40 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 04:42:40 user nova-compute[72444]: DEBUG nova.compute.manager [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG nova.policy [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f3d18e55922c4d41bea8cc96c6c7cae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81df940dade241e1a3560045086f8699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 04:42:40 user nova-compute[72444]: INFO nova.compute.claims [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Claim successful on node user
Aug 03 04:42:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85521338-f660-49ab-a3ab-9eb6df7a7353/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG nova.compute.manager [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 04:42:40 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Creating image(s)
Aug 03 04:42:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Acquiring lock "/opt/stack/data/nova/instances/619ce0f2-51f9-4b87-9709-a736db645218/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Lock "/opt/stack/data/nova/instances/619ce0f2-51f9-4b87-9709-a736db645218/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Lock "/opt/stack/data/nova/instances/619ce0f2-51f9-4b87-9709-a736db645218/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85521338-f660-49ab-a3ab-9eb6df7a7353/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85521338-f660-49ab-a3ab-9eb6df7a7353/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.146s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85521338-f660-49ab-a3ab-9eb6df7a7353/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.168s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/619ce0f2-51f9-4b87-9709-a736db645218/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/619ce0f2-51f9-4b87-9709-a736db645218/disk 1073741824" returned: 0 in 0.054s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG nova.network.neutron [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Successfully created port: 60932a4b-e500-42ba-b61b-997a0ec85e0c {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.193s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Checking if we can resize image /opt/stack/data/nova/instances/619ce0f2-51f9-4b87-9709-a736db645218/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/619ce0f2-51f9-4b87-9709-a736db645218/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/619ce0f2-51f9-4b87-9709-a736db645218/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Cannot resize image /opt/stack/data/nova/instances/619ce0f2-51f9-4b87-9709-a736db645218/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG nova.objects.instance [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Lazy-loading 'migration_context' on Instance uuid 619ce0f2-51f9-4b87-9709-a736db645218 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Ensure instance console log exists: /opt/stack/data/nova/instances/619ce0f2-51f9-4b87-9709-a736db645218/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.905s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG nova.compute.manager [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG nova.compute.manager [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG nova.network.neutron [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 04:42:41 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 04:42:41 user nova-compute[72444]: DEBUG nova.compute.manager [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07450ea8-cb80-4318-9fc9-4268944d2cae/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG nova.policy [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '099a590e90f043cba5b076c8dd75999d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c520dc44eff4401789ef1ff61cc24cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG nova.compute.manager [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 04:42:41 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Creating image(s)
Aug 03 04:42:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Acquiring lock "/opt/stack/data/nova/instances/445ab78e-a1f6-4a4c-bd63-44d149f88b35/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Lock "/opt/stack/data/nova/instances/445ab78e-a1f6-4a4c-bd63-44d149f88b35/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Lock "/opt/stack/data/nova/instances/445ab78e-a1f6-4a4c-bd63-44d149f88b35/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:42:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07450ea8-cb80-4318-9fc9-4268944d2cae/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07450ea8-cb80-4318-9fc9-4268944d2cae/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.144s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07450ea8-cb80-4318-9fc9-4268944d2cae/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG nova.network.neutron [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Successfully updated port: 60932a4b-e500-42ba-b61b-997a0ec85e0c {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:42 user sudo[84210]: pam_unix(sudo:session): session closed for user root
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Acquiring lock "refresh_cache-619ce0f2-51f9-4b87-9709-a736db645218" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Acquired lock "refresh_cache-619ce0f2-51f9-4b87-9709-a736db645218" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG nova.network.neutron [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG nova.compute.manager [req-654d3658-02c3-489c-bdee-6780e9402f03 req-ebb771ae-6090-436d-9058-6d973d972a97 service nova] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Received event network-changed-60932a4b-e500-42ba-b61b-997a0ec85e0c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG nova.compute.manager [req-654d3658-02c3-489c-bdee-6780e9402f03 req-ebb771ae-6090-436d-9058-6d973d972a97 service nova] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Refreshing instance network info cache due to event network-changed-60932a4b-e500-42ba-b61b-997a0ec85e0c. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-654d3658-02c3-489c-bdee-6780e9402f03 req-ebb771ae-6090-436d-9058-6d973d972a97 service nova] Acquiring lock "refresh_cache-619ce0f2-51f9-4b87-9709-a736db645218" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:42:42 user nova-compute[72444]: INFO oslo.privsep.daemon [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Spawned new privsep daemon via rootwrap
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.151s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:42 user nova-compute[72444]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 03 04:42:42 user nova-compute[72444]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 03 04:42:42 user nova-compute[72444]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 03 04:42:42 user nova-compute[72444]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84280
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/445ab78e-a1f6-4a4c-bd63-44d149f88b35/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f6ff9f-e61f-4d91-85a6-3d2c68ffced2]: (2,) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/445ab78e-a1f6-4a4c-bd63-44d149f88b35/disk 1073741824" returned: 0 in 0.048s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG nova.network.neutron [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.157s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Checking if we can resize image /opt/stack/data/nova/instances/445ab78e-a1f6-4a4c-bd63-44d149f88b35/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445ab78e-a1f6-4a4c-bd63-44d149f88b35/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[781413e9-eed7-4891-b772-43b045f8eb9a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:42:42 user nova-compute[72444]: WARNING os_brick.initiator.connectors.nvmeof [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.070s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf30f3a4-35f8-4b72-bf26-642498f24613]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d5c0324-68e8-4f0a-a740-0b4551e81fac/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[925eb7bc-c416-411e-8fe7-cb5f2db1df9c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445ab78e-a1f6-4a4c-bd63-44d149f88b35/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Cannot resize image /opt/stack/data/nova/instances/445ab78e-a1f6-4a4c-bd63-44d149f88b35/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG nova.objects.instance [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Lazy-loading 'migration_context' on Instance uuid 445ab78e-a1f6-4a4c-bd63-44d149f88b35 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f29961a-3d1c-4e0b-9160-04da24a59de8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Ensure instance console log exists: /opt/stack/data/nova/instances/445ab78e-a1f6-4a4c-bd63-44d149f88b35/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:42:42 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb8a2e0-c790-4699-8835-4efdd5fe8ec4]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG os_brick.utils [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] <== get_connector_properties: return (2335ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Updating existing volume attachment record: 0f8ad1a1-6c0f-49be-98b0-4b7abf280ad0 {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d5c0324-68e8-4f0a-a740-0b4551e81fac/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d5c0324-68e8-4f0a-a740-0b4551e81fac/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG nova.network.neutron [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Updating instance_info_cache with network_info: [{"id": "60932a4b-e500-42ba-b61b-997a0ec85e0c", "address": "fa:16:3e:2f:31:01", "network": {"id": "6ec6c203-3446-4671-84b4-9d6a55757afb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1998429186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81df940dade241e1a3560045086f8699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60932a4b-e5", "ovs_interfaceid": "60932a4b-e500-42ba-b61b-997a0ec85e0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Releasing lock "refresh_cache-619ce0f2-51f9-4b87-9709-a736db645218" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG nova.compute.manager [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Instance network_info: |[{"id": "60932a4b-e500-42ba-b61b-997a0ec85e0c", "address": "fa:16:3e:2f:31:01", "network": {"id": "6ec6c203-3446-4671-84b4-9d6a55757afb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1998429186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81df940dade241e1a3560045086f8699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60932a4b-e5", "ovs_interfaceid": "60932a4b-e500-42ba-b61b-997a0ec85e0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-654d3658-02c3-489c-bdee-6780e9402f03 req-ebb771ae-6090-436d-9058-6d973d972a97 service nova] Acquired lock "refresh_cache-619ce0f2-51f9-4b87-9709-a736db645218" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:42:42 user nova-compute[72444]: DEBUG nova.network.neutron [req-654d3658-02c3-489c-bdee-6780e9402f03 req-ebb771ae-6090-436d-9058-6d973d972a97 service nova] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Refreshing network info cache for port 60932a4b-e500-42ba-b61b-997a0ec85e0c {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Start _get_guest_xml network_info=[{"id": "60932a4b-e500-42ba-b61b-997a0ec85e0c", "address": "fa:16:3e:2f:31:01", "network": {"id": "6ec6c203-3446-4671-84b4-9d6a55757afb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1998429186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81df940dade241e1a3560045086f8699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60932a4b-e5", "ovs_interfaceid": "60932a4b-e500-42ba-b61b-997a0ec85e0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG nova.network.neutron [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Successfully created port: 7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24 {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d5c0324-68e8-4f0a-a740-0b4551e81fac/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:43 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:42:43 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:42:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba81117e-fef4-4b0d-89ba-ba16aaeaf124/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:42:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1126375205',display_name='tempest-ServersNegativeTestJSON-server-1126375205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1126375205',id=12,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81df940dade241e1a3560045086f8699',ramdisk_id='',reservation_id='r-6mbcm7zi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2144635638',owner_user_name='tempest-ServersNegativeTestJSON-2144635638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:42:41Z,user_data=None,user_id='f3d18e55922c4d41bea8cc96c6c7cae3',uuid=619ce0f2-51f9-4b87-9709-a736db645218,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60932a4b-e500-42ba-b61b-997a0ec85e0c", "address": "fa:16:3e:2f:31:01", "network": {"id": "6ec6c203-3446-4671-84b4-9d6a55757afb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1998429186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81df940dade241e1a3560045086f8699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60932a4b-e5", "ovs_interfaceid": "60932a4b-e500-42ba-b61b-997a0ec85e0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Converting VIF {"id": "60932a4b-e500-42ba-b61b-997a0ec85e0c", "address": "fa:16:3e:2f:31:01", "network": {"id": "6ec6c203-3446-4671-84b4-9d6a55757afb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1998429186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81df940dade241e1a3560045086f8699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60932a4b-e5", "ovs_interfaceid": "60932a4b-e500-42ba-b61b-997a0ec85e0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:31:01,bridge_name='br-int',has_traffic_filtering=True,id=60932a4b-e500-42ba-b61b-997a0ec85e0c,network=Network(6ec6c203-3446-4671-84b4-9d6a55757afb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60932a4b-e5') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG nova.objects.instance [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Lazy-loading 'pci_devices' on Instance uuid 619ce0f2-51f9-4b87-9709-a736db645218 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:42:43 user nova-compute[72444]:   <uuid>619ce0f2-51f9-4b87-9709-a736db645218</uuid>
Aug 03 04:42:43 user nova-compute[72444]:   <name>instance-0000000c</name>
Aug 03 04:42:43 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:42:43 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:42:43 user nova-compute[72444]:   <metadata>
Aug 03 04:42:43 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:42:43 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:42:43 user nova-compute[72444]:       <nova:name>tempest-ServersNegativeTestJSON-server-1126375205</nova:name>
Aug 03 04:42:43 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:42:43</nova:creationTime>
Aug 03 04:42:43 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:42:43 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:42:43 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:42:43 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:42:43 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:42:43 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:42:43 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:42:43 user nova-compute[72444]:       <nova:owner>
Aug 03 04:42:43 user nova-compute[72444]:         <nova:user uuid="f3d18e55922c4d41bea8cc96c6c7cae3">tempest-ServersNegativeTestJSON-2144635638-project-member</nova:user>
Aug 03 04:42:43 user nova-compute[72444]:         <nova:project uuid="81df940dade241e1a3560045086f8699">tempest-ServersNegativeTestJSON-2144635638</nova:project>
Aug 03 04:42:43 user nova-compute[72444]:       </nova:owner>
Aug 03 04:42:43 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:42:43 user nova-compute[72444]:       <nova:ports>
Aug 03 04:42:43 user nova-compute[72444]:         <nova:port uuid="60932a4b-e500-42ba-b61b-997a0ec85e0c">
Aug 03 04:42:43 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 03 04:42:43 user nova-compute[72444]:         </nova:port>
Aug 03 04:42:43 user nova-compute[72444]:       </nova:ports>
Aug 03 04:42:43 user nova-compute[72444]:     </nova:instance>
Aug 03 04:42:43 user nova-compute[72444]:   </metadata>
Aug 03 04:42:43 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:42:43 user nova-compute[72444]:     <system>
Aug 03 04:42:43 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:42:43 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:42:43 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:42:43 user nova-compute[72444]:       <entry name="serial">619ce0f2-51f9-4b87-9709-a736db645218</entry>
Aug 03 04:42:43 user nova-compute[72444]:       <entry name="uuid">619ce0f2-51f9-4b87-9709-a736db645218</entry>
Aug 03 04:42:43 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:42:43 user nova-compute[72444]:     </system>
Aug 03 04:42:43 user nova-compute[72444]:   </sysinfo>
Aug 03 04:42:43 user nova-compute[72444]:   <os>
Aug 03 04:42:43 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:42:43 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:42:43 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:42:43 user nova-compute[72444]:   </os>
Aug 03 04:42:43 user nova-compute[72444]:   <features>
Aug 03 04:42:43 user nova-compute[72444]:     <acpi/>
Aug 03 04:42:43 user nova-compute[72444]:     <apic/>
Aug 03 04:42:43 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:42:43 user nova-compute[72444]:   </features>
Aug 03 04:42:43 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:42:43 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:42:43 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:42:43 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:42:43 user nova-compute[72444]:   </clock>
Aug 03 04:42:43 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:42:43 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:42:43 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:42:43 user nova-compute[72444]:   </cpu>
Aug 03 04:42:43 user nova-compute[72444]:   <devices>
Aug 03 04:42:43 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:42:43 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:42:43 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/619ce0f2-51f9-4b87-9709-a736db645218/disk"/>
Aug 03 04:42:43 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:42:43 user nova-compute[72444]:     </disk>
Aug 03 04:42:43 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:42:43 user nova-compute[72444]:       <mac address="fa:16:3e:2f:31:01"/>
Aug 03 04:42:43 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:42:43 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:42:43 user nova-compute[72444]:       <target dev="tap60932a4b-e5"/>
Aug 03 04:42:43 user nova-compute[72444]:     </interface>
Aug 03 04:42:43 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:42:43 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/619ce0f2-51f9-4b87-9709-a736db645218/console.log" append="off"/>
Aug 03 04:42:43 user nova-compute[72444]:     </serial>
Aug 03 04:42:43 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:42:43 user nova-compute[72444]:     <video>
Aug 03 04:42:43 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:42:43 user nova-compute[72444]:     </video>
Aug 03 04:42:43 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:42:43 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:42:43 user nova-compute[72444]:     </rng>
Aug 03 04:42:43 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:42:43 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:42:43 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:42:43 user nova-compute[72444]:     </memballoon>
Aug 03 04:42:43 user nova-compute[72444]:   </devices>
Aug 03 04:42:43 user nova-compute[72444]: </domain>
Aug 03 04:42:43 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:42:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1126375205',display_name='tempest-ServersNegativeTestJSON-server-1126375205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1126375205',id=12,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81df940dade241e1a3560045086f8699',ramdisk_id='',reservation_id='r-6mbcm7zi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2144635638',owner_user_name='tempest-ServersNegativeTestJSON-2144635638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:42:41Z,user_data=None,user_id='f3d18e55922c4d41bea8cc96c6c7cae3',uuid=619ce0f2-51f9-4b87-9709-a736db645218,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60932a4b-e500-42ba-b61b-997a0ec85e0c", "address": "fa:16:3e:2f:31:01", "network": {"id": "6ec6c203-3446-4671-84b4-9d6a55757afb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1998429186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81df940dade241e1a3560045086f8699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60932a4b-e5", "ovs_interfaceid": "60932a4b-e500-42ba-b61b-997a0ec85e0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Converting VIF {"id": "60932a4b-e500-42ba-b61b-997a0ec85e0c", "address": "fa:16:3e:2f:31:01", "network": {"id": "6ec6c203-3446-4671-84b4-9d6a55757afb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1998429186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81df940dade241e1a3560045086f8699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60932a4b-e5", "ovs_interfaceid": "60932a4b-e500-42ba-b61b-997a0ec85e0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:31:01,bridge_name='br-int',has_traffic_filtering=True,id=60932a4b-e500-42ba-b61b-997a0ec85e0c,network=Network(6ec6c203-3446-4671-84b4-9d6a55757afb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60932a4b-e5') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG os_vif [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:31:01,bridge_name='br-int',has_traffic_filtering=True,id=60932a4b-e500-42ba-b61b-997a0ec85e0c,network=Network(6ec6c203-3446-4671-84b4-9d6a55757afb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60932a4b-e5') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60932a4b-e5, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap60932a4b-e5, col_values=(('external_ids', {'iface-id': '60932a4b-e500-42ba-b61b-997a0ec85e0c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:31:01', 'vm-uuid': '619ce0f2-51f9-4b87-9709-a736db645218'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:43 user nova-compute[72444]: INFO os_vif [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:31:01,bridge_name='br-int',has_traffic_filtering=True,id=60932a4b-e500-42ba-b61b-997a0ec85e0c,network=Network(6ec6c203-3446-4671-84b4-9d6a55757afb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60932a4b-e5')
Aug 03 04:42:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba81117e-fef4-4b0d-89ba-ba16aaeaf124/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba81117e-fef4-4b0d-89ba-ba16aaeaf124/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] No VIF found with MAC fa:16:3e:2f:31:01, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:42:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba81117e-fef4-4b0d-89ba-ba16aaeaf124/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.network.neutron [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Successfully updated port: 7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24 {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037766.856687, 619ce0f2-51f9-4b87-9709-a736db645218 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:42:47 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] VM Resumed (Lifecycle Event)
Aug 03 04:42:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.compute.manager [req-8847f8a5-29e0-433c-ac5e-6ba54e172332 req-baffdc38-dd32-408e-94e7-6f1ddbfeecaf service nova] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Received event network-changed-7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.compute.manager [req-8847f8a5-29e0-433c-ac5e-6ba54e172332 req-baffdc38-dd32-408e-94e7-6f1ddbfeecaf service nova] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Refreshing instance network info cache due to event network-changed-7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8847f8a5-29e0-433c-ac5e-6ba54e172332 req-baffdc38-dd32-408e-94e7-6f1ddbfeecaf service nova] Acquiring lock "refresh_cache-445ab78e-a1f6-4a4c-bd63-44d149f88b35" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8847f8a5-29e0-433c-ac5e-6ba54e172332 req-baffdc38-dd32-408e-94e7-6f1ddbfeecaf service nova] Acquired lock "refresh_cache-445ab78e-a1f6-4a4c-bd63-44d149f88b35" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.network.neutron [req-8847f8a5-29e0-433c-ac5e-6ba54e172332 req-baffdc38-dd32-408e-94e7-6f1ddbfeecaf service nova] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Refreshing network info cache for port 7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.compute.manager [req-87ab5233-5076-4542-bc9c-863fc61c78a0 req-5833bd73-8121-4ead-afd0-390e643193cf service nova] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Received event network-vif-plugged-60932a4b-e500-42ba-b61b-997a0ec85e0c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-87ab5233-5076-4542-bc9c-863fc61c78a0 req-5833bd73-8121-4ead-afd0-390e643193cf service nova] Acquiring lock "619ce0f2-51f9-4b87-9709-a736db645218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-87ab5233-5076-4542-bc9c-863fc61c78a0 req-5833bd73-8121-4ead-afd0-390e643193cf service nova] Lock "619ce0f2-51f9-4b87-9709-a736db645218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-87ab5233-5076-4542-bc9c-863fc61c78a0 req-5833bd73-8121-4ead-afd0-390e643193cf service nova] Lock "619ce0f2-51f9-4b87-9709-a736db645218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.compute.manager [req-87ab5233-5076-4542-bc9c-863fc61c78a0 req-5833bd73-8121-4ead-afd0-390e643193cf service nova] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] No waiting events found dispatching network-vif-plugged-60932a4b-e500-42ba-b61b-997a0ec85e0c {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:42:47 user nova-compute[72444]: WARNING nova.compute.manager [req-87ab5233-5076-4542-bc9c-863fc61c78a0 req-5833bd73-8121-4ead-afd0-390e643193cf service nova] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Received unexpected event network-vif-plugged-60932a4b-e500-42ba-b61b-997a0ec85e0c for instance with vm_state building and task_state spawning.
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.compute.manager [req-87ab5233-5076-4542-bc9c-863fc61c78a0 req-5833bd73-8121-4ead-afd0-390e643193cf service nova] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Received event network-vif-plugged-60932a4b-e500-42ba-b61b-997a0ec85e0c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-87ab5233-5076-4542-bc9c-863fc61c78a0 req-5833bd73-8121-4ead-afd0-390e643193cf service nova] Acquiring lock "619ce0f2-51f9-4b87-9709-a736db645218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-87ab5233-5076-4542-bc9c-863fc61c78a0 req-5833bd73-8121-4ead-afd0-390e643193cf service nova] Lock "619ce0f2-51f9-4b87-9709-a736db645218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-87ab5233-5076-4542-bc9c-863fc61c78a0 req-5833bd73-8121-4ead-afd0-390e643193cf service nova] Lock "619ce0f2-51f9-4b87-9709-a736db645218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.compute.manager [req-87ab5233-5076-4542-bc9c-863fc61c78a0 req-5833bd73-8121-4ead-afd0-390e643193cf service nova] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] No waiting events found dispatching network-vif-plugged-60932a4b-e500-42ba-b61b-997a0ec85e0c {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:42:47 user nova-compute[72444]: WARNING nova.compute.manager [req-87ab5233-5076-4542-bc9c-863fc61c78a0 req-5833bd73-8121-4ead-afd0-390e643193cf service nova] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Received unexpected event network-vif-plugged-60932a4b-e500-42ba-b61b-997a0ec85e0c for instance with vm_state building and task_state spawning.
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.compute.manager [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Acquiring lock "refresh_cache-445ab78e-a1f6-4a4c-bd63-44d149f88b35" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:42:47 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:42:47 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=6758MB free_disk=25.685771942138672GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:42:47 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Instance spawned successfully.
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:42:47 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037766.8582838, 619ce0f2-51f9-4b87-9709-a736db645218 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:42:47 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] VM Started (Lifecycle Event)
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.network.neutron [req-8847f8a5-29e0-433c-ac5e-6ba54e172332 req-baffdc38-dd32-408e-94e7-6f1ddbfeecaf service nova] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:42:47 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:42:47 user nova-compute[72444]: INFO nova.compute.manager [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Took 6.59 seconds to spawn the instance on the hypervisor.
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.compute.manager [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 81725845-6158-4e34-bedb-6e41219bc227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance b6ed9c42-fa6e-4a0d-8312-588471e157f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 85521338-f660-49ab-a3ab-9eb6df7a7353 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance e3089887-56df-42de-bc62-88e6db28daf0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance e2859322-6f99-442d-bee1-65fe49ce6360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 07450ea8-cb80-4318-9fc9-4268944d2cae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 4d5c0324-68e8-4f0a-a740-0b4551e81fac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 42f131f8-83ac-4fd4-b056-f8dac3d32c55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance ba81117e-fef4-4b0d-89ba-ba16aaeaf124 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 619ce0f2-51f9-4b87-9709-a736db645218 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 445ab78e-a1f6-4a4c-bd63-44d149f88b35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.network.neutron [req-654d3658-02c3-489c-bdee-6780e9402f03 req-ebb771ae-6090-436d-9058-6d973d972a97 service nova] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Updated VIF entry in instance network info cache for port 60932a4b-e500-42ba-b61b-997a0ec85e0c. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.network.neutron [req-654d3658-02c3-489c-bdee-6780e9402f03 req-ebb771ae-6090-436d-9058-6d973d972a97 service nova] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Updating instance_info_cache with network_info: [{"id": "60932a4b-e500-42ba-b61b-997a0ec85e0c", "address": "fa:16:3e:2f:31:01", "network": {"id": "6ec6c203-3446-4671-84b4-9d6a55757afb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1998429186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81df940dade241e1a3560045086f8699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60932a4b-e5", "ovs_interfaceid": "60932a4b-e500-42ba-b61b-997a0ec85e0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-654d3658-02c3-489c-bdee-6780e9402f03 req-ebb771ae-6090-436d-9058-6d973d972a97 service nova] Releasing lock "refresh_cache-619ce0f2-51f9-4b87-9709-a736db645218" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:42:47 user nova-compute[72444]: INFO nova.compute.manager [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Took 7.84 seconds to build instance.
Aug 03 04:42:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-54048e87-f247-4e29-800a-2a4b8072189e tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Lock "619ce0f2-51f9-4b87-9709-a736db645218" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.016s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.network.neutron [req-8847f8a5-29e0-433c-ac5e-6ba54e172332 req-baffdc38-dd32-408e-94e7-6f1ddbfeecaf service nova] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8847f8a5-29e0-433c-ac5e-6ba54e172332 req-baffdc38-dd32-408e-94e7-6f1ddbfeecaf service nova] Releasing lock "refresh_cache-445ab78e-a1f6-4a4c-bd63-44d149f88b35" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Acquired lock "refresh_cache-445ab78e-a1f6-4a4c-bd63-44d149f88b35" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.network.neutron [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:42:47 user nova-compute[72444]: DEBUG nova.network.neutron [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.811s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG nova.network.neutron [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Updating instance_info_cache with network_info: [{"id": "7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24", "address": "fa:16:3e:27:2b:3b", "network": {"id": "23b52932-5969-4b02-8d35-6cbc7f007838", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1885096873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c520dc44eff4401789ef1ff61cc24cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b3b54c1-f1", "ovs_interfaceid": "7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Releasing lock "refresh_cache-445ab78e-a1f6-4a4c-bd63-44d149f88b35" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG nova.compute.manager [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Instance network_info: |[{"id": "7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24", "address": "fa:16:3e:27:2b:3b", "network": {"id": "23b52932-5969-4b02-8d35-6cbc7f007838", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1885096873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c520dc44eff4401789ef1ff61cc24cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b3b54c1-f1", "ovs_interfaceid": "7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Start _get_guest_xml network_info=[{"id": "7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24", "address": "fa:16:3e:27:2b:3b", "network": {"id": "23b52932-5969-4b02-8d35-6cbc7f007838", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1885096873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c520dc44eff4401789ef1ff61cc24cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b3b54c1-f1", "ovs_interfaceid": "7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:42:48 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:42:48 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:42:48 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-407780263',display_name='tempest-VolumesActionsTest-instance-407780263',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-407780263',id=13,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c520dc44eff4401789ef1ff61cc24cd4',ramdisk_id='',reservation_id='r-asomca4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-684402275',owner_user_name='tempest-VolumesActionsTest-684402275-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:42:42Z,user_data=None,user_id='099a590e90f043cba5b076c8dd75999d',uuid=445ab78e-a1f6-4a4c-bd63-44d149f88b35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24", "address": "fa:16:3e:27:2b:3b", "network": {"id": "23b52932-5969-4b02-8d35-6cbc7f007838", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1885096873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c520dc44eff4401789ef1ff61cc24cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b3b54c1-f1", "ovs_interfaceid": "7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Converting VIF {"id": "7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24", "address": "fa:16:3e:27:2b:3b", "network": {"id": "23b52932-5969-4b02-8d35-6cbc7f007838", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1885096873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c520dc44eff4401789ef1ff61cc24cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b3b54c1-f1", "ovs_interfaceid": "7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:2b:3b,bridge_name='br-int',has_traffic_filtering=True,id=7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24,network=Network(23b52932-5969-4b02-8d35-6cbc7f007838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b3b54c1-f1') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG nova.objects.instance [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Lazy-loading 'pci_devices' on Instance uuid 445ab78e-a1f6-4a4c-bd63-44d149f88b35 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:42:48 user nova-compute[72444]:   <uuid>445ab78e-a1f6-4a4c-bd63-44d149f88b35</uuid>
Aug 03 04:42:48 user nova-compute[72444]:   <name>instance-0000000d</name>
Aug 03 04:42:48 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:42:48 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:42:48 user nova-compute[72444]:   <metadata>
Aug 03 04:42:48 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:42:48 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:42:48 user nova-compute[72444]:       <nova:name>tempest-VolumesActionsTest-instance-407780263</nova:name>
Aug 03 04:42:48 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:42:48</nova:creationTime>
Aug 03 04:42:48 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:42:48 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:42:48 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:42:48 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:42:48 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:42:48 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:42:48 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:42:48 user nova-compute[72444]:       <nova:owner>
Aug 03 04:42:48 user nova-compute[72444]:         <nova:user uuid="099a590e90f043cba5b076c8dd75999d">tempest-VolumesActionsTest-684402275-project-member</nova:user>
Aug 03 04:42:48 user nova-compute[72444]:         <nova:project uuid="c520dc44eff4401789ef1ff61cc24cd4">tempest-VolumesActionsTest-684402275</nova:project>
Aug 03 04:42:48 user nova-compute[72444]:       </nova:owner>
Aug 03 04:42:48 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:42:48 user nova-compute[72444]:       <nova:ports>
Aug 03 04:42:48 user nova-compute[72444]:         <nova:port uuid="7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24">
Aug 03 04:42:48 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 03 04:42:48 user nova-compute[72444]:         </nova:port>
Aug 03 04:42:48 user nova-compute[72444]:       </nova:ports>
Aug 03 04:42:48 user nova-compute[72444]:     </nova:instance>
Aug 03 04:42:48 user nova-compute[72444]:   </metadata>
Aug 03 04:42:48 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:42:48 user nova-compute[72444]:     <system>
Aug 03 04:42:48 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:42:48 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:42:48 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:42:48 user nova-compute[72444]:       <entry name="serial">445ab78e-a1f6-4a4c-bd63-44d149f88b35</entry>
Aug 03 04:42:48 user nova-compute[72444]:       <entry name="uuid">445ab78e-a1f6-4a4c-bd63-44d149f88b35</entry>
Aug 03 04:42:48 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:42:48 user nova-compute[72444]:     </system>
Aug 03 04:42:48 user nova-compute[72444]:   </sysinfo>
Aug 03 04:42:48 user nova-compute[72444]:   <os>
Aug 03 04:42:48 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:42:48 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:42:48 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:42:48 user nova-compute[72444]:   </os>
Aug 03 04:42:48 user nova-compute[72444]:   <features>
Aug 03 04:42:48 user nova-compute[72444]:     <acpi/>
Aug 03 04:42:48 user nova-compute[72444]:     <apic/>
Aug 03 04:42:48 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:42:48 user nova-compute[72444]:   </features>
Aug 03 04:42:48 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:42:48 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:42:48 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:42:48 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:42:48 user nova-compute[72444]:   </clock>
Aug 03 04:42:48 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:42:48 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:42:48 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:42:48 user nova-compute[72444]:   </cpu>
Aug 03 04:42:48 user nova-compute[72444]:   <devices>
Aug 03 04:42:48 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:42:48 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:42:48 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/445ab78e-a1f6-4a4c-bd63-44d149f88b35/disk"/>
Aug 03 04:42:48 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:42:48 user nova-compute[72444]:     </disk>
Aug 03 04:42:48 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:42:48 user nova-compute[72444]:       <mac address="fa:16:3e:27:2b:3b"/>
Aug 03 04:42:48 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:42:48 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:42:48 user nova-compute[72444]:       <target dev="tap7b3b54c1-f1"/>
Aug 03 04:42:48 user nova-compute[72444]:     </interface>
Aug 03 04:42:48 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:42:48 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/445ab78e-a1f6-4a4c-bd63-44d149f88b35/console.log" append="off"/>
Aug 03 04:42:48 user nova-compute[72444]:     </serial>
Aug 03 04:42:48 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:42:48 user nova-compute[72444]:     <video>
Aug 03 04:42:48 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:42:48 user nova-compute[72444]:     </video>
Aug 03 04:42:48 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:42:48 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:42:48 user nova-compute[72444]:     </rng>
Aug 03 04:42:48 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:42:48 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:42:48 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:42:48 user nova-compute[72444]:     </memballoon>
Aug 03 04:42:48 user nova-compute[72444]:   </devices>
Aug 03 04:42:48 user nova-compute[72444]: </domain>
Aug 03 04:42:48 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-407780263',display_name='tempest-VolumesActionsTest-instance-407780263',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-407780263',id=13,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c520dc44eff4401789ef1ff61cc24cd4',ramdisk_id='',reservation_id='r-asomca4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-684402275',owner_user_name='tempest-VolumesActionsTest-684402275-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:42:42Z,user_data=None,user_id='099a590e90f043cba5b076c8dd75999d',uuid=445ab78e-a1f6-4a4c-bd63-44d149f88b35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24", "address": "fa:16:3e:27:2b:3b", "network": {"id": "23b52932-5969-4b02-8d35-6cbc7f007838", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1885096873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c520dc44eff4401789ef1ff61cc24cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b3b54c1-f1", "ovs_interfaceid": "7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Converting VIF {"id": "7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24", "address": "fa:16:3e:27:2b:3b", "network": {"id": "23b52932-5969-4b02-8d35-6cbc7f007838", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1885096873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c520dc44eff4401789ef1ff61cc24cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b3b54c1-f1", "ovs_interfaceid": "7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:2b:3b,bridge_name='br-int',has_traffic_filtering=True,id=7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24,network=Network(23b52932-5969-4b02-8d35-6cbc7f007838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b3b54c1-f1') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG os_vif [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:2b:3b,bridge_name='br-int',has_traffic_filtering=True,id=7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24,network=Network(23b52932-5969-4b02-8d35-6cbc7f007838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b3b54c1-f1') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b3b54c1-f1, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7b3b54c1-f1, col_values=(('external_ids', {'iface-id': '7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:2b:3b', 'vm-uuid': '445ab78e-a1f6-4a4c-bd63-44d149f88b35'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:48 user nova-compute[72444]: INFO os_vif [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:2b:3b,bridge_name='br-int',has_traffic_filtering=True,id=7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24,network=Network(23b52932-5969-4b02-8d35-6cbc7f007838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b3b54c1-f1')
Aug 03 04:42:48 user nova-compute[72444]: DEBUG nova.compute.manager [req-f126d4bc-0520-4858-89c4-a2f7c24b3439 req-bb25a8c0-ba28-477c-b30f-fae8c235d1d2 service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Received event network-changed-269c2e0d-94ee-4084-985a-58c5afed4411 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG nova.compute.manager [req-f126d4bc-0520-4858-89c4-a2f7c24b3439 req-bb25a8c0-ba28-477c-b30f-fae8c235d1d2 service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Refreshing instance network info cache due to event network-changed-269c2e0d-94ee-4084-985a-58c5afed4411. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f126d4bc-0520-4858-89c4-a2f7c24b3439 req-bb25a8c0-ba28-477c-b30f-fae8c235d1d2 service nova] Acquiring lock "refresh_cache-e2859322-6f99-442d-bee1-65fe49ce6360" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f126d4bc-0520-4858-89c4-a2f7c24b3439 req-bb25a8c0-ba28-477c-b30f-fae8c235d1d2 service nova] Acquired lock "refresh_cache-e2859322-6f99-442d-bee1-65fe49ce6360" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG nova.network.neutron [req-f126d4bc-0520-4858-89c4-a2f7c24b3439 req-bb25a8c0-ba28-477c-b30f-fae8c235d1d2 service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Refreshing network info cache for port 269c2e0d-94ee-4084-985a-58c5afed4411 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] No VIF found with MAC fa:16:3e:27:2b:3b, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:42:48 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:49 user nova-compute[72444]: DEBUG nova.network.neutron [req-f126d4bc-0520-4858-89c4-a2f7c24b3439 req-bb25a8c0-ba28-477c-b30f-fae8c235d1d2 service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Updated VIF entry in instance network info cache for port 269c2e0d-94ee-4084-985a-58c5afed4411. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:42:49 user nova-compute[72444]: DEBUG nova.network.neutron [req-f126d4bc-0520-4858-89c4-a2f7c24b3439 req-bb25a8c0-ba28-477c-b30f-fae8c235d1d2 service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Updating instance_info_cache with network_info: [{"id": "269c2e0d-94ee-4084-985a-58c5afed4411", "address": "fa:16:3e:bd:11:20", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap269c2e0d-94", "ovs_interfaceid": "269c2e0d-94ee-4084-985a-58c5afed4411", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:42:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f126d4bc-0520-4858-89c4-a2f7c24b3439 req-bb25a8c0-ba28-477c-b30f-fae8c235d1d2 service nova] Releasing lock "refresh_cache-e2859322-6f99-442d-bee1-65fe49ce6360" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:42:49 user nova-compute[72444]: DEBUG nova.compute.manager [req-98342595-330c-409e-8cb5-ff45399c2574 req-059930d3-b70b-44ec-92f3-b78d1f59aef4 service nova] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Received event network-changed-fcb29ef9-b342-48cf-9fab-165ea205728f {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:42:49 user nova-compute[72444]: DEBUG nova.compute.manager [req-98342595-330c-409e-8cb5-ff45399c2574 req-059930d3-b70b-44ec-92f3-b78d1f59aef4 service nova] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Refreshing instance network info cache due to event network-changed-fcb29ef9-b342-48cf-9fab-165ea205728f. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:42:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-98342595-330c-409e-8cb5-ff45399c2574 req-059930d3-b70b-44ec-92f3-b78d1f59aef4 service nova] Acquiring lock "refresh_cache-07450ea8-cb80-4318-9fc9-4268944d2cae" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:42:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-98342595-330c-409e-8cb5-ff45399c2574 req-059930d3-b70b-44ec-92f3-b78d1f59aef4 service nova] Acquired lock "refresh_cache-07450ea8-cb80-4318-9fc9-4268944d2cae" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:42:49 user nova-compute[72444]: DEBUG nova.network.neutron [req-98342595-330c-409e-8cb5-ff45399c2574 req-059930d3-b70b-44ec-92f3-b78d1f59aef4 service nova] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Refreshing network info cache for port fcb29ef9-b342-48cf-9fab-165ea205728f {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:42:49 user nova-compute[72444]: DEBUG nova.network.neutron [req-98342595-330c-409e-8cb5-ff45399c2574 req-059930d3-b70b-44ec-92f3-b78d1f59aef4 service nova] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Updated VIF entry in instance network info cache for port fcb29ef9-b342-48cf-9fab-165ea205728f. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:42:49 user nova-compute[72444]: DEBUG nova.network.neutron [req-98342595-330c-409e-8cb5-ff45399c2574 req-059930d3-b70b-44ec-92f3-b78d1f59aef4 service nova] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Updating instance_info_cache with network_info: [{"id": "fcb29ef9-b342-48cf-9fab-165ea205728f", "address": "fa:16:3e:26:71:73", "network": {"id": "f0b4a33e-e079-4817-8747-412ca56818fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1198621443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6037670c8c6450bb3663e55b50c6dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb29ef9-b3", "ovs_interfaceid": "fcb29ef9-b342-48cf-9fab-165ea205728f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:42:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-98342595-330c-409e-8cb5-ff45399c2574 req-059930d3-b70b-44ec-92f3-b78d1f59aef4 service nova] Releasing lock "refresh_cache-07450ea8-cb80-4318-9fc9-4268944d2cae" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:42:50 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:42:50 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 04:42:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-81725845-6158-4e34-bedb-6e41219bc227" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:42:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-81725845-6158-4e34-bedb-6e41219bc227" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:42:50 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 04:42:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:51 user nova-compute[72444]: DEBUG nova.compute.manager [req-a5fdfcb3-213b-4b1e-ac55-a25d4b378854 req-8323bd4a-d6e1-4ac2-b2c0-86f199cc595b service nova] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Received event network-vif-plugged-7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:42:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a5fdfcb3-213b-4b1e-ac55-a25d4b378854 req-8323bd4a-d6e1-4ac2-b2c0-86f199cc595b service nova] Acquiring lock "445ab78e-a1f6-4a4c-bd63-44d149f88b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:42:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a5fdfcb3-213b-4b1e-ac55-a25d4b378854 req-8323bd4a-d6e1-4ac2-b2c0-86f199cc595b service nova] Lock "445ab78e-a1f6-4a4c-bd63-44d149f88b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:42:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a5fdfcb3-213b-4b1e-ac55-a25d4b378854 req-8323bd4a-d6e1-4ac2-b2c0-86f199cc595b service nova] Lock "445ab78e-a1f6-4a4c-bd63-44d149f88b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:42:51 user nova-compute[72444]: DEBUG nova.compute.manager [req-a5fdfcb3-213b-4b1e-ac55-a25d4b378854 req-8323bd4a-d6e1-4ac2-b2c0-86f199cc595b service nova] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] No waiting events found dispatching network-vif-plugged-7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:42:51 user nova-compute[72444]: WARNING nova.compute.manager [req-a5fdfcb3-213b-4b1e-ac55-a25d4b378854 req-8323bd4a-d6e1-4ac2-b2c0-86f199cc595b service nova] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Received unexpected event network-vif-plugged-7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24 for instance with vm_state building and task_state spawning.
Aug 03 04:42:51 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Updating instance_info_cache with network_info: [{"id": "9b1b9675-c2df-4b16-ba94-807765bab119", "address": "fa:16:3e:e6:7a:2e", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b1b9675-c2", "ovs_interfaceid": "9b1b9675-c2df-4b16-ba94-807765bab119", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:42:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-81725845-6158-4e34-bedb-6e41219bc227" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:42:51 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 04:42:51 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:42:51 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:42:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:42:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:42:51 user nova-compute[72444]: DEBUG os_brick.initiator.connector [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Factory for ISCSI on None {{(pid=72444) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Aug 03 04:42:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.015s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:42:51 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:42:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NipJhmAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:42:51 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:42:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:42:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:42:51 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:42:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:42:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:42:51 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:42:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:51 user nova-compute[72444]: DEBUG nova.compute.manager [req-b8600e2e-34fb-4928-b4f3-b4b7156a7f7e req-1e6ee678-ea34-468d-9da2-f24bf95cbd16 service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Received event network-changed-841a11a2-ffb3-44cf-9e15-c8099578d405 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:42:51 user nova-compute[72444]: DEBUG nova.compute.manager [req-b8600e2e-34fb-4928-b4f3-b4b7156a7f7e req-1e6ee678-ea34-468d-9da2-f24bf95cbd16 service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Refreshing instance network info cache due to event network-changed-841a11a2-ffb3-44cf-9e15-c8099578d405. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:42:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b8600e2e-34fb-4928-b4f3-b4b7156a7f7e req-1e6ee678-ea34-468d-9da2-f24bf95cbd16 service nova] Acquiring lock "refresh_cache-7daab2c6-8768-46ed-a7bb-0ffbd107cf82" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:42:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b8600e2e-34fb-4928-b4f3-b4b7156a7f7e req-1e6ee678-ea34-468d-9da2-f24bf95cbd16 service nova] Acquired lock "refresh_cache-7daab2c6-8768-46ed-a7bb-0ffbd107cf82" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:42:51 user nova-compute[72444]: DEBUG nova.network.neutron [req-b8600e2e-34fb-4928-b4f3-b4b7156a7f7e req-1e6ee678-ea34-468d-9da2-f24bf95cbd16 service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Refreshing network info cache for port 841a11a2-ffb3-44cf-9e15-c8099578d405 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:42:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:51 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacaae3c-1b51-4f47-9a7b-8c5bd95e17e8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:42:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 04:42:51 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:42:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702 -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:51 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7188ba4-670d-4fbb-9bd4-0aa51b6dcc65]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:42:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702] added
Aug 03 04:42:51 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:42:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87a3d86-e4cb-426d-9389-741a4a7e8d9b]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be85bfc-cca5-4b7a-b5f2-dcedf4a0c22a]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NipJhmAt {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NipJhmAt" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfabc92-1191-4875-8472-c5ac18a8e26b]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NipJhmAt'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf826b2-f910-489b-8455-da853ba00c02]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.025s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20f9afa-0144-4424-b8ff-7bd0ad4f87f4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 03 04:42:52 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 03 04:42:52 user nova-compute[72444]:  {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:42:52 user nova-compute[72444]: WARNING os_brick.initiator.connectors.iscsi [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 03 04:42:52 user nova-compute[72444]: 
Aug 03 04:42:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702 -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a93a8d6-073b-4994-8e74-e44695036872]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702, portal: 172.16.0.220,3260]
Aug 03 04:42:52 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702, portal: 172.16.0.220,3260] successful.
Aug 03 04:42:52 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ec94b4-265a-483a-84f2-5489715b8b53]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[50204af6-eb2a-4ae6-8f24-7036bbf4716b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702 (non-flash)
Aug 03 04:42:52 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702 (non-flash)
Aug 03 04:42:52 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.030s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3d839e-af80-4dd8-82c5-d5b255fad0e0]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NipJhmAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG nova.network.neutron [req-b8600e2e-34fb-4928-b4f3-b4b7156a7f7e req-1e6ee678-ea34-468d-9da2-f24bf95cbd16 service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Updated VIF entry in instance network info cache for port 841a11a2-ffb3-44cf-9e15-c8099578d405. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG nova.network.neutron [req-b8600e2e-34fb-4928-b4f3-b4b7156a7f7e req-1e6ee678-ea34-468d-9da2-f24bf95cbd16 service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Updating instance_info_cache with network_info: [{"id": "841a11a2-ffb3-44cf-9e15-c8099578d405", "address": "fa:16:3e:12:4d:37", "network": {"id": "628fbd1c-7104-4911-9eb9-1f38c394bebd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-366258398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a65efd00e0ac4039bf1d6429787b8595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841a11a2-ff", "ovs_interfaceid": "841a11a2-ffb3-44cf-9e15-c8099578d405", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037772.6690993, 445ab78e-a1f6-4a4c-bd63-44d149f88b35 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:42:52 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] VM Resumed (Lifecycle Event)
Aug 03 04:42:52 user nova-compute[72444]: DEBUG nova.compute.manager [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b8600e2e-34fb-4928-b4f3-b4b7156a7f7e req-1e6ee678-ea34-468d-9da2-f24bf95cbd16 service nova] Releasing lock "refresh_cache-7daab2c6-8768-46ed-a7bb-0ffbd107cf82" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:42:52 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Instance spawned successfully.
Aug 03 04:42:52 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:42:52 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:42:52 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037772.6727486, 445ab78e-a1f6-4a4c-bd63-44d149f88b35 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:42:52 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] VM Started (Lifecycle Event)
Aug 03 04:42:52 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:42:52 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:42:52 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:42:52 user nova-compute[72444]: INFO nova.compute.manager [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Took 10.88 seconds to spawn the instance on the hypervisor.
Aug 03 04:42:52 user nova-compute[72444]: DEBUG nova.compute.manager [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:42:52 user nova-compute[72444]: INFO nova.compute.manager [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Took 12.20 seconds to build instance.
Aug 03 04:42:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4b19df8c-919c-4be3-acd7-cdea9f0edd98 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Lock "445ab78e-a1f6-4a4c-bd63-44d149f88b35" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.311s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:42:53 user nova-compute[72444]: DEBUG nova.compute.manager [req-e2d714c7-fef2-4d1b-8609-dae4a06dd512 req-df363dca-cb66-4f80-901a-1dbaecf673fa service nova] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Received event network-vif-plugged-7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:42:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e2d714c7-fef2-4d1b-8609-dae4a06dd512 req-df363dca-cb66-4f80-901a-1dbaecf673fa service nova] Acquiring lock "445ab78e-a1f6-4a4c-bd63-44d149f88b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:42:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e2d714c7-fef2-4d1b-8609-dae4a06dd512 req-df363dca-cb66-4f80-901a-1dbaecf673fa service nova] Lock "445ab78e-a1f6-4a4c-bd63-44d149f88b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:42:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e2d714c7-fef2-4d1b-8609-dae4a06dd512 req-df363dca-cb66-4f80-901a-1dbaecf673fa service nova] Lock "445ab78e-a1f6-4a4c-bd63-44d149f88b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:42:53 user nova-compute[72444]: DEBUG nova.compute.manager [req-e2d714c7-fef2-4d1b-8609-dae4a06dd512 req-df363dca-cb66-4f80-901a-1dbaecf673fa service nova] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] No waiting events found dispatching network-vif-plugged-7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:42:53 user nova-compute[72444]: WARNING nova.compute.manager [req-e2d714c7-fef2-4d1b-8609-dae4a06dd512 req-df363dca-cb66-4f80-901a-1dbaecf673fa service nova] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Received unexpected event network-vif-plugged-7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24 for instance with vm_state active and task_state None.
Aug 03 04:42:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:42:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23038623666626631', 'path': '/dev/sdb'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:42:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038623666626631', 'path': '/dev/sdb'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:42:53 user nova-compute[72444]: DEBUG nova.objects.instance [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Lazy-loading 'flavor' on Instance uuid 85521338-f660-49ab-a3ab-9eb6df7a7353 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:42:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 04:42:53 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:42:53 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 04:42:53 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:42:53 user nova-compute[72444]:   <serial>a912316e-c202-4d71-86b9-ca39e5d88702</serial>
Aug 03 04:42:53 user nova-compute[72444]: </disk>
Aug 03 04:42:53 user nova-compute[72444]:  {{(pid=72444) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 04:42:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:42:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:42:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] No VIF found with MAC fa:16:3e:cf:20:74, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:42:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c2a196d0-7369-482f-9b16-10cfa2e529ef tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Lock "85521338-f660-49ab-a3ab-9eb6df7a7353" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.221s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:42:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Acquiring lock "85521338-f660-49ab-a3ab-9eb6df7a7353" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:42:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Lock "85521338-f660-49ab-a3ab-9eb6df7a7353" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:42:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Acquiring lock "85521338-f660-49ab-a3ab-9eb6df7a7353-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:42:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Lock "85521338-f660-49ab-a3ab-9eb6df7a7353-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:42:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Lock "85521338-f660-49ab-a3ab-9eb6df7a7353-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:42:54 user nova-compute[72444]: INFO nova.compute.manager [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Terminating instance
Aug 03 04:42:54 user nova-compute[72444]: DEBUG nova.compute.manager [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 04:42:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:55 user nova-compute[72444]: DEBUG nova.compute.manager [req-e97fbdac-2556-4b7d-a4aa-7ea55daf3f61 req-ef3f2aa6-2e13-4d87-b298-30a9a6e3f604 service nova] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Received event network-vif-unplugged-19cfd924-3dff-4024-97c6-285ac53c1fcd {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:42:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e97fbdac-2556-4b7d-a4aa-7ea55daf3f61 req-ef3f2aa6-2e13-4d87-b298-30a9a6e3f604 service nova] Acquiring lock "85521338-f660-49ab-a3ab-9eb6df7a7353-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:42:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e97fbdac-2556-4b7d-a4aa-7ea55daf3f61 req-ef3f2aa6-2e13-4d87-b298-30a9a6e3f604 service nova] Lock "85521338-f660-49ab-a3ab-9eb6df7a7353-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:42:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e97fbdac-2556-4b7d-a4aa-7ea55daf3f61 req-ef3f2aa6-2e13-4d87-b298-30a9a6e3f604 service nova] Lock "85521338-f660-49ab-a3ab-9eb6df7a7353-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:42:55 user nova-compute[72444]: DEBUG nova.compute.manager [req-e97fbdac-2556-4b7d-a4aa-7ea55daf3f61 req-ef3f2aa6-2e13-4d87-b298-30a9a6e3f604 service nova] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] No waiting events found dispatching network-vif-unplugged-19cfd924-3dff-4024-97c6-285ac53c1fcd {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:42:55 user nova-compute[72444]: DEBUG nova.compute.manager [req-e97fbdac-2556-4b7d-a4aa-7ea55daf3f61 req-ef3f2aa6-2e13-4d87-b298-30a9a6e3f604 service nova] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Received event network-vif-unplugged-19cfd924-3dff-4024-97c6-285ac53c1fcd for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:42:55 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Instance destroyed successfully.
Aug 03 04:42:55 user nova-compute[72444]: DEBUG nova.objects.instance [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Lazy-loading 'resources' on Instance uuid 85521338-f660-49ab-a3ab-9eb6df7a7353 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:42:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:40:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1899651228',display_name='tempest-DeleteServersTestJSON-server-1899651228',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1899651228',id=4,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:41:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e67b7c5d89c244a19f95cc3fc4f33695',ramdisk_id='',reservation_id='r-c4q9jecn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-96824376',owner_user_name='tempest-DeleteServersTestJSON-96824376-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:41:06Z,user_data=None,user_id='9e32c358290a4170be682ac98bf2e17d',uuid=85521338-f660-49ab-a3ab-9eb6df7a7353,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19cfd924-3dff-4024-97c6-285ac53c1fcd", "address": "fa:16:3e:cf:20:74", "network": {"id": "5df96f95-b1db-4ea0-af6a-5b52bbed0063", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-562110281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e67b7c5d89c244a19f95cc3fc4f33695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19cfd924-3d", "ovs_interfaceid": "19cfd924-3dff-4024-97c6-285ac53c1fcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:42:55 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Converting VIF {"id": "19cfd924-3dff-4024-97c6-285ac53c1fcd", "address": "fa:16:3e:cf:20:74", "network": {"id": "5df96f95-b1db-4ea0-af6a-5b52bbed0063", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-562110281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e67b7c5d89c244a19f95cc3fc4f33695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19cfd924-3d", "ovs_interfaceid": "19cfd924-3dff-4024-97c6-285ac53c1fcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:42:55 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:20:74,bridge_name='br-int',has_traffic_filtering=True,id=19cfd924-3dff-4024-97c6-285ac53c1fcd,network=Network(5df96f95-b1db-4ea0-af6a-5b52bbed0063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19cfd924-3d') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:42:55 user nova-compute[72444]: DEBUG os_vif [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:20:74,bridge_name='br-int',has_traffic_filtering=True,id=19cfd924-3dff-4024-97c6-285ac53c1fcd,network=Network(5df96f95-b1db-4ea0-af6a-5b52bbed0063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19cfd924-3d') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:42:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19cfd924-3d, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:42:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:42:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:42:55 user nova-compute[72444]: INFO os_vif [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:20:74,bridge_name='br-int',has_traffic_filtering=True,id=19cfd924-3dff-4024-97c6-285ac53c1fcd,network=Network(5df96f95-b1db-4ea0-af6a-5b52bbed0063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19cfd924-3d')
Aug 03 04:42:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:42:55 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NipJhmAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:42:55 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:42:55 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:42:55 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:42:55 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:42:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:55 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c51b6a6-71ee-41c7-9d73-f5d84fc659a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:42:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:55 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf02ab9f-10d5-4c38-84a4-7087e7df96a8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:42:55 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702 (non-flash)
Aug 03 04:42:55 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:42:55 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702 (non-flash)
Aug 03 04:42:55 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:42:55 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30a0f31750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702'): ({'sdb'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:42:55 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Removing single pathed devices sdb {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 04:42:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:55 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb4f7cb-86e7-47a7-8ba7-a1daa1fecc5b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:42:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:56 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac75d77c-3dd2-44bb-9993-24febccc54c9]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:42:56 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Flushing IO for device /dev/sdb {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 04:42:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:56 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadeea7b-e1d4-4e56-811a-0d364a97c9cd]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:42:56 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 04:42:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:56 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6962c97-02f9-4f1b-9e28-0448e8aa0ac0]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:42:56 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 04:42:56 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 04:42:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:42:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:56 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88acdbb-b533-4c50-9e35-6fc7c25dde99]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:42:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:42:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702 -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:42:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:42:56 user nova-compute[72444]: DEBUG nova.objects.instance [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lazy-loading 'flavor' on Instance uuid 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:42:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:56 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb105486-2827-41b6-b58c-2f446f4d42e1]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:42:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702, portal: 172.16.0.220,3260]
Aug 03 04:42:56 user nova-compute[72444]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702, portal: 172.16.0.220,3260] successful.
Aug 03 04:42:56 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:42:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702 -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a912316e-c202-4d71-86b9-ca39e5d88702 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:56 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[31af9d03-e671-4e74-b14e-ebbe7d1b790a]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:42:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:42:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:42:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] <== disconnect_volume: return (326ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:42:56 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:42:56 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Deleting instance files /opt/stack/data/nova/instances/85521338-f660-49ab-a3ab-9eb6df7a7353_del
Aug 03 04:42:56 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Deletion of /opt/stack/data/nova/instances/85521338-f660-49ab-a3ab-9eb6df7a7353_del complete
Aug 03 04:42:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.126s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:42:56 user nova-compute[72444]: INFO nova.compute.manager [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Took 1.44 seconds to destroy the instance on the hypervisor.
Aug 03 04:42:56 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 04:42:56 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 04:42:56 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 04:42:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:42:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:42:56 user nova-compute[72444]: INFO nova.compute.manager [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Attaching volume cd7ca08c-42db-4007-a06b-e327179ac574 to /dev/vdb
Aug 03 04:42:56 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:42:56 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Took 0.59 seconds to deallocate network for instance.
Aug 03 04:42:56 user nova-compute[72444]: DEBUG nova.compute.manager [req-0798bb43-48d9-4d0a-8a6a-ea3bd036d118 req-777219d5-8f1f-4495-9961-92dd69e0bd79 service nova] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Received event network-vif-deleted-19cfd924-3dff-4024-97c6-285ac53c1fcd {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:42:56 user nova-compute[72444]: INFO nova.compute.manager [req-0798bb43-48d9-4d0a-8a6a-ea3bd036d118 req-777219d5-8f1f-4495-9961-92dd69e0bd79 service nova] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Neutron deleted interface 19cfd924-3dff-4024-97c6-285ac53c1fcd; detaching it from the instance and deleting it from the info cache
Aug 03 04:42:56 user nova-compute[72444]: DEBUG nova.network.neutron [req-0798bb43-48d9-4d0a-8a6a-ea3bd036d118 req-777219d5-8f1f-4495-9961-92dd69e0bd79 service nova] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:42:56 user nova-compute[72444]: DEBUG os_brick.utils [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:42:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:56 user nova-compute[72444]: DEBUG nova.compute.manager [req-0798bb43-48d9-4d0a-8a6a-ea3bd036d118 req-777219d5-8f1f-4495-9961-92dd69e0bd79 service nova] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Detach interface failed, port_id=19cfd924-3dff-4024-97c6-285ac53c1fcd, reason: Instance 85521338-f660-49ab-a3ab-9eb6df7a7353 could not be found. {{(pid=72444) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 03 04:42:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:57 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61f7a91-e8ce-4419-b563-df2a4b4942b3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:42:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:57 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[728acc2a-f394-4d65-8d79-9ad2ede5337e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:42:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:42:57 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[19631ddc-db46-4cc4-adc5-d63ea01268ed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:42:57 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c4eaa7-3137-4fcf-9c4c-eddbe9be78b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:42:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:42:57 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 04:42:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:42:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:42:57 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 04:42:57 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f97985f-d501-45e2-9a45-7105a5bde8ad]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:42:57 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 04:42:57 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 04:42:57 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 04:42:57 user nova-compute[72444]: DEBUG os_brick.utils [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:42:57 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Updating existing volume attachment record: 375331ab-d25a-47bb-bd1d-e038e8a4d350 {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 04:42:57 user nova-compute[72444]: DEBUG nova.compute.manager [req-ae969485-edf6-461c-99e0-3f5d6200396e req-90db07f9-799e-4ab0-9c2c-a022912d1524 service nova] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Received event network-vif-plugged-19cfd924-3dff-4024-97c6-285ac53c1fcd {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:42:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ae969485-edf6-461c-99e0-3f5d6200396e req-90db07f9-799e-4ab0-9c2c-a022912d1524 service nova] Acquiring lock "85521338-f660-49ab-a3ab-9eb6df7a7353-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:42:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ae969485-edf6-461c-99e0-3f5d6200396e req-90db07f9-799e-4ab0-9c2c-a022912d1524 service nova] Lock "85521338-f660-49ab-a3ab-9eb6df7a7353-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:42:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ae969485-edf6-461c-99e0-3f5d6200396e req-90db07f9-799e-4ab0-9c2c-a022912d1524 service nova] Lock "85521338-f660-49ab-a3ab-9eb6df7a7353-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:42:57 user nova-compute[72444]: DEBUG nova.compute.manager [req-ae969485-edf6-461c-99e0-3f5d6200396e req-90db07f9-799e-4ab0-9c2c-a022912d1524 service nova] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] No waiting events found dispatching network-vif-plugged-19cfd924-3dff-4024-97c6-285ac53c1fcd {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:42:57 user nova-compute[72444]: WARNING nova.compute.manager [req-ae969485-edf6-461c-99e0-3f5d6200396e req-90db07f9-799e-4ab0-9c2c-a022912d1524 service nova] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Received unexpected event network-vif-plugged-19cfd924-3dff-4024-97c6-285ac53c1fcd for instance with vm_state active and task_state deleting.
Aug 03 04:42:57 user nova-compute[72444]: INFO nova.compute.manager [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Took 0.89 seconds to detach 1 volumes for instance.
Aug 03 04:42:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:42:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:42:58 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:42:58 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:42:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.447s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:42:58 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Deleted allocations for instance 85521338-f660-49ab-a3ab-9eb6df7a7353
Aug 03 04:42:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4f74eea6-15bd-471d-b32c-bcf1848e91f5 tempest-DeleteServersTestJSON-96824376 tempest-DeleteServersTestJSON-96824376-project-member] Lock "85521338-f660-49ab-a3ab-9eb6df7a7353" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.628s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:42:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Acquiring lock "ba7bd541-c761-4e4a-ac7c-7dd2cb89150d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:43:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "ba7bd541-c761-4e4a-ac7c-7dd2cb89150d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:43:04 user nova-compute[72444]: DEBUG nova.compute.manager [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 04:43:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:43:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:43:04 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 04:43:04 user nova-compute[72444]: INFO nova.compute.claims [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Claim successful on node user
Aug 03 04:43:05 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:43:05 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:43:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.718s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:43:05 user nova-compute[72444]: DEBUG nova.compute.manager [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 04:43:05 user nova-compute[72444]: DEBUG nova.compute.manager [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 04:43:05 user nova-compute[72444]: DEBUG nova.network.neutron [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 04:43:05 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 04:43:05 user nova-compute[72444]: DEBUG nova.compute.manager [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 04:43:05 user nova-compute[72444]: DEBUG nova.policy [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6837fb4f8f04f38a0e429d8905eae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6037670c8c6450bb3663e55b50c6dd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 04:43:05 user nova-compute[72444]: INFO nova.virt.block_device [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Booting with volume fbd912dd-0923-470a-8a00-ee611de909cd at /dev/vda
Aug 03 04:43:05 user nova-compute[72444]: DEBUG os_brick.utils [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:43:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:05 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f260fc89-8ad8-4db7-8094-9b182bb8ec13]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:05 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[238cfc1d-c43d-48a5-8aaf-b6bd6d06dce7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:05 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3f7a53-def6-4eec-baf6-02f1717a907e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:05 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fc0834-c5c9-4067-804f-411395ba939a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:43:05 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 04:43:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:43:05 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 04:43:05 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae9ad9f-6700-4920-9bf1-517a1959849b]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:05 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 04:43:05 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 04:43:05 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 04:43:05 user nova-compute[72444]: DEBUG os_brick.utils [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:43:05 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Updating existing volume attachment record: c9023bb8-cd48-4087-87fd-692d0f13634b {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 04:43:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:06 user nova-compute[72444]: DEBUG nova.network.neutron [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Successfully created port: 5e00edc4-284f-4e60-b3f6-75ab3df268dc {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:43:06 user nova-compute[72444]: DEBUG nova.network.neutron [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Successfully updated port: 5e00edc4-284f-4e60-b3f6-75ab3df268dc {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:43:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Acquiring lock "refresh_cache-ba7bd541-c761-4e4a-ac7c-7dd2cb89150d" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:43:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Acquired lock "refresh_cache-ba7bd541-c761-4e4a-ac7c-7dd2cb89150d" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:43:06 user nova-compute[72444]: DEBUG nova.network.neutron [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:43:06 user nova-compute[72444]: DEBUG nova.compute.manager [req-ef7c6d8c-abc2-401f-ad3e-14a3399c2fd9 req-825909c6-9f7c-44b5-ba00-0d4992eaf513 service nova] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Received event network-changed-5e00edc4-284f-4e60-b3f6-75ab3df268dc {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:43:06 user nova-compute[72444]: DEBUG nova.compute.manager [req-ef7c6d8c-abc2-401f-ad3e-14a3399c2fd9 req-825909c6-9f7c-44b5-ba00-0d4992eaf513 service nova] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Refreshing instance network info cache due to event network-changed-5e00edc4-284f-4e60-b3f6-75ab3df268dc. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:43:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ef7c6d8c-abc2-401f-ad3e-14a3399c2fd9 req-825909c6-9f7c-44b5-ba00-0d4992eaf513 service nova] Acquiring lock "refresh_cache-ba7bd541-c761-4e4a-ac7c-7dd2cb89150d" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG nova.network.neutron [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG nova.network.neutron [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Updating instance_info_cache with network_info: [{"id": "5e00edc4-284f-4e60-b3f6-75ab3df268dc", "address": "fa:16:3e:49:68:54", "network": {"id": "f0b4a33e-e079-4817-8747-412ca56818fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1198621443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6037670c8c6450bb3663e55b50c6dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e00edc4-28", "ovs_interfaceid": "5e00edc4-284f-4e60-b3f6-75ab3df268dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Releasing lock "refresh_cache-ba7bd541-c761-4e4a-ac7c-7dd2cb89150d" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG nova.compute.manager [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Instance network_info: |[{"id": "5e00edc4-284f-4e60-b3f6-75ab3df268dc", "address": "fa:16:3e:49:68:54", "network": {"id": "f0b4a33e-e079-4817-8747-412ca56818fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1198621443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6037670c8c6450bb3663e55b50c6dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e00edc4-28", "ovs_interfaceid": "5e00edc4-284f-4e60-b3f6-75ab3df268dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ef7c6d8c-abc2-401f-ad3e-14a3399c2fd9 req-825909c6-9f7c-44b5-ba00-0d4992eaf513 service nova] Acquired lock "refresh_cache-ba7bd541-c761-4e4a-ac7c-7dd2cb89150d" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG nova.network.neutron [req-ef7c6d8c-abc2-401f-ad3e-14a3399c2fd9 req-825909c6-9f7c-44b5-ba00-0d4992eaf513 service nova] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Refreshing network info cache for port 5e00edc4-284f-4e60-b3f6-75ab3df268dc {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiwnchLG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:43:07 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:43:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:43:07 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:43:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:43:07 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:43:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87647fd-7e45-4bf2-8058-f5fdbd1f60bd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 04:43:07 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa30d06-a6c8-4aad-b891-aea38fc2e491]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574] added
Aug 03 04:43:07 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02749e1-402a-45ea-905c-1ed23312b3cc]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[67533947-b504-4a10-8a7e-c45cc710f514]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qiwnchLG {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qiwnchLG" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[190691fd-e0cb-4565-9157-1dbee8cdb1be]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qiwnchLG'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e53e48-31aa-4122-9262-1bd4f740e1ec]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[38434fe7-3e01-4a61-b8d1-a69a2b281974]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 03 04:43:07 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 03 04:43:07 user nova-compute[72444]:  {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:43:07 user nova-compute[72444]: WARNING os_brick.initiator.connectors.iscsi [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 03 04:43:07 user nova-compute[72444]: 
Aug 03 04:43:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG nova.network.neutron [req-ef7c6d8c-abc2-401f-ad3e-14a3399c2fd9 req-825909c6-9f7c-44b5-ba00-0d4992eaf513 service nova] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Updated VIF entry in instance network info cache for port 5e00edc4-284f-4e60-b3f6-75ab3df268dc. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG nova.network.neutron [req-ef7c6d8c-abc2-401f-ad3e-14a3399c2fd9 req-825909c6-9f7c-44b5-ba00-0d4992eaf513 service nova] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Updating instance_info_cache with network_info: [{"id": "5e00edc4-284f-4e60-b3f6-75ab3df268dc", "address": "fa:16:3e:49:68:54", "network": {"id": "f0b4a33e-e079-4817-8747-412ca56818fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1198621443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6037670c8c6450bb3663e55b50c6dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e00edc4-28", "ovs_interfaceid": "5e00edc4-284f-4e60-b3f6-75ab3df268dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c93648-365a-4429-9b0f-0177172549e0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574, portal: 172.16.0.220,3260]
Aug 03 04:43:07 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574, portal: 172.16.0.220,3260] successful.
Aug 03 04:43:07 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ef7c6d8c-abc2-401f-ad3e-14a3399c2fd9 req-825909c6-9f7c-44b5-ba00-0d4992eaf513 service nova] Releasing lock "refresh_cache-ba7bd541-c761-4e4a-ac7c-7dd2cb89150d" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ef2473-c2af-4c76-a9bb-1bdcea3788d7]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a52c7c9-17d7-4aef-9e06-664773d5830f]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:43:07 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:43:07 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] HCTL ('33', '-', '-', 0) found on session 3 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.034s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae821528-f18b-4d30-b0da-d6aca69933d5]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:43:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiwnchLG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:43:08 user nova-compute[72444]: DEBUG nova.compute.manager [req-05e253f4-bfe0-4323-a6ba-153a25257fc7 req-08a0b57f-a6c2-48fa-acaa-fb25ab98b395 service nova] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Received event network-changed-d181dc6a-eec0-4611-9f3b-c8c43052c56c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:43:08 user nova-compute[72444]: DEBUG nova.compute.manager [req-05e253f4-bfe0-4323-a6ba-153a25257fc7 req-08a0b57f-a6c2-48fa-acaa-fb25ab98b395 service nova] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Refreshing instance network info cache due to event network-changed-d181dc6a-eec0-4611-9f3b-c8c43052c56c. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:43:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-05e253f4-bfe0-4323-a6ba-153a25257fc7 req-08a0b57f-a6c2-48fa-acaa-fb25ab98b395 service nova] Acquiring lock "refresh_cache-4d5c0324-68e8-4f0a-a740-0b4551e81fac" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:43:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-05e253f4-bfe0-4323-a6ba-153a25257fc7 req-08a0b57f-a6c2-48fa-acaa-fb25ab98b395 service nova] Acquired lock "refresh_cache-4d5c0324-68e8-4f0a-a740-0b4551e81fac" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:43:08 user nova-compute[72444]: DEBUG nova.network.neutron [req-05e253f4-bfe0-4323-a6ba-153a25257fc7 req-08a0b57f-a6c2-48fa-acaa-fb25ab98b395 service nova] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Refreshing network info cache for port d181dc6a-eec0-4611-9f3b-c8c43052c56c {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:43:08 user nova-compute[72444]: DEBUG nova.network.neutron [req-05e253f4-bfe0-4323-a6ba-153a25257fc7 req-08a0b57f-a6c2-48fa-acaa-fb25ab98b395 service nova] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Updated VIF entry in instance network info cache for port d181dc6a-eec0-4611-9f3b-c8c43052c56c. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:43:08 user nova-compute[72444]: DEBUG nova.network.neutron [req-05e253f4-bfe0-4323-a6ba-153a25257fc7 req-08a0b57f-a6c2-48fa-acaa-fb25ab98b395 service nova] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Updating instance_info_cache with network_info: [{"id": "d181dc6a-eec0-4611-9f3b-c8c43052c56c", "address": "fa:16:3e:05:29:38", "network": {"id": "a7fd7a43-0569-4382-88b3-33e9c55ac8aa", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-134274412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fef3fddba949838bc580dd71a24f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd181dc6a-ee", "ovs_interfaceid": "d181dc6a-eec0-4611-9f3b-c8c43052c56c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:43:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-05e253f4-bfe0-4323-a6ba-153a25257fc7 req-08a0b57f-a6c2-48fa-acaa-fb25ab98b395 service nova] Releasing lock "refresh_cache-4d5c0324-68e8-4f0a-a740-0b4551e81fac" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:43:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:43:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23964393636333465', 'path': '/dev/sdb'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:43:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964393636333465', 'path': '/dev/sdb'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:43:08 user nova-compute[72444]: DEBUG nova.objects.instance [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lazy-loading 'flavor' on Instance uuid 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:43:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 04:43:08 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:43:08 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 04:43:08 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:43:08 user nova-compute[72444]:   <serial>cd7ca08c-42db-4007-a06b-e327179ac574</serial>
Aug 03 04:43:08 user nova-compute[72444]: </disk>
Aug 03 04:43:08 user nova-compute[72444]:  {{(pid=72444) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 04:43:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:43:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:43:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] No VIF found with MAC fa:16:3e:12:4d:37, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:43:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b7bc6615-ecbc-43e4-9bc6-5031033a0bc8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.283s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:43:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-48a2a3eb-56f2-46e4-a80c-3619aa524cc6 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:43:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-48a2a3eb-56f2-46e4-a80c-3619aa524cc6 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:43:10 user nova-compute[72444]: DEBUG nova.compute.manager [None req-48a2a3eb-56f2-46e4-a80c-3619aa524cc6 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:43:10 user nova-compute[72444]: DEBUG nova.compute.manager [None req-48a2a3eb-56f2-46e4-a80c-3619aa524cc6 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72444) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 03 04:43:10 user nova-compute[72444]: DEBUG nova.objects.instance [None req-48a2a3eb-56f2-46e4-a80c-3619aa524cc6 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lazy-loading 'flavor' on Instance uuid 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:43:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:10 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691037775.8326883, 85521338-f660-49ab-a3ab-9eb6df7a7353 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:43:10 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] VM Stopped (Lifecycle Event)
Aug 03 04:43:10 user nova-compute[72444]: DEBUG nova.compute.manager [None req-bb96f4fb-a63a-4f81-8344-40bde1e0e347 None None] [instance: 85521338-f660-49ab-a3ab-9eb6df7a7353] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:43:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:11 user nova-compute[72444]: DEBUG nova.compute.manager [req-e068744f-84ea-4834-9e78-98925994c3f6 req-06368b88-f36f-4e2a-91f7-dc2523f6a4b5 service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Received event network-vif-unplugged-841a11a2-ffb3-44cf-9e15-c8099578d405 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:43:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e068744f-84ea-4834-9e78-98925994c3f6 req-06368b88-f36f-4e2a-91f7-dc2523f6a4b5 service nova] Acquiring lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:43:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e068744f-84ea-4834-9e78-98925994c3f6 req-06368b88-f36f-4e2a-91f7-dc2523f6a4b5 service nova] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:43:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e068744f-84ea-4834-9e78-98925994c3f6 req-06368b88-f36f-4e2a-91f7-dc2523f6a4b5 service nova] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:43:11 user nova-compute[72444]: DEBUG nova.compute.manager [req-e068744f-84ea-4834-9e78-98925994c3f6 req-06368b88-f36f-4e2a-91f7-dc2523f6a4b5 service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] No waiting events found dispatching network-vif-unplugged-841a11a2-ffb3-44cf-9e15-c8099578d405 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:43:11 user nova-compute[72444]: WARNING nova.compute.manager [req-e068744f-84ea-4834-9e78-98925994c3f6 req-06368b88-f36f-4e2a-91f7-dc2523f6a4b5 service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Received unexpected event network-vif-unplugged-841a11a2-ffb3-44cf-9e15-c8099578d405 for instance with vm_state active and task_state powering-off.
Aug 03 04:43:11 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Instance destroyed successfully.
Aug 03 04:43:11 user nova-compute[72444]: DEBUG nova.compute.manager [None req-48a2a3eb-56f2-46e4-a80c-3619aa524cc6 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:43:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-48a2a3eb-56f2-46e4-a80c-3619aa524cc6 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.887s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:43:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Acquiring lock "4d5c0324-68e8-4f0a-a740-0b4551e81fac" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:43:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Lock "4d5c0324-68e8-4f0a-a740-0b4551e81fac" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:43:11 user nova-compute[72444]: DEBUG nova.objects.instance [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Lazy-loading 'flavor' on Instance uuid 4d5c0324-68e8-4f0a-a740-0b4551e81fac {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:43:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Lock "4d5c0324-68e8-4f0a-a740-0b4551e81fac" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:43:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Acquiring lock "4d5c0324-68e8-4f0a-a740-0b4551e81fac" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:43:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Lock "4d5c0324-68e8-4f0a-a740-0b4551e81fac" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:43:12 user nova-compute[72444]: INFO nova.compute.manager [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Attaching volume 53d64158-7d06-4bf1-a32a-3e8b00ac1f67 to /dev/sdc
Aug 03 04:43:12 user nova-compute[72444]: DEBUG os_brick.utils [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:43:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e06f28b-f9f6-432d-9be2-817ea33950d6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0636cb99-1f5c-4a8e-bee0-a10f09b4f1a5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fe4814-0355-43e9-90af-08d53ffaeac3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4717ee28-3caf-47c7-81d8-6c8dabeb2ab4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:43:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 04:43:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:43:12 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 04:43:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a35603-e5ad-4b91-8ab7-5917839374a3]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 04:43:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 04:43:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 04:43:12 user nova-compute[72444]: DEBUG os_brick.utils [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:43:12 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Updating existing volume attachment record: 4dfb64dd-0002-4148-94ca-64ac4b470599 {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 04:43:13 user nova-compute[72444]: DEBUG nova.compute.manager [req-a186b36f-73a6-46af-a242-e7db13abb29f req-18d82bb7-529e-4508-baac-2b7808473d25 service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Received event network-vif-plugged-841a11a2-ffb3-44cf-9e15-c8099578d405 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:43:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a186b36f-73a6-46af-a242-e7db13abb29f req-18d82bb7-529e-4508-baac-2b7808473d25 service nova] Acquiring lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:43:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a186b36f-73a6-46af-a242-e7db13abb29f req-18d82bb7-529e-4508-baac-2b7808473d25 service nova] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:43:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a186b36f-73a6-46af-a242-e7db13abb29f req-18d82bb7-529e-4508-baac-2b7808473d25 service nova] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:43:13 user nova-compute[72444]: DEBUG nova.compute.manager [req-a186b36f-73a6-46af-a242-e7db13abb29f req-18d82bb7-529e-4508-baac-2b7808473d25 service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] No waiting events found dispatching network-vif-plugged-841a11a2-ffb3-44cf-9e15-c8099578d405 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:43:13 user nova-compute[72444]: WARNING nova.compute.manager [req-a186b36f-73a6-46af-a242-e7db13abb29f req-18d82bb7-529e-4508-baac-2b7808473d25 service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Received unexpected event network-vif-plugged-841a11a2-ffb3-44cf-9e15-c8099578d405 for instance with vm_state stopped and task_state None.
Aug 03 04:43:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:13 user nova-compute[72444]: DEBUG nova.compute.manager [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 04:43:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 04:43:13 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Creating image(s)
Aug 03 04:43:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Did not create local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 03 04:43:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Ensure instance console log exists: /opt/stack/data/nova/instances/ba7bd541-c761-4e4a-ac7c-7dd2cb89150d/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 04:43:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:43:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:43:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:43:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Start _get_guest_xml network_info=[{"id": "5e00edc4-284f-4e60-b3f6-75ab3df268dc", "address": "fa:16:3e:49:68:54", "network": {"id": "f0b4a33e-e079-4817-8747-412ca56818fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1198621443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6037670c8c6450bb3663e55b50c6dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e00edc4-28", "ovs_interfaceid": "5e00edc4-284f-4e60-b3f6-75ab3df268dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'voVSHFml', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ba7bd541-c761-4e4a-ac7c-7dd2cb89150d', 'attached_at': '', 'detached_at': '', 'volume_id': 'fbd912dd-0923-470a-8a00-ee611de909cd', 'serial': 'fbd912dd-0923-470a-8a00-ee611de909cd'}, 'disk_bus': 'virtio', 'attachment_id': 'c9023bb8-cd48-4087-87fd-692d0f13634b', 'guest_format': None, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:43:13 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:43:13 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:43:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'voVSHFml', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:43:14 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:43:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:43:14 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:43:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:43:14 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:43:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb8b479-fe82-4dca-ab51-297d6b72e1ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 04:43:14 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb807c6-aaea-4f33-8416-30240073bea9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd] added
Aug 03 04:43:14 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe01d93-867b-46e4-bbfb-a83e3eb1b5fd]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed5508c-f718-4225-aee5-a63820596db0]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v voVSHFml {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v voVSHFml" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[39592d3c-6dfc-4fb1-af36-c818fae39153]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'voVSHFml'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1e9e62-7a0e-40ca-b65e-b260bcc6138f]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae190d86-10dd-41bc-8704-836a1ced1f44]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:43:14 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:43:14 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e37670d-4340-4d79-80c7-bd6a69841c4b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd, portal: 172.16.0.220,3260]
Aug 03 04:43:14 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd, portal: 172.16.0.220,3260] successful.
Aug 03 04:43:14 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c25045-157f-437d-986b-10fec3025638]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2ae220-b594-4ae5-bef1-5be43ce1ef12]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:43:14 user nova-compute[72444]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:43:14 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:43:14 user nova-compute[72444]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:43:14 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4c11f2-b05a-4c05-b680-c75346c8c48b]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:43:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'voVSHFml', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:43:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:43:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23533323039303336', 'path': '/dev/sdc'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:43:15 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533323039303336', 'path': '/dev/sdc'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:43:15 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:43:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1380099260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1380099260',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxWTXqS2gTOwwksDvDA82ZhKXb+8OJ2l8zmonKnC8DV5DMkdpimVA0a9LAiDqgbZc2C7mTSh4D9lL13WOlFB3MFWXZFbpJsJYQhGkVl7O5aTGjbtLXsvFxHqIp9QmPVeg==',key_name='tempest-keypair-15472896',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6037670c8c6450bb3663e55b50c6dd5',ramdisk_id='',reservation_id='r-91lxwkqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-780888408',owner_user_name='tempest-ServerActionsV293TestJSON-780888408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:43:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6837fb4f8f04f38a0e429d8905eae54',uuid=ba7bd541-c761-4e4a-ac7c-7dd2cb89150d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e00edc4-284f-4e60-b3f6-75ab3df268dc", "address": "fa:16:3e:49:68:54", "network": {"id": "f0b4a33e-e079-4817-8747-412ca56818fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1198621443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6037670c8c6450bb3663e55b50c6dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e00edc4-28", "ovs_interfaceid": "5e00edc4-284f-4e60-b3f6-75ab3df268dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:43:15 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Converting VIF {"id": "5e00edc4-284f-4e60-b3f6-75ab3df268dc", "address": "fa:16:3e:49:68:54", "network": {"id": "f0b4a33e-e079-4817-8747-412ca56818fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1198621443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6037670c8c6450bb3663e55b50c6dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e00edc4-28", "ovs_interfaceid": "5e00edc4-284f-4e60-b3f6-75ab3df268dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:43:15 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:68:54,bridge_name='br-int',has_traffic_filtering=True,id=5e00edc4-284f-4e60-b3f6-75ab3df268dc,network=Network(f0b4a33e-e079-4817-8747-412ca56818fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e00edc4-28') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:43:15 user nova-compute[72444]: DEBUG nova.objects.instance [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lazy-loading 'pci_devices' on Instance uuid ba7bd541-c761-4e4a-ac7c-7dd2cb89150d {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:43:15 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:43:15 user nova-compute[72444]:   <uuid>ba7bd541-c761-4e4a-ac7c-7dd2cb89150d</uuid>
Aug 03 04:43:15 user nova-compute[72444]:   <name>instance-0000000e</name>
Aug 03 04:43:15 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:43:15 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:43:15 user nova-compute[72444]:   <metadata>
Aug 03 04:43:15 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:43:15 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:43:15 user nova-compute[72444]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1380099260</nova:name>
Aug 03 04:43:15 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:43:13</nova:creationTime>
Aug 03 04:43:15 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:43:15 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:43:15 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:43:15 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:43:15 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:43:15 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:43:15 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:43:15 user nova-compute[72444]:       <nova:owner>
Aug 03 04:43:15 user nova-compute[72444]:         <nova:user uuid="e6837fb4f8f04f38a0e429d8905eae54">tempest-ServerActionsV293TestJSON-780888408-project-member</nova:user>
Aug 03 04:43:15 user nova-compute[72444]:         <nova:project uuid="f6037670c8c6450bb3663e55b50c6dd5">tempest-ServerActionsV293TestJSON-780888408</nova:project>
Aug 03 04:43:15 user nova-compute[72444]:       </nova:owner>
Aug 03 04:43:15 user nova-compute[72444]:       <nova:ports>
Aug 03 04:43:15 user nova-compute[72444]:         <nova:port uuid="5e00edc4-284f-4e60-b3f6-75ab3df268dc">
Aug 03 04:43:15 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 03 04:43:15 user nova-compute[72444]:         </nova:port>
Aug 03 04:43:15 user nova-compute[72444]:       </nova:ports>
Aug 03 04:43:15 user nova-compute[72444]:     </nova:instance>
Aug 03 04:43:15 user nova-compute[72444]:   </metadata>
Aug 03 04:43:15 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:43:15 user nova-compute[72444]:     <system>
Aug 03 04:43:15 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:43:15 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:43:15 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:43:15 user nova-compute[72444]:       <entry name="serial">ba7bd541-c761-4e4a-ac7c-7dd2cb89150d</entry>
Aug 03 04:43:15 user nova-compute[72444]:       <entry name="uuid">ba7bd541-c761-4e4a-ac7c-7dd2cb89150d</entry>
Aug 03 04:43:15 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:43:15 user nova-compute[72444]:     </system>
Aug 03 04:43:15 user nova-compute[72444]:   </sysinfo>
Aug 03 04:43:15 user nova-compute[72444]:   <os>
Aug 03 04:43:15 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:43:15 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:43:15 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:43:15 user nova-compute[72444]:   </os>
Aug 03 04:43:15 user nova-compute[72444]:   <features>
Aug 03 04:43:15 user nova-compute[72444]:     <acpi/>
Aug 03 04:43:15 user nova-compute[72444]:     <apic/>
Aug 03 04:43:15 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:43:15 user nova-compute[72444]:   </features>
Aug 03 04:43:15 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:43:15 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:43:15 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:43:15 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:43:15 user nova-compute[72444]:   </clock>
Aug 03 04:43:15 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:43:15 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:43:15 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:43:15 user nova-compute[72444]:   </cpu>
Aug 03 04:43:15 user nova-compute[72444]:   <devices>
Aug 03 04:43:15 user nova-compute[72444]:     <disk type="block" device="disk">
Aug 03 04:43:15 user nova-compute[72444]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:43:15 user nova-compute[72444]:       <source dev="/dev/sdc"/>
Aug 03 04:43:15 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:43:15 user nova-compute[72444]:       <serial>fbd912dd-0923-470a-8a00-ee611de909cd</serial>
Aug 03 04:43:15 user nova-compute[72444]:     </disk>
Aug 03 04:43:15 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:43:15 user nova-compute[72444]:       <mac address="fa:16:3e:49:68:54"/>
Aug 03 04:43:15 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:43:15 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:43:15 user nova-compute[72444]:       <target dev="tap5e00edc4-28"/>
Aug 03 04:43:15 user nova-compute[72444]:     </interface>
Aug 03 04:43:15 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:43:15 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/ba7bd541-c761-4e4a-ac7c-7dd2cb89150d/console.log" append="off"/>
Aug 03 04:43:15 user nova-compute[72444]:     </serial>
Aug 03 04:43:15 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:43:15 user nova-compute[72444]:     <video>
Aug 03 04:43:15 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:43:15 user nova-compute[72444]:     </video>
Aug 03 04:43:15 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:43:15 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:43:15 user nova-compute[72444]:     </rng>
Aug 03 04:43:15 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:43:15 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:43:15 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:43:15 user nova-compute[72444]:     </memballoon>
Aug 03 04:43:15 user nova-compute[72444]:   </devices>
Aug 03 04:43:15 user nova-compute[72444]: </domain>
Aug 03 04:43:15 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:43:15 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:43:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1380099260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1380099260',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxWTXqS2gTOwwksDvDA82ZhKXb+8OJ2l8zmonKnC8DV5DMkdpimVA0a9LAiDqgbZc2C7mTSh4D9lL13WOlFB3MFWXZFbpJsJYQhGkVl7O5aTGjbtLXsvFxHqIp9QmPVeg==',key_name='tempest-keypair-15472896',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6037670c8c6450bb3663e55b50c6dd5',ramdisk_id='',reservation_id='r-91lxwkqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-780888408',owner_user_name='tempest-ServerActionsV293TestJSON-780888408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:43:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6837fb4f8f04f38a0e429d8905eae54',uuid=ba7bd541-c761-4e4a-ac7c-7dd2cb89150d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e00edc4-284f-4e60-b3f6-75ab3df268dc", "address": "fa:16:3e:49:68:54", "network": {"id": "f0b4a33e-e079-4817-8747-412ca56818fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1198621443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6037670c8c6450bb3663e55b50c6dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e00edc4-28", "ovs_interfaceid": "5e00edc4-284f-4e60-b3f6-75ab3df268dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:43:15 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Converting VIF {"id": "5e00edc4-284f-4e60-b3f6-75ab3df268dc", "address": "fa:16:3e:49:68:54", "network": {"id": "f0b4a33e-e079-4817-8747-412ca56818fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1198621443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6037670c8c6450bb3663e55b50c6dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e00edc4-28", "ovs_interfaceid": "5e00edc4-284f-4e60-b3f6-75ab3df268dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:43:15 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:68:54,bridge_name='br-int',has_traffic_filtering=True,id=5e00edc4-284f-4e60-b3f6-75ab3df268dc,network=Network(f0b4a33e-e079-4817-8747-412ca56818fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e00edc4-28') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:43:15 user nova-compute[72444]: DEBUG os_vif [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:68:54,bridge_name='br-int',has_traffic_filtering=True,id=5e00edc4-284f-4e60-b3f6-75ab3df268dc,network=Network(f0b4a33e-e079-4817-8747-412ca56818fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e00edc4-28') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:43:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:43:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:43:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e00edc4-28, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:43:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5e00edc4-28, col_values=(('external_ids', {'iface-id': '5e00edc4-284f-4e60-b3f6-75ab3df268dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:68:54', 'vm-uuid': 'ba7bd541-c761-4e4a-ac7c-7dd2cb89150d'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:43:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:43:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:15 user nova-compute[72444]: INFO os_vif [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:68:54,bridge_name='br-int',has_traffic_filtering=True,id=5e00edc4-284f-4e60-b3f6-75ab3df268dc,network=Network(f0b4a33e-e079-4817-8747-412ca56818fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e00edc4-28')
Aug 03 04:43:15 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:43:15 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] No VIF found with MAC fa:16:3e:49:68:54, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:43:16 user nova-compute[72444]: DEBUG nova.compute.manager [req-cdc6fe9c-be7b-4628-9c8d-ec07f139dd11 req-0ea45bb7-dde6-4bdb-a49a-056ae813f4d9 service nova] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Received event network-changed-2b3c7303-d2c6-4bab-96ad-a43903c2c28d {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:43:16 user nova-compute[72444]: DEBUG nova.compute.manager [req-cdc6fe9c-be7b-4628-9c8d-ec07f139dd11 req-0ea45bb7-dde6-4bdb-a49a-056ae813f4d9 service nova] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Refreshing instance network info cache due to event network-changed-2b3c7303-d2c6-4bab-96ad-a43903c2c28d. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:43:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-cdc6fe9c-be7b-4628-9c8d-ec07f139dd11 req-0ea45bb7-dde6-4bdb-a49a-056ae813f4d9 service nova] Acquiring lock "refresh_cache-42f131f8-83ac-4fd4-b056-f8dac3d32c55" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:43:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-cdc6fe9c-be7b-4628-9c8d-ec07f139dd11 req-0ea45bb7-dde6-4bdb-a49a-056ae813f4d9 service nova] Acquired lock "refresh_cache-42f131f8-83ac-4fd4-b056-f8dac3d32c55" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:43:16 user nova-compute[72444]: DEBUG nova.network.neutron [req-cdc6fe9c-be7b-4628-9c8d-ec07f139dd11 req-0ea45bb7-dde6-4bdb-a49a-056ae813f4d9 service nova] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Refreshing network info cache for port 2b3c7303-d2c6-4bab-96ad-a43903c2c28d {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:43:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Acquiring lock "42f131f8-83ac-4fd4-b056-f8dac3d32c55" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:43:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Lock "42f131f8-83ac-4fd4-b056-f8dac3d32c55" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:43:16 user nova-compute[72444]: DEBUG nova.objects.instance [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Lazy-loading 'flavor' on Instance uuid 42f131f8-83ac-4fd4-b056-f8dac3d32c55 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:43:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Lock "42f131f8-83ac-4fd4-b056-f8dac3d32c55" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:43:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Acquiring lock "42f131f8-83ac-4fd4-b056-f8dac3d32c55" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:43:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Lock "42f131f8-83ac-4fd4-b056-f8dac3d32c55" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:43:16 user nova-compute[72444]: INFO nova.compute.manager [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Attaching volume f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd to /dev/vdb
Aug 03 04:43:16 user nova-compute[72444]: DEBUG os_brick.utils [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:43:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:16 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[471261c4-b288-4b05-a7d6-0f1062b04479]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:16 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08dec41-b6e7-484d-b4c2-399d9ec96558]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:16 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fda2317-a08b-407d-854a-b5916eea0e17]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:16 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a6b445-2e0c-4c4c-b88d-db6d58f77cef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:43:16 user nova-compute[72444]: DEBUG nova.network.neutron [req-cdc6fe9c-be7b-4628-9c8d-ec07f139dd11 req-0ea45bb7-dde6-4bdb-a49a-056ae813f4d9 service nova] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Updated VIF entry in instance network info cache for port 2b3c7303-d2c6-4bab-96ad-a43903c2c28d. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:43:16 user nova-compute[72444]: DEBUG nova.network.neutron [req-cdc6fe9c-be7b-4628-9c8d-ec07f139dd11 req-0ea45bb7-dde6-4bdb-a49a-056ae813f4d9 service nova] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Updating instance_info_cache with network_info: [{"id": "2b3c7303-d2c6-4bab-96ad-a43903c2c28d", "address": "fa:16:3e:72:9e:bf", "network": {"id": "0b4f64f0-db21-4355-ba1c-32275f0d8b34", "bridge": "br-int", "label": "tempest-TestVolumeSwap-815026343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5432e4ac5443489a923966c0c85ef140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3c7303-d2", "ovs_interfaceid": "2b3c7303-d2c6-4bab-96ad-a43903c2c28d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:43:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 04:43:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:43:16 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 04:43:16 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c042d943-9d84-45e3-baa7-76d68cc2ce84]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 04:43:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 04:43:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 04:43:16 user nova-compute[72444]: DEBUG os_brick.utils [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:43:16 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Updating existing volume attachment record: 969ce2d7-1369-4aea-b29c-06ab3c401f07 {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 04:43:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-cdc6fe9c-be7b-4628-9c8d-ec07f139dd11 req-0ea45bb7-dde6-4bdb-a49a-056ae813f4d9 service nova] Releasing lock "refresh_cache-42f131f8-83ac-4fd4-b056-f8dac3d32c55" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:43:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:17 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:17 user nova-compute[72444]: DEBUG nova.compute.manager [req-f5d14969-67a9-4fd8-a9b0-5d5f9ebe6f01 req-93dc0e15-e52b-4520-b737-ba6dbdbe0fa2 service nova] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Received event network-vif-plugged-5e00edc4-284f-4e60-b3f6-75ab3df268dc {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:43:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f5d14969-67a9-4fd8-a9b0-5d5f9ebe6f01 req-93dc0e15-e52b-4520-b737-ba6dbdbe0fa2 service nova] Acquiring lock "ba7bd541-c761-4e4a-ac7c-7dd2cb89150d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:43:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f5d14969-67a9-4fd8-a9b0-5d5f9ebe6f01 req-93dc0e15-e52b-4520-b737-ba6dbdbe0fa2 service nova] Lock "ba7bd541-c761-4e4a-ac7c-7dd2cb89150d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:43:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f5d14969-67a9-4fd8-a9b0-5d5f9ebe6f01 req-93dc0e15-e52b-4520-b737-ba6dbdbe0fa2 service nova] Lock "ba7bd541-c761-4e4a-ac7c-7dd2cb89150d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:43:17 user nova-compute[72444]: DEBUG nova.compute.manager [req-f5d14969-67a9-4fd8-a9b0-5d5f9ebe6f01 req-93dc0e15-e52b-4520-b737-ba6dbdbe0fa2 service nova] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] No waiting events found dispatching network-vif-plugged-5e00edc4-284f-4e60-b3f6-75ab3df268dc {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:43:17 user nova-compute[72444]: WARNING nova.compute.manager [req-f5d14969-67a9-4fd8-a9b0-5d5f9ebe6f01 req-93dc0e15-e52b-4520-b737-ba6dbdbe0fa2 service nova] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Received unexpected event network-vif-plugged-5e00edc4-284f-4e60-b3f6-75ab3df268dc for instance with vm_state building and task_state spawning.
Aug 03 04:43:17 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:18 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:18 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037798.9056664, ba7bd541-c761-4e4a-ac7c-7dd2cb89150d => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:43:18 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] VM Resumed (Lifecycle Event)
Aug 03 04:43:18 user nova-compute[72444]: DEBUG nova.compute.manager [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:43:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 04:43:18 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Instance spawned successfully.
Aug 03 04:43:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 04:43:18 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:43:18 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:43:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:43:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:43:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:43:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:43:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:43:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:43:18 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:43:18 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037798.9075847, ba7bd541-c761-4e4a-ac7c-7dd2cb89150d => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:43:18 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] VM Started (Lifecycle Event)
Aug 03 04:43:18 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:43:18 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:43:19 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:43:19 user nova-compute[72444]: INFO nova.compute.manager [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Took 5.04 seconds to spawn the instance on the hypervisor.
Aug 03 04:43:19 user nova-compute[72444]: DEBUG nova.compute.manager [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:43:19 user nova-compute[72444]: DEBUG nova.compute.manager [req-e1ccafe1-ff1a-47e8-9e86-7267cf3bc8f4 req-0d1a6970-5571-42b4-b343-6a5f696fc50f service nova] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Received event network-vif-plugged-5e00edc4-284f-4e60-b3f6-75ab3df268dc {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:43:19 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e1ccafe1-ff1a-47e8-9e86-7267cf3bc8f4 req-0d1a6970-5571-42b4-b343-6a5f696fc50f service nova] Acquiring lock "ba7bd541-c761-4e4a-ac7c-7dd2cb89150d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:43:19 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e1ccafe1-ff1a-47e8-9e86-7267cf3bc8f4 req-0d1a6970-5571-42b4-b343-6a5f696fc50f service nova] Lock "ba7bd541-c761-4e4a-ac7c-7dd2cb89150d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:43:19 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e1ccafe1-ff1a-47e8-9e86-7267cf3bc8f4 req-0d1a6970-5571-42b4-b343-6a5f696fc50f service nova] Lock "ba7bd541-c761-4e4a-ac7c-7dd2cb89150d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:43:19 user nova-compute[72444]: DEBUG nova.compute.manager [req-e1ccafe1-ff1a-47e8-9e86-7267cf3bc8f4 req-0d1a6970-5571-42b4-b343-6a5f696fc50f service nova] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] No waiting events found dispatching network-vif-plugged-5e00edc4-284f-4e60-b3f6-75ab3df268dc {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:43:19 user nova-compute[72444]: WARNING nova.compute.manager [req-e1ccafe1-ff1a-47e8-9e86-7267cf3bc8f4 req-0d1a6970-5571-42b4-b343-6a5f696fc50f service nova] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Received unexpected event network-vif-plugged-5e00edc4-284f-4e60-b3f6-75ab3df268dc for instance with vm_state building and task_state spawning.
Aug 03 04:43:19 user nova-compute[72444]: INFO nova.compute.manager [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Took 14.48 seconds to build instance.
Aug 03 04:43:19 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-23fd074a-29ec-4ec3-9654-18aabb8d28c1 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "ba7bd541-c761-4e4a-ac7c-7dd2cb89150d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.597s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hvANQUGV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:43:20 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:43:20 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:43:20 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:43:20 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:43:20 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:43:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c59695-efce-465a-b1e0-8bf300c97648]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 04:43:20 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67 -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[79aa4fb6-694e-4a31-b278-ee575dc630d8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67] added
Aug 03 04:43:20 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e49256-6b9e-4ff6-b7f2-85944edcd308]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca53687e-dfc5-4ae1-b6a0-fe655af5490a]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hvANQUGV {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hvANQUGV" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3368169d-98dc-4252-88b9-9a4937142b90]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hvANQUGV'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a8b20e-0648-47ae-b08c-704d2a89816e]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ac6f2b-1da6-4269-9857-015ad8575607]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:43:20 user nova-compute[72444]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:43:20 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:43:20 user nova-compute[72444]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:43:20 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67 -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b46235d-db0c-42e5-8d8b-c14a465e0b1a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67, portal: 172.16.0.220,3260]
Aug 03 04:43:20 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67, portal: 172.16.0.220,3260] successful.
Aug 03 04:43:20 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[98350095-f3a8-4530-9297-a82ac72447b5]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[694d99b9-fcb9-4219-bbac-ca8575c20a06]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:43:20 user nova-compute[72444]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:43:20 user nova-compute[72444]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67 (non-flash)
Aug 03 04:43:20 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:43:20 user nova-compute[72444]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:43:20 user nova-compute[72444]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67 (non-flash)
Aug 03 04:43:20 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b9999b-b2d2-43d3-96bd-3363bc1ba94c]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:43:20 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hvANQUGV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:43:21 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:43:21 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23661326363613134', 'path': '/dev/sdd'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:43:21 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661326363613134', 'path': '/dev/sdd'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:43:21 user nova-compute[72444]: DEBUG nova.objects.instance [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Lazy-loading 'flavor' on Instance uuid 4d5c0324-68e8-4f0a-a740-0b4551e81fac {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:43:21 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 04:43:21 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:43:21 user nova-compute[72444]:   <source dev="/dev/sdd"/>
Aug 03 04:43:21 user nova-compute[72444]:   <target dev="sdc" bus="scsi"/>
Aug 03 04:43:21 user nova-compute[72444]:   <serial>53d64158-7d06-4bf1-a32a-3e8b00ac1f67</serial>
Aug 03 04:43:21 user nova-compute[72444]:   <address type="drive" controller="0" unit="2"/>
Aug 03 04:43:21 user nova-compute[72444]: </disk>
Aug 03 04:43:21 user nova-compute[72444]:  {{(pid=72444) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 04:43:22 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] No BDM found with device name sda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:43:22 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:43:22 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:43:22 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] No VIF found with MAC fa:16:3e:05:29:38, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:43:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-aea306f1-d051-49de-b7c4-217df821295e tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Lock "4d5c0324-68e8-4f0a-a740-0b4551e81fac" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.297s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:43:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f5f44b4e-819a-4d21-af64-94b6e69c3615 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Acquiring lock "4d5c0324-68e8-4f0a-a740-0b4551e81fac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:43:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f5f44b4e-819a-4d21-af64-94b6e69c3615 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Lock "4d5c0324-68e8-4f0a-a740-0b4551e81fac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:43:23 user nova-compute[72444]: INFO nova.compute.manager [None req-f5f44b4e-819a-4d21-af64-94b6e69c3615 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Detaching volume 53d64158-7d06-4bf1-a32a-3e8b00ac1f67
Aug 03 04:43:23 user nova-compute[72444]: INFO nova.virt.block_device [None req-f5f44b4e-819a-4d21-af64-94b6e69c3615 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Attempting to driver detach volume 53d64158-7d06-4bf1-a32a-3e8b00ac1f67 from mountpoint /dev/sdc
Aug 03 04:43:23 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f5f44b4e-819a-4d21-af64-94b6e69c3615 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Attempting to detach device sdc from instance 4d5c0324-68e8-4f0a-a740-0b4551e81fac from the persistent domain config. {{(pid=72444) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 04:43:23 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-f5f44b4e-819a-4d21-af64-94b6e69c3615 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 04:43:23 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:43:23 user nova-compute[72444]:   <source dev="/dev/sdd"/>
Aug 03 04:43:23 user nova-compute[72444]:   <target dev="sdc" bus="scsi"/>
Aug 03 04:43:23 user nova-compute[72444]:   <serial>53d64158-7d06-4bf1-a32a-3e8b00ac1f67</serial>
Aug 03 04:43:23 user nova-compute[72444]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 03 04:43:23 user nova-compute[72444]: </disk>
Aug 03 04:43:23 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:43:23 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-f5f44b4e-819a-4d21-af64-94b6e69c3615 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Successfully detached device sdc from instance 4d5c0324-68e8-4f0a-a740-0b4551e81fac from the persistent domain config.
Aug 03 04:43:23 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f5f44b4e-819a-4d21-af64-94b6e69c3615 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 4d5c0324-68e8-4f0a-a740-0b4551e81fac from the live domain config. {{(pid=72444) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 04:43:23 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-f5f44b4e-819a-4d21-af64-94b6e69c3615 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 04:43:23 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:43:23 user nova-compute[72444]:   <source dev="/dev/sdd"/>
Aug 03 04:43:23 user nova-compute[72444]:   <target dev="sdc" bus="scsi"/>
Aug 03 04:43:23 user nova-compute[72444]:   <serial>53d64158-7d06-4bf1-a32a-3e8b00ac1f67</serial>
Aug 03 04:43:23 user nova-compute[72444]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 03 04:43:23 user nova-compute[72444]: </disk>
Aug 03 04:43:23 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:43:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:23 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Received event <DeviceRemovedEvent: 1691037803.8897774, 4d5c0324-68e8-4f0a-a740-0b4551e81fac => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72444) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 04:43:23 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f5f44b4e-819a-4d21-af64-94b6e69c3615 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 4d5c0324-68e8-4f0a-a740-0b4551e81fac {{(pid=72444) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 04:43:23 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-f5f44b4e-819a-4d21-af64-94b6e69c3615 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Successfully detached device sdc from instance 4d5c0324-68e8-4f0a-a740-0b4551e81fac from the live domain config.
Aug 03 04:43:23 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5f44b4e-819a-4d21-af64-94b6e69c3615 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:43:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f44b4e-819a-4d21-af64-94b6e69c3615 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hvANQUGV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:43:23 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-f5f44b4e-819a-4d21-af64-94b6e69c3615 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:43:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-f5f44b4e-819a-4d21-af64-94b6e69c3615 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:43:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-f5f44b4e-819a-4d21-af64-94b6e69c3615 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:43:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f44b4e-819a-4d21-af64-94b6e69c3615 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:43:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:23 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfec243-6d8d-4760-80ee-a3359b9ff27f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:23 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac77b88-8b52-4f34-8326-b116256cda3d]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f44b4e-819a-4d21-af64-94b6e69c3615 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:43:23 user nova-compute[72444]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:43:23 user nova-compute[72444]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67 (non-flash)
Aug 03 04:43:23 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:43:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f44b4e-819a-4d21-af64-94b6e69c3615 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:43:23 user nova-compute[72444]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:43:23 user nova-compute[72444]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67 (non-flash)
Aug 03 04:43:23 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:43:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f44b4e-819a-4d21-af64-94b6e69c3615 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f309f7976d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67'): ({'sdd'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:43:23 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-f5f44b4e-819a-4d21-af64-94b6e69c3615 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Removing single pathed devices sdd {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 04:43:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:23 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb19c61-dcd7-4d7e-b329-61c9e788f372]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70a9799-59a8-42dc-aa94-1619d7fe9ded]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-f5f44b4e-819a-4d21-af64-94b6e69c3615 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Flushing IO for device /dev/sdd {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3479072-f3ca-42e6-b655-1605661a80ca]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-f5f44b4e-819a-4d21-af64-94b6e69c3615 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cac4f17-9d69-46bb-b95b-fd63546daa6a]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-f5f44b4e-819a-4d21-af64-94b6e69c3615 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-f5f44b4e-819a-4d21-af64-94b6e69c3615 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] SCSI volumes sdd have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f44b4e-819a-4d21-af64-94b6e69c3615 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c080fd-8fca-4ecc-9b0a-fd83b7fdf4e2]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f44b4e-819a-4d21-af64-94b6e69c3615 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67 -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[679a2e17-5c19-4488-ae4d-b616171b18f7]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f44b4e-819a-4d21-af64-94b6e69c3615 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67, portal: 172.16.0.220,3260]
Aug 03 04:43:24 user nova-compute[72444]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67, portal: 172.16.0.220,3260] successful.
Aug 03 04:43:24 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67 -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53d64158-7d06-4bf1-a32a-3e8b00ac1f67 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51ac9b7-5821-4a9d-8ca5-bf6dadc4b363]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f44b4e-819a-4d21-af64-94b6e69c3615 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-f5f44b4e-819a-4d21-af64-94b6e69c3615 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f44b4e-819a-4d21-af64-94b6e69c3615 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] <== disconnect_volume: return (299ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5f44b4e-819a-4d21-af64-94b6e69c3615 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TveiztUW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:43:24 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:43:24 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:43:24 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:43:24 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:43:24 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:43:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cd70c8-4197-4a5a-9b85-77f114c77d5e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 04:43:24 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c125e27c-2d1f-4f79-98a0-8aaa924a7eed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd] added
Aug 03 04:43:24 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded4c502-e9cc-498f-8a63-4fe75370fc60]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bc53d7-dcd8-4fe3-90c2-3bd60d0d6bd6]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TveiztUW {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TveiztUW" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e414791-f55e-461a-b576-aa8ea5c73e22]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TveiztUW'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[000db4a3-c8ab-4dae-bcad-e55c68798c40]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ff1989-72c8-41cb-b940-40d0a5658d3a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:43:25 user nova-compute[72444]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:43:25 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:43:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:43:25 user nova-compute[72444]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:43:25 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:43:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[98db269f-d6b6-4774-96d9-7b7fc61a1ca9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd, portal: 172.16.0.220,3260]
Aug 03 04:43:25 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd, portal: 172.16.0.220,3260] successful.
Aug 03 04:43:25 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1516f4-cf8a-49bb-8448-2df274aa49e9]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:25 user nova-compute[72444]: DEBUG nova.objects.instance [None req-f5f44b4e-819a-4d21-af64-94b6e69c3615 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Lazy-loading 'flavor' on Instance uuid 4d5c0324-68e8-4f0a-a740-0b4551e81fac {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:43:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8e6a0e-9019-4a5d-a8ba-9b08999043c9]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:43:25 user nova-compute[72444]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:43:25 user nova-compute[72444]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd (non-flash)
Aug 03 04:43:25 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:43:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:43:25 user nova-compute[72444]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:43:25 user nova-compute[72444]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd (non-flash)
Aug 03 04:43:25 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:43:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:43:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:43:25 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] HCTL ('35', '-', '-', 0) found on session 6 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:43:25 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:43:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f5f44b4e-819a-4d21-af64-94b6e69c3615 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Lock "4d5c0324-68e8-4f0a-a740-0b4551e81fac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.808s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:43:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fb0113-8760-401a-8068-920933d6c8bf]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:25 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Searching for a device in session 6 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:43:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TveiztUW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:43:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e1bfd100-a83e-4bbc-b2a4-7dc5f2f270b1 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Acquiring lock "4d5c0324-68e8-4f0a-a740-0b4551e81fac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:43:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e1bfd100-a83e-4bbc-b2a4-7dc5f2f270b1 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Lock "4d5c0324-68e8-4f0a-a740-0b4551e81fac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:43:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e1bfd100-a83e-4bbc-b2a4-7dc5f2f270b1 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Acquiring lock "4d5c0324-68e8-4f0a-a740-0b4551e81fac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:43:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e1bfd100-a83e-4bbc-b2a4-7dc5f2f270b1 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Lock "4d5c0324-68e8-4f0a-a740-0b4551e81fac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:43:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e1bfd100-a83e-4bbc-b2a4-7dc5f2f270b1 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Lock "4d5c0324-68e8-4f0a-a740-0b4551e81fac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:43:26 user nova-compute[72444]: INFO nova.compute.manager [None req-e1bfd100-a83e-4bbc-b2a4-7dc5f2f270b1 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Terminating instance
Aug 03 04:43:26 user nova-compute[72444]: DEBUG nova.compute.manager [None req-e1bfd100-a83e-4bbc-b2a4-7dc5f2f270b1 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 04:43:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:26 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:43:26 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '26235333533666232', 'path': '/dev/sdd'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:43:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235333533666232', 'path': '/dev/sdd'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:43:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:26 user nova-compute[72444]: DEBUG nova.objects.instance [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Lazy-loading 'flavor' on Instance uuid 42f131f8-83ac-4fd4-b056-f8dac3d32c55 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:43:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 04:43:26 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:43:26 user nova-compute[72444]:   <source dev="/dev/sdd"/>
Aug 03 04:43:26 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:43:26 user nova-compute[72444]:   <serial>f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd</serial>
Aug 03 04:43:26 user nova-compute[72444]: </disk>
Aug 03 04:43:26 user nova-compute[72444]:  {{(pid=72444) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 04:43:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:26 user nova-compute[72444]: DEBUG nova.compute.manager [req-5af2be74-4de1-4644-bc54-cb8f558bf09b req-e679b668-07cd-4b46-907a-49799cb01712 service nova] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Received event network-vif-unplugged-d181dc6a-eec0-4611-9f3b-c8c43052c56c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:43:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5af2be74-4de1-4644-bc54-cb8f558bf09b req-e679b668-07cd-4b46-907a-49799cb01712 service nova] Acquiring lock "4d5c0324-68e8-4f0a-a740-0b4551e81fac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:43:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5af2be74-4de1-4644-bc54-cb8f558bf09b req-e679b668-07cd-4b46-907a-49799cb01712 service nova] Lock "4d5c0324-68e8-4f0a-a740-0b4551e81fac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:43:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5af2be74-4de1-4644-bc54-cb8f558bf09b req-e679b668-07cd-4b46-907a-49799cb01712 service nova] Lock "4d5c0324-68e8-4f0a-a740-0b4551e81fac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:43:26 user nova-compute[72444]: DEBUG nova.compute.manager [req-5af2be74-4de1-4644-bc54-cb8f558bf09b req-e679b668-07cd-4b46-907a-49799cb01712 service nova] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] No waiting events found dispatching network-vif-unplugged-d181dc6a-eec0-4611-9f3b-c8c43052c56c {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:43:26 user nova-compute[72444]: DEBUG nova.compute.manager [req-5af2be74-4de1-4644-bc54-cb8f558bf09b req-e679b668-07cd-4b46-907a-49799cb01712 service nova] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Received event network-vif-unplugged-d181dc6a-eec0-4611-9f3b-c8c43052c56c for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:43:26 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691037791.5137708, 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:43:26 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] VM Stopped (Lifecycle Event)
Aug 03 04:43:26 user nova-compute[72444]: DEBUG nova.compute.manager [None req-c8ca168d-5291-4246-b996-4e70585991fd None None] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:43:26 user nova-compute[72444]: DEBUG nova.compute.manager [None req-c8ca168d-5291-4246-b996-4e70585991fd None None] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:43:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:43:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:43:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] No VIF found with MAC fa:16:3e:72:9e:bf, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:43:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ff435d5f-532a-4f7c-b016-855fd44fd1ed tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Lock "42f131f8-83ac-4fd4-b056-f8dac3d32c55" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.472s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:43:27 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Instance destroyed successfully.
Aug 03 04:43:27 user nova-compute[72444]: DEBUG nova.objects.instance [None req-e1bfd100-a83e-4bbc-b2a4-7dc5f2f270b1 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Lazy-loading 'resources' on Instance uuid 4d5c0324-68e8-4f0a-a740-0b4551e81fac {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:43:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-e1bfd100-a83e-4bbc-b2a4-7dc5f2f270b1 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:41:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2110780742',display_name='tempest-AttachSCSIVolumeTestJSON-server-2110780742',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2110780742',id=9,image_ref='e71f545b-f80d-47f1-8b23-7dd1afc643d8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfAYun0VPylzdvojSj/Ol6ebLeUZa6ue0FwjvfnfxdcoJKRj/G2t2j9Hzf8X0TRxqfU5Fd8RNYymYQjHKs1gknPbHxrEW8IKB2nIvtXCurJWFDJdY4NEs0+zkvEgUek9A==',key_name='tempest-keypair-256061458',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:41:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63fef3fddba949838bc580dd71a24f44',ramdisk_id='',reservation_id='r-pzwg52yu',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e71f545b-f80d-47f1-8b23-7dd1afc643d8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-636686183',owner_user_name='tempest-AttachSCSIVolumeTestJSON-636686183-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:41:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d977491d031344f7b6c9438c99e434dd',uuid=4d5c0324-68e8-4f0a-a740-0b4551e81fac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d181dc6a-eec0-4611-9f3b-c8c43052c56c", "address": "fa:16:3e:05:29:38", "network": {"id": "a7fd7a43-0569-4382-88b3-33e9c55ac8aa", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-134274412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fef3fddba949838bc580dd71a24f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd181dc6a-ee", "ovs_interfaceid": "d181dc6a-eec0-4611-9f3b-c8c43052c56c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:43:27 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e1bfd100-a83e-4bbc-b2a4-7dc5f2f270b1 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Converting VIF {"id": "d181dc6a-eec0-4611-9f3b-c8c43052c56c", "address": "fa:16:3e:05:29:38", "network": {"id": "a7fd7a43-0569-4382-88b3-33e9c55ac8aa", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-134274412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fef3fddba949838bc580dd71a24f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd181dc6a-ee", "ovs_interfaceid": "d181dc6a-eec0-4611-9f3b-c8c43052c56c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:43:27 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e1bfd100-a83e-4bbc-b2a4-7dc5f2f270b1 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:29:38,bridge_name='br-int',has_traffic_filtering=True,id=d181dc6a-eec0-4611-9f3b-c8c43052c56c,network=Network(a7fd7a43-0569-4382-88b3-33e9c55ac8aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd181dc6a-ee') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:43:27 user nova-compute[72444]: DEBUG os_vif [None req-e1bfd100-a83e-4bbc-b2a4-7dc5f2f270b1 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:29:38,bridge_name='br-int',has_traffic_filtering=True,id=d181dc6a-eec0-4611-9f3b-c8c43052c56c,network=Network(a7fd7a43-0569-4382-88b3-33e9c55ac8aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd181dc6a-ee') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:43:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd181dc6a-ee, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:43:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:43:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:27 user nova-compute[72444]: INFO os_vif [None req-e1bfd100-a83e-4bbc-b2a4-7dc5f2f270b1 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:29:38,bridge_name='br-int',has_traffic_filtering=True,id=d181dc6a-eec0-4611-9f3b-c8c43052c56c,network=Network(a7fd7a43-0569-4382-88b3-33e9c55ac8aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd181dc6a-ee')
Aug 03 04:43:27 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-e1bfd100-a83e-4bbc-b2a4-7dc5f2f270b1 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Deleting instance files /opt/stack/data/nova/instances/4d5c0324-68e8-4f0a-a740-0b4551e81fac_del
Aug 03 04:43:27 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-e1bfd100-a83e-4bbc-b2a4-7dc5f2f270b1 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Deletion of /opt/stack/data/nova/instances/4d5c0324-68e8-4f0a-a740-0b4551e81fac_del complete
Aug 03 04:43:27 user nova-compute[72444]: INFO nova.compute.manager [None req-e1bfd100-a83e-4bbc-b2a4-7dc5f2f270b1 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Took 1.12 seconds to destroy the instance on the hypervisor.
Aug 03 04:43:27 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-e1bfd100-a83e-4bbc-b2a4-7dc5f2f270b1 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 04:43:27 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 04:43:27 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 04:43:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Acquiring lock "42f131f8-83ac-4fd4-b056-f8dac3d32c55" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:43:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Lock "42f131f8-83ac-4fd4-b056-f8dac3d32c55" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:43:27 user nova-compute[72444]: DEBUG os_brick.utils [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:43:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:27 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf938d4-8d8e-4836-96a2-78ef98d038c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:27 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfa405b-3449-437d-ba65-27594e12288f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:28 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:28 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[07925f79-e522-4004-ad3b-3cc070a064ee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:28 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1cfb2a-7e98-4253-871f-3d1a3e51d2f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:28 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:28 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:43:28 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 04:43:28 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:28 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:43:28 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 04:43:28 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4e38c4-24d6-43fa-b0dd-414c05c93161]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:28 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 04:43:28 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 04:43:28 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 04:43:28 user nova-compute[72444]: DEBUG os_brick.utils [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:43:28 user nova-compute[72444]: INFO nova.compute.manager [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Swapping volume f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd for 96716d59-f823-422e-83c6-0f9448733af5
Aug 03 04:43:28 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:43:28 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Took 1.11 seconds to deallocate network for instance.
Aug 03 04:43:28 user nova-compute[72444]: DEBUG nova.compute.manager [req-e3fe3f30-dd11-47d4-ab97-3650252a7213 req-c2d6c82a-eca2-4688-801b-8fc49ad2ce75 service nova] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Received event network-vif-deleted-d181dc6a-eec0-4611-9f3b-c8c43052c56c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:43:28 user nova-compute[72444]: INFO nova.compute.manager [req-e3fe3f30-dd11-47d4-ab97-3650252a7213 req-c2d6c82a-eca2-4688-801b-8fc49ad2ce75 service nova] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Neutron deleted interface d181dc6a-eec0-4611-9f3b-c8c43052c56c; detaching it from the instance and deleting it from the info cache
Aug 03 04:43:28 user nova-compute[72444]: DEBUG nova.network.neutron [req-e3fe3f30-dd11-47d4-ab97-3650252a7213 req-c2d6c82a-eca2-4688-801b-8fc49ad2ce75 service nova] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:43:28 user nova-compute[72444]: DEBUG nova.compute.manager [req-e3fe3f30-dd11-47d4-ab97-3650252a7213 req-c2d6c82a-eca2-4688-801b-8fc49ad2ce75 service nova] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Detach interface failed, port_id=d181dc6a-eec0-4611-9f3b-c8c43052c56c, reason: Instance 4d5c0324-68e8-4f0a-a740-0b4551e81fac could not be found. {{(pid=72444) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 03 04:43:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e1bfd100-a83e-4bbc-b2a4-7dc5f2f270b1 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:43:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e1bfd100-a83e-4bbc-b2a4-7dc5f2f270b1 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:43:28 user nova-compute[72444]: DEBUG nova.compute.manager [req-53eea131-aacd-481b-af49-438cbe1fb98a req-5be10e2e-b6a4-4bea-91f5-840339846eb2 service nova] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Received event network-vif-plugged-d181dc6a-eec0-4611-9f3b-c8c43052c56c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:43:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-53eea131-aacd-481b-af49-438cbe1fb98a req-5be10e2e-b6a4-4bea-91f5-840339846eb2 service nova] Acquiring lock "4d5c0324-68e8-4f0a-a740-0b4551e81fac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:43:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-53eea131-aacd-481b-af49-438cbe1fb98a req-5be10e2e-b6a4-4bea-91f5-840339846eb2 service nova] Lock "4d5c0324-68e8-4f0a-a740-0b4551e81fac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:43:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-53eea131-aacd-481b-af49-438cbe1fb98a req-5be10e2e-b6a4-4bea-91f5-840339846eb2 service nova] Lock "4d5c0324-68e8-4f0a-a740-0b4551e81fac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:43:28 user nova-compute[72444]: DEBUG nova.compute.manager [req-53eea131-aacd-481b-af49-438cbe1fb98a req-5be10e2e-b6a4-4bea-91f5-840339846eb2 service nova] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] No waiting events found dispatching network-vif-plugged-d181dc6a-eec0-4611-9f3b-c8c43052c56c {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:43:28 user nova-compute[72444]: WARNING nova.compute.manager [req-53eea131-aacd-481b-af49-438cbe1fb98a req-5be10e2e-b6a4-4bea-91f5-840339846eb2 service nova] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Received unexpected event network-vif-plugged-d181dc6a-eec0-4611-9f3b-c8c43052c56c for instance with vm_state deleted and task_state None.
Aug 03 04:43:28 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-e1bfd100-a83e-4bbc-b2a4-7dc5f2f270b1 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:43:28 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-e1bfd100-a83e-4bbc-b2a4-7dc5f2f270b1 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:43:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e1bfd100-a83e-4bbc-b2a4-7dc5f2f270b1 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.532s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:43:28 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-e1bfd100-a83e-4bbc-b2a4-7dc5f2f270b1 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Deleted allocations for instance 4d5c0324-68e8-4f0a-a740-0b4551e81fac
Aug 03 04:43:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e1bfd100-a83e-4bbc-b2a4-7dc5f2f270b1 tempest-AttachSCSIVolumeTestJSON-636686183 tempest-AttachSCSIVolumeTestJSON-636686183-project-member] Lock "4d5c0324-68e8-4f0a-a740-0b4551e81fac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.040s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:43:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8bbd39f9-0e7d-4160-951a-45bc0d1af191 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Acquiring lock "ba81117e-fef4-4b0d-89ba-ba16aaeaf124" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:43:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8bbd39f9-0e7d-4160-951a-45bc0d1af191 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Lock "ba81117e-fef4-4b0d-89ba-ba16aaeaf124" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:43:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8bbd39f9-0e7d-4160-951a-45bc0d1af191 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Acquiring lock "ba81117e-fef4-4b0d-89ba-ba16aaeaf124-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:43:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8bbd39f9-0e7d-4160-951a-45bc0d1af191 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Lock "ba81117e-fef4-4b0d-89ba-ba16aaeaf124-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:43:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8bbd39f9-0e7d-4160-951a-45bc0d1af191 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Lock "ba81117e-fef4-4b0d-89ba-ba16aaeaf124-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:43:31 user nova-compute[72444]: INFO nova.compute.manager [None req-8bbd39f9-0e7d-4160-951a-45bc0d1af191 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Terminating instance
Aug 03 04:43:31 user nova-compute[72444]: DEBUG nova.compute.manager [None req-8bbd39f9-0e7d-4160-951a-45bc0d1af191 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 04:43:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:31 user nova-compute[72444]: DEBUG nova.compute.manager [req-96840eda-6611-427e-9fcf-a5368e509529 req-4db58e39-31bc-4bd8-9894-a8f13683f2f2 service nova] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Received event network-vif-unplugged-fec9c34d-38ef-46e3-ad2d-47ec3e0895e1 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:43:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-96840eda-6611-427e-9fcf-a5368e509529 req-4db58e39-31bc-4bd8-9894-a8f13683f2f2 service nova] Acquiring lock "ba81117e-fef4-4b0d-89ba-ba16aaeaf124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:43:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-96840eda-6611-427e-9fcf-a5368e509529 req-4db58e39-31bc-4bd8-9894-a8f13683f2f2 service nova] Lock "ba81117e-fef4-4b0d-89ba-ba16aaeaf124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:43:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-96840eda-6611-427e-9fcf-a5368e509529 req-4db58e39-31bc-4bd8-9894-a8f13683f2f2 service nova] Lock "ba81117e-fef4-4b0d-89ba-ba16aaeaf124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:43:31 user nova-compute[72444]: DEBUG nova.compute.manager [req-96840eda-6611-427e-9fcf-a5368e509529 req-4db58e39-31bc-4bd8-9894-a8f13683f2f2 service nova] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] No waiting events found dispatching network-vif-unplugged-fec9c34d-38ef-46e3-ad2d-47ec3e0895e1 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:43:31 user nova-compute[72444]: DEBUG nova.compute.manager [req-96840eda-6611-427e-9fcf-a5368e509529 req-4db58e39-31bc-4bd8-9894-a8f13683f2f2 service nova] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Received event network-vif-unplugged-fec9c34d-38ef-46e3-ad2d-47ec3e0895e1 for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:43:31 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Instance destroyed successfully.
Aug 03 04:43:31 user nova-compute[72444]: DEBUG nova.objects.instance [None req-8bbd39f9-0e7d-4160-951a-45bc0d1af191 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Lazy-loading 'resources' on Instance uuid ba81117e-fef4-4b0d-89ba-ba16aaeaf124 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:43:31 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-8bbd39f9-0e7d-4160-951a-45bc0d1af191 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:41:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-739885277',display_name='tempest-VolumesActionsTest-instance-739885277',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-739885277',id=11,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:41:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5329f0bac5b64d07afaba5a42c12b537',ramdisk_id='',reservation_id='r-jf05yl94',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1012112512',owner_user_name='tempest-VolumesActionsTest-1012112512-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:41:40Z,user_data=None,user_id='f0c63f7ac0ce4389a1c66d104cc1eb67',uuid=ba81117e-fef4-4b0d-89ba-ba16aaeaf124,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fec9c34d-38ef-46e3-ad2d-47ec3e0895e1", "address": "fa:16:3e:3c:ac:bc", "network": {"id": "944e9ac7-5ec1-4834-894d-7c1dcc63277f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2126179557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5329f0bac5b64d07afaba5a42c12b537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec9c34d-38", "ovs_interfaceid": "fec9c34d-38ef-46e3-ad2d-47ec3e0895e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:43:31 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-8bbd39f9-0e7d-4160-951a-45bc0d1af191 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Converting VIF {"id": "fec9c34d-38ef-46e3-ad2d-47ec3e0895e1", "address": "fa:16:3e:3c:ac:bc", "network": {"id": "944e9ac7-5ec1-4834-894d-7c1dcc63277f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2126179557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5329f0bac5b64d07afaba5a42c12b537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec9c34d-38", "ovs_interfaceid": "fec9c34d-38ef-46e3-ad2d-47ec3e0895e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:43:31 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-8bbd39f9-0e7d-4160-951a-45bc0d1af191 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:ac:bc,bridge_name='br-int',has_traffic_filtering=True,id=fec9c34d-38ef-46e3-ad2d-47ec3e0895e1,network=Network(944e9ac7-5ec1-4834-894d-7c1dcc63277f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec9c34d-38') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:43:31 user nova-compute[72444]: DEBUG os_vif [None req-8bbd39f9-0e7d-4160-951a-45bc0d1af191 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:ac:bc,bridge_name='br-int',has_traffic_filtering=True,id=fec9c34d-38ef-46e3-ad2d-47ec3e0895e1,network=Network(944e9ac7-5ec1-4834-894d-7c1dcc63277f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec9c34d-38') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:43:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfec9c34d-38, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:43:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:43:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:31 user nova-compute[72444]: INFO os_vif [None req-8bbd39f9-0e7d-4160-951a-45bc0d1af191 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:ac:bc,bridge_name='br-int',has_traffic_filtering=True,id=fec9c34d-38ef-46e3-ad2d-47ec3e0895e1,network=Network(944e9ac7-5ec1-4834-894d-7c1dcc63277f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec9c34d-38')
Aug 03 04:43:31 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-8bbd39f9-0e7d-4160-951a-45bc0d1af191 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Deleting instance files /opt/stack/data/nova/instances/ba81117e-fef4-4b0d-89ba-ba16aaeaf124_del
Aug 03 04:43:31 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-8bbd39f9-0e7d-4160-951a-45bc0d1af191 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Deletion of /opt/stack/data/nova/instances/ba81117e-fef4-4b0d-89ba-ba16aaeaf124_del complete
Aug 03 04:43:31 user nova-compute[72444]: INFO nova.compute.manager [None req-8bbd39f9-0e7d-4160-951a-45bc0d1af191 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Took 0.71 seconds to destroy the instance on the hypervisor.
Aug 03 04:43:31 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-8bbd39f9-0e7d-4160-951a-45bc0d1af191 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 04:43:31 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 04:43:31 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 04:43:32 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:43:32 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Took 0.53 seconds to deallocate network for instance.
Aug 03 04:43:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8bbd39f9-0e7d-4160-951a-45bc0d1af191 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:43:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8bbd39f9-0e7d-4160-951a-45bc0d1af191 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:43:32 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-8bbd39f9-0e7d-4160-951a-45bc0d1af191 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:43:32 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-8bbd39f9-0e7d-4160-951a-45bc0d1af191 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:43:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8bbd39f9-0e7d-4160-951a-45bc0d1af191 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.554s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:43:33 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-8bbd39f9-0e7d-4160-951a-45bc0d1af191 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Deleted allocations for instance ba81117e-fef4-4b0d-89ba-ba16aaeaf124
Aug 03 04:43:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8bbd39f9-0e7d-4160-951a-45bc0d1af191 tempest-VolumesActionsTest-1012112512 tempest-VolumesActionsTest-1012112512-project-member] Lock "ba81117e-fef4-4b0d-89ba-ba16aaeaf124" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.035s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:43:33 user nova-compute[72444]: DEBUG nova.compute.manager [req-5f56db10-2164-483b-aa77-8611d75f99d5 req-0dd49d9b-6529-44da-bacc-3f05dd952f3b service nova] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Received event network-vif-plugged-fec9c34d-38ef-46e3-ad2d-47ec3e0895e1 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:43:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5f56db10-2164-483b-aa77-8611d75f99d5 req-0dd49d9b-6529-44da-bacc-3f05dd952f3b service nova] Acquiring lock "ba81117e-fef4-4b0d-89ba-ba16aaeaf124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:43:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5f56db10-2164-483b-aa77-8611d75f99d5 req-0dd49d9b-6529-44da-bacc-3f05dd952f3b service nova] Lock "ba81117e-fef4-4b0d-89ba-ba16aaeaf124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:43:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5f56db10-2164-483b-aa77-8611d75f99d5 req-0dd49d9b-6529-44da-bacc-3f05dd952f3b service nova] Lock "ba81117e-fef4-4b0d-89ba-ba16aaeaf124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:43:33 user nova-compute[72444]: DEBUG nova.compute.manager [req-5f56db10-2164-483b-aa77-8611d75f99d5 req-0dd49d9b-6529-44da-bacc-3f05dd952f3b service nova] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] No waiting events found dispatching network-vif-plugged-fec9c34d-38ef-46e3-ad2d-47ec3e0895e1 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:43:33 user nova-compute[72444]: WARNING nova.compute.manager [req-5f56db10-2164-483b-aa77-8611d75f99d5 req-0dd49d9b-6529-44da-bacc-3f05dd952f3b service nova] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Received unexpected event network-vif-plugged-fec9c34d-38ef-46e3-ad2d-47ec3e0895e1 for instance with vm_state deleted and task_state None.
Aug 03 04:43:33 user nova-compute[72444]: DEBUG nova.compute.manager [req-5f56db10-2164-483b-aa77-8611d75f99d5 req-0dd49d9b-6529-44da-bacc-3f05dd952f3b service nova] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Received event network-vif-deleted-fec9c34d-38ef-46e3-ad2d-47ec3e0895e1 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:43:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:36 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:43:37 user nova-compute[72444]: DEBUG nova.compute.manager [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VadZkgvF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '42f131f8-83ac-4fd4-b056-f8dac3d32c55', 'attached_at': '', 'detached_at': '', 'volume_id': '96716d59-f823-422e-83c6-0f9448733af5', 'serial': '96716d59-f823-422e-83c6-0f9448733af5'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TveiztUW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '42f131f8-83ac-4fd4-b056-f8dac3d32c55', 'attached_at': '', 'detached_at': '', 'volume_id': 'f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd', 'serial'} {{(pid=72444) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 03 04:43:37 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:43:37 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VadZkgvF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:43:37 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:43:37 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:43:37 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:43:37 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:43:37 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:43:37 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:43:37 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:43:37 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:37 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:37 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[57eeb8ff-5084-4e13-91b8-a5ba6c43f018]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:37 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 04:43:37 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:37 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:37 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:37 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ceebb8a-ecb9-425e-a95c-648b34124688]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:37 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5] added
Aug 03 04:43:37 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:37 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:37 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:37 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a512551a-d293-4e61-9038-6478520b5f0e]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:37 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:37 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:37 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:43:37 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:37 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[69301706-1b4d-47eb-be1f-2c583d1da9c7]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:37 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:37 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VadZkgvF {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:37 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VadZkgvF" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:37 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3f7a9d-34ab-4523-b925-b551f67c5049]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:37 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VadZkgvF'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:37 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:37 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:37 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[23470884-36be-4ad6-960d-06290473ff2b]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:37 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:37 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:37 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:37 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0269791-5540-4fc4-83a1-1fb219d4a21f]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:37 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:43:37 user nova-compute[72444]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:43:37 user nova-compute[72444]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd (non-flash)
Aug 03 04:43:37 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:43:37 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:43:37 user nova-compute[72444]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:43:37 user nova-compute[72444]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd (non-flash)
Aug 03 04:43:37 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:43:37 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[19437a9a-9b90-4af3-9e15-deedb13836d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5, portal: 172.16.0.220,3260]
Aug 03 04:43:38 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5, portal: 172.16.0.220,3260] successful.
Aug 03 04:43:38 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd6555e-73a7-41e2-a801-58d059177aa9]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[841a1e91-4edc-44e0-826b-2c9361aa2f48]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:43:38 user nova-compute[72444]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:43:38 user nova-compute[72444]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd (non-flash)
Aug 03 04:43:38 user nova-compute[72444]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 (non-flash)
Aug 03 04:43:38 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:43:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:43:38 user nova-compute[72444]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:43:38 user nova-compute[72444]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd (non-flash)
Aug 03 04:43:38 user nova-compute[72444]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 (non-flash)
Aug 03 04:43:38 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:43:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:43:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:43:38 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] HCTL ('36', '-', '-', 0) found on session 7 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:43:38 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:43:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ddc88f-bd5d-409b-9980-47f89cb039e4]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:38 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Searching for a device in session 7 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:43:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VadZkgvF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:43:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:38 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:43:38 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:43:38 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 04:43:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:43:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26562336133353930', 'path': '/dev/sde'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:43:39 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562336133353930', 'path': '/dev/sde'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:43:39 user nova-compute[72444]: DEBUG nova.objects.instance [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Lazy-loading 'flavor' on Instance uuid 42f131f8-83ac-4fd4-b056-f8dac3d32c55 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:43:39 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] COPY block job progress, current cursor: 5242880 final cursor: 1073741824 {{(pid=72444) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 03 04:43:39 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:43:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:43:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:43:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:43:39 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 04:43:40 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] COPY block job progress, current cursor: 158334976 final cursor: 1073741824 {{(pid=72444) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 03 04:43:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:40 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] COPY block job progress, current cursor: 315621376 final cursor: 1073741824 {{(pid=72444) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 03 04:43:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:43:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:43:40 user nova-compute[72444]: DEBUG nova.compute.manager [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 04:43:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:43:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:43:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] COPY block job progress, current cursor: 421527552 final cursor: 1073741824 {{(pid=72444) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 03 04:43:41 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 04:43:41 user nova-compute[72444]: INFO nova.compute.claims [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Claim successful on node user
Aug 03 04:43:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:43:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f131f8-83ac-4fd4-b056-f8dac3d32c55/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] COPY block job progress, current cursor: 592445440 final cursor: 1073741824 {{(pid=72444) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 03 04:43:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f131f8-83ac-4fd4-b056-f8dac3d32c55/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f131f8-83ac-4fd4-b056-f8dac3d32c55/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:41 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:43:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f131f8-83ac-4fd4-b056-f8dac3d32c55/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:43:41 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:43:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.824s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:43:42 user nova-compute[72444]: DEBUG nova.compute.manager [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 04:43:42 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691037807.0259662, 4d5c0324-68e8-4f0a-a740-0b4551e81fac => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:43:42 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] VM Stopped (Lifecycle Event)
Aug 03 04:43:42 user nova-compute[72444]: DEBUG nova.compute.manager [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 04:43:42 user nova-compute[72444]: DEBUG nova.network.neutron [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 04:43:42 user nova-compute[72444]: DEBUG nova.compute.manager [None req-f9635dbd-fcde-4014-9a55-6a1219e3624a None None] [instance: 4d5c0324-68e8-4f0a-a740-0b4551e81fac] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:43:42 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 04:43:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:42 user nova-compute[72444]: DEBUG nova.compute.manager [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 04:43:42 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] COPY block job progress, current cursor: 788529152 final cursor: 1073741824 {{(pid=72444) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 03 04:43:42 user nova-compute[72444]: DEBUG nova.policy [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ceede92aa3a74060a7f57d29d0d97aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '929fd4a3127b475282426d4412e58def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 04:43:42 user nova-compute[72444]: INFO nova.virt.block_device [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Booting with blank volume at /dev/vda
Aug 03 04:43:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:42 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] COPY block job progress, current cursor: 959447040 final cursor: 1073741824 {{(pid=72444) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 03 04:43:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07450ea8-cb80-4318-9fc9-4268944d2cae/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72444) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG nova.network.neutron [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Successfully created port: c14e16af-c17e-4152-a400-cbb8fb4f41fa {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07450ea8-cb80-4318-9fc9-4268944d2cae/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07450ea8-cb80-4318-9fc9-4268944d2cae/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TveiztUW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:43:43 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:43:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3188193d-6f60-4384-a8a2-38e2e666a6f7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[300faa53-455e-4348-8879-152196c25d5e]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:43:43 user nova-compute[72444]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:43:43 user nova-compute[72444]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd (non-flash)
Aug 03 04:43:43 user nova-compute[72444]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 (non-flash)
Aug 03 04:43:43 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:43:43 user nova-compute[72444]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:43:43 user nova-compute[72444]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd (non-flash)
Aug 03 04:43:43 user nova-compute[72444]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 (non-flash)
Aug 03 04:43:43 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3094493a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd'): ({'sdd'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Removing single pathed devices sdd {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07450ea8-cb80-4318-9fc9-4268944d2cae/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fc6435-ed33-4382-9e0f-103983a9e65d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9796ac93-3ba5-4f53-b9b8-e4cd5de7e692]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Flushing IO for device /dev/sdd {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d6eafc-e5ab-45b5-80ef-3007d1eaf4e6]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[029f2e63-edcf-4d68-86bf-e474b4d4596d]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] SCSI volumes sdd have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44f88e6-f61b-4372-a963-efaad223b096]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcb3897-7217-4bdc-b71a-f7df2d83a128]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd, portal: 172.16.0.220,3260]
Aug 03 04:43:43 user nova-compute[72444]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd, portal: 172.16.0.220,3260] successful.
Aug 03 04:43:43 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1300e9-1665-451d-9b3f-2f80fb8da337]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] <== disconnect_volume: return (312ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG nova.compute.manager [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VadZkgvF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '42f131f8-83ac-4fd4-b056-f8dac3d32c55', 'attached_at': '', 'detached_at': '', 'volume_id': '96716d59-f823-422e-83c6-0f9448733af5', 'serial'} {{(pid=72444) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG nova.compute.manager [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] swap_volume: removing Cinder connection for volume f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd {{(pid=72444) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445ab78e-a1f6-4a4c-bd63-44d149f88b35/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445ab78e-a1f6-4a4c-bd63-44d149f88b35/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445ab78e-a1f6-4a4c-bd63-44d149f88b35/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445ab78e-a1f6-4a4c-bd63-44d149f88b35/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:44 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:43:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/619ce0f2-51f9-4b87-9709-a736db645218/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/619ce0f2-51f9-4b87-9709-a736db645218/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/619ce0f2-51f9-4b87-9709-a736db645218/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:44 user nova-compute[72444]: DEBUG nova.network.neutron [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Successfully updated port: c14e16af-c17e-4152-a400-cbb8fb4f41fa {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:43:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "refresh_cache-2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:43:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquired lock "refresh_cache-2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:43:44 user nova-compute[72444]: DEBUG nova.network.neutron [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:43:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/619ce0f2-51f9-4b87-9709-a736db645218/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:44 user nova-compute[72444]: DEBUG nova.compute.manager [req-8b654d41-515e-48bf-ac81-5e5888bff07f req-3a6f687f-858a-4df3-a6e4-a77c279cb5b8 service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Received event network-changed-c14e16af-c17e-4152-a400-cbb8fb4f41fa {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:43:44 user nova-compute[72444]: DEBUG nova.compute.manager [req-8b654d41-515e-48bf-ac81-5e5888bff07f req-3a6f687f-858a-4df3-a6e4-a77c279cb5b8 service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Refreshing instance network info cache due to event network-changed-c14e16af-c17e-4152-a400-cbb8fb4f41fa. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:43:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8b654d41-515e-48bf-ac81-5e5888bff07f req-3a6f687f-858a-4df3-a6e4-a77c279cb5b8 service nova] Acquiring lock "refresh_cache-2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:43:44 user nova-compute[72444]: DEBUG nova.network.neutron [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:43:44 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:43:44 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:43:44 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=6861MB free_disk=25.718048095703125GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 04:43:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:43:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:43:45 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:43:45 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 81725845-6158-4e34-bedb-6e41219bc227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:43:45 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance b6ed9c42-fa6e-4a0d-8312-588471e157f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:43:45 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance e3089887-56df-42de-bc62-88e6db28daf0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:43:45 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance e2859322-6f99-442d-bee1-65fe49ce6360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:43:45 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 07450ea8-cb80-4318-9fc9-4268944d2cae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:43:45 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:43:45 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 42f131f8-83ac-4fd4-b056-f8dac3d32c55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:43:45 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 619ce0f2-51f9-4b87-9709-a736db645218 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:43:45 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 445ab78e-a1f6-4a4c-bd63-44d149f88b35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:43:45 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance ba7bd541-c761-4e4a-ac7c-7dd2cb89150d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:43:45 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:43:45 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 04:43:45 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 04:43:45 user nova-compute[72444]: DEBUG nova.network.neutron [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Updating instance_info_cache with network_info: [{"id": "c14e16af-c17e-4152-a400-cbb8fb4f41fa", "address": "fa:16:3e:05:10:6a", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14e16af-c1", "ovs_interfaceid": "c14e16af-c17e-4152-a400-cbb8fb4f41fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:43:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Releasing lock "refresh_cache-2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:43:45 user nova-compute[72444]: DEBUG nova.compute.manager [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Instance network_info: |[{"id": "c14e16af-c17e-4152-a400-cbb8fb4f41fa", "address": "fa:16:3e:05:10:6a", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14e16af-c1", "ovs_interfaceid": "c14e16af-c17e-4152-a400-cbb8fb4f41fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 04:43:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8b654d41-515e-48bf-ac81-5e5888bff07f req-3a6f687f-858a-4df3-a6e4-a77c279cb5b8 service nova] Acquired lock "refresh_cache-2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:43:45 user nova-compute[72444]: DEBUG nova.network.neutron [req-8b654d41-515e-48bf-ac81-5e5888bff07f req-3a6f687f-858a-4df3-a6e4-a77c279cb5b8 service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Refreshing network info cache for port c14e16af-c17e-4152-a400-cbb8fb4f41fa {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:43:45 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:43:45 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:43:45 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 04:43:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.571s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:43:45 user nova-compute[72444]: DEBUG nova.network.neutron [req-8b654d41-515e-48bf-ac81-5e5888bff07f req-3a6f687f-858a-4df3-a6e4-a77c279cb5b8 service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Updated VIF entry in instance network info cache for port c14e16af-c17e-4152-a400-cbb8fb4f41fa. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:43:45 user nova-compute[72444]: DEBUG nova.network.neutron [req-8b654d41-515e-48bf-ac81-5e5888bff07f req-3a6f687f-858a-4df3-a6e4-a77c279cb5b8 service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Updating instance_info_cache with network_info: [{"id": "c14e16af-c17e-4152-a400-cbb8fb4f41fa", "address": "fa:16:3e:05:10:6a", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14e16af-c1", "ovs_interfaceid": "c14e16af-c17e-4152-a400-cbb8fb4f41fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:43:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8b654d41-515e-48bf-ac81-5e5888bff07f req-3a6f687f-858a-4df3-a6e4-a77c279cb5b8 service nova] Releasing lock "refresh_cache-2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:43:46 user nova-compute[72444]: DEBUG nova.compute.manager [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] swap_volume: Updating volume f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "VadZkgvF", "auth_password": "rbhi9eJORBUPL0", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "96716d59-f823-422e-83c6-0f9448733af5"}, "status": "reserved", "instance": "42f131f8-83ac-4fd4-b056-f8dac3d32c55", "attached_at": "", "detached_at": "", "volume_id": "96716d59-f823-422e-83c6-0f9448733af5", "serial": "96716d59-f823-422e-83c6-0f9448733af5"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '96716d59-f823-422e-83c6-0f9448733af5', 'no_device': None, 'attachment_id': '20387a32-d182-4472-a8a7-9f190b0504bb'} {{(pid=72444) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 03 04:43:46 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:43:46 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 04:43:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7e5727ee-f872-4613-80ee-5c87da4d5c30 tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Lock "42f131f8-83ac-4fd4-b056-f8dac3d32c55" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 18.539s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:43:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-b6ed9c42-fa6e-4a0d-8312-588471e157f7" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:43:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-b6ed9c42-fa6e-4a0d-8312-588471e157f7" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:43:46 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 04:43:46 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691037811.8113487, ba81117e-fef4-4b0d-89ba-ba16aaeaf124 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:43:46 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] VM Stopped (Lifecycle Event)
Aug 03 04:43:46 user nova-compute[72444]: DEBUG nova.compute.manager [None req-0b002667-b713-48fe-a107-94de9f58c9db None None] [instance: ba81117e-fef4-4b0d-89ba-ba16aaeaf124] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:43:46 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:46 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Updating instance_info_cache with network_info: [{"id": "bd9827e6-3c6f-4bb3-8889-1ae45107f6f0", "address": "fa:16:3e:61:54:b7", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd9827e6-3c", "ovs_interfaceid": "bd9827e6-3c6f-4bb3-8889-1ae45107f6f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:43:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-b6ed9c42-fa6e-4a0d-8312-588471e157f7" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:43:47 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 04:43:47 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:43:47 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:43:47 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:43:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Acquiring lock "42f131f8-83ac-4fd4-b056-f8dac3d32c55" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:43:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Lock "42f131f8-83ac-4fd4-b056-f8dac3d32c55" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:43:47 user nova-compute[72444]: DEBUG os_brick.utils [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:43:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:47 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de557f5-3bfe-49b4-9bac-160ef9be7bb1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:47 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[348e17b8-bc93-4596-9af0-23e34629e18f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:47 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db6557b-b168-44ea-a02b-71501f4913cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:47 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2b3e78-658f-4e3c-8694-f8afeb2c7670]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:43:47 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 04:43:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:43:47 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 04:43:47 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d2c740-7e38-4cb2-82e6-6fbbffd0a166]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:47 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 04:43:47 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 04:43:47 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 04:43:47 user nova-compute[72444]: DEBUG os_brick.utils [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:43:47 user nova-compute[72444]: INFO nova.compute.manager [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Swapping volume 96716d59-f823-422e-83c6-0f9448733af5 for f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd
Aug 03 04:43:48 user nova-compute[72444]: DEBUG os_brick.utils [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:43:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:48 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f1e71f-58aa-459a-a1cb-cbc19c8138dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:48 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[08dba644-5436-4577-9dbf-939a5d8bbba6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:43:48 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ecf156-5a35-44ad-b4b6-572fa4402109]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:48 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff935f17-5598-40a5-ab39-4fd2d5fd6b65]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:43:48 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 04:43:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:43:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:43:48 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 04:43:48 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e189ca1a-05cf-4d64-83d3-eaed9904837d]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:43:48 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 04:43:48 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 04:43:48 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 04:43:48 user nova-compute[72444]: DEBUG os_brick.utils [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:43:48 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Updating existing volume attachment record: b14fb212-9627-4a48-a0a3-0568fbcfba34 {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 04:43:48 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:43:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:02 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG nova.compute.manager [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TveiztUW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '42f131f8-83ac-4fd4-b056-f8dac3d32c55', 'attached_at': '', 'detached_at': '', 'volume_id': 'f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd', 'serial': 'f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VadZkgvF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '96716d59-f823-422e-83c6-0f9448733af5'}, 'status': 'reserved', 'instance': '42f131f8-83ac-4fd4-b056-f8dac3d32c55', 'attached_at': '', 'detached_at': '', 'volume_id': '96716d59-f823-422e-83c6-0f9448733af5', 'serial'} {{(pid=72444) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TveiztUW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:44:06 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:44:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:44:06 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:44:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:44:06 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:44:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98da512-7859-4e65-8757-7dfed6bc346f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 04:44:06 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d6dc12-c9a4-4e10-bda0-d3e3b6e77bfb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd] added
Aug 03 04:44:06 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0911883e-7914-4b96-a2a7-372149a21660]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c6b4d5-d9ce-40f2-9ca2-89cec43bb035]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TveiztUW {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TveiztUW" returned: 0 in 0.027s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a6705d-2af1-4a1b-a67e-224b1ea9cfcb]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TveiztUW'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a229b11-b900-47ff-a2a3-a50d32e58201]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab3b154-ba36-4651-9112-69e9d7250080]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:44:06 user nova-compute[72444]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:44:06 user nova-compute[72444]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 (non-flash)
Aug 03 04:44:06 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:44:06 user nova-compute[72444]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:44:06 user nova-compute[72444]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 (non-flash)
Aug 03 04:44:06 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b2a42a-32bd-4d57-a31b-20deafa0daed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd, portal: 172.16.0.220,3260]
Aug 03 04:44:06 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd, portal: 172.16.0.220,3260] successful.
Aug 03 04:44:06 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[02537f61-6c99-4afe-96ea-baff7a127d2e]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad38e9f-ec93-4799-98f3-ceed33762d23]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:44:06 user nova-compute[72444]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:44:06 user nova-compute[72444]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 (non-flash)
Aug 03 04:44:06 user nova-compute[72444]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd (non-flash)
Aug 03 04:44:06 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:44:06 user nova-compute[72444]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:44:06 user nova-compute[72444]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 (non-flash)
Aug 03 04:44:06 user nova-compute[72444]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd (non-flash)
Aug 03 04:44:06 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] HCTL ('35', '-', '-', 0) found on session 8 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG nova.compute.manager [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 04:44:06 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Creating image(s)
Aug 03 04:44:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Did not create local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Ensure instance console log exists: /opt/stack/data/nova/instances/2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Start _get_guest_xml network_info=[{"id": "c14e16af-c17e-4152-a400-cbb8fb4f41fa", "address": "fa:16:3e:05:10:6a", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14e16af-c1", "ovs_interfaceid": "c14e16af-c17e-4152-a400-cbb8fb4f41fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RFpBszwX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15', 'attached_at': '', 'detached_at': '', 'volume_id': 'fe332412-b62b-4f63-abe0-b743ff189828', 'serial': 'fe332412-b62b-4f63-abe0-b743ff189828'}, 'disk_bus': 'virtio', 'attachment_id': 'b14fb212-9627-4a48-a0a3-0568fbcfba34', 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d53a78-13af-47f5-b92d-8ed71b557157]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Searching for a device in session 8 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TveiztUW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:44:06 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:44:06 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:44:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RFpBszwX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:44:06 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:44:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:44:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '26235333533666232', 'path': '/dev/sdd'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235333533666232', 'path': '/dev/sdd'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.954s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:44:07 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:44:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:44:07 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:44:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG nova.objects.instance [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Lazy-loading 'flavor' on Instance uuid 42f131f8-83ac-4fd4-b056-f8dac3d32c55 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd465c6-a141-4c27-8a75-6320099082d1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 04:44:07 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f0e2ce-5c39-4377-96c7-978bbf27c7ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828] added
Aug 03 04:44:07 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c49074-e13c-4622-b80b-a0a8ca570634]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[df645a6a-3503-4045-bbec-1cf2e9f5f4c7]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RFpBszwX {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RFpBszwX" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4224314c-9967-49ce-bf84-6950eb67e269]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RFpBszwX'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2374efd-38d7-4a88-8212-c791cba4b46d]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f003dc15-62ca-47d2-8186-11bd6c554a07]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:44:07 user nova-compute[72444]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:44:07 user nova-compute[72444]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 (non-flash)
Aug 03 04:44:07 user nova-compute[72444]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd (non-flash)
Aug 03 04:44:07 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:44:07 user nova-compute[72444]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:44:07 user nova-compute[72444]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 (non-flash)
Aug 03 04:44:07 user nova-compute[72444]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd (non-flash)
Aug 03 04:44:07 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[70179f0d-e2aa-4ec9-96a0-f3fcc41cbfb1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828, portal: 172.16.0.220,3260]
Aug 03 04:44:07 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828, portal: 172.16.0.220,3260] successful.
Aug 03 04:44:07 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6842611a-5042-40d2-a2f6-cfc897ab034d]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:44:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:08 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a01cc14-18b1-447c-af9c-b92b08131eaa]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:44:08 user nova-compute[72444]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:44:08 user nova-compute[72444]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 (non-flash)
Aug 03 04:44:08 user nova-compute[72444]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd (non-flash)
Aug 03 04:44:08 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:44:08 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:44:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:44:08 user nova-compute[72444]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:44:08 user nova-compute[72444]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 (non-flash)
Aug 03 04:44:08 user nova-compute[72444]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd (non-flash)
Aug 03 04:44:08 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:44:08 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:44:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:44:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:44:08 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] HCTL ('37', '-', '-', 0) found on session 9 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:44:08 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:44:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:08 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e357ec9-90ab-4b72-bcef-20f86894bf78]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:08 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Searching for a device in session 9 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:44:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RFpBszwX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:44:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72444) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 03 04:44:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] COPY block job progress, current cursor: 161480704 final cursor: 1073741824 {{(pid=72444) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 03 04:44:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:09 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.424s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:44:09 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] <== connect_volume: return (2378ms) {'type': 'block', 'scsi_wwn': '26334323031306438', 'path': '/dev/sdf'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:44:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334323031306438', 'path': '/dev/sdf'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:44:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:43:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1841165233',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1841165233',id=15,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='929fd4a3127b475282426d4412e58def',ramdisk_id='',reservation_id='r-p417nobm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1082770125',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:43:42Z,user_data=None,user_id='ceede92aa3a74060a7f57d29d0d97aee',uuid=2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c14e16af-c17e-4152-a400-cbb8fb4f41fa", "address": "fa:16:3e:05:10:6a", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14e16af-c1", "ovs_interfaceid": "c14e16af-c17e-4152-a400-cbb8fb4f41fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:44:09 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Converting VIF {"id": "c14e16af-c17e-4152-a400-cbb8fb4f41fa", "address": "fa:16:3e:05:10:6a", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14e16af-c1", "ovs_interfaceid": "c14e16af-c17e-4152-a400-cbb8fb4f41fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:44:09 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:10:6a,bridge_name='br-int',has_traffic_filtering=True,id=c14e16af-c17e-4152-a400-cbb8fb4f41fa,network=Network(0e8b3ddd-e35a-45eb-a34c-614654c25549),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc14e16af-c1') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:44:09 user nova-compute[72444]: DEBUG nova.objects.instance [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:44:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:44:09 user nova-compute[72444]:   <uuid>2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15</uuid>
Aug 03 04:44:09 user nova-compute[72444]:   <name>instance-0000000f</name>
Aug 03 04:44:09 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:44:09 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:44:09 user nova-compute[72444]:   <metadata>
Aug 03 04:44:09 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:44:09 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:44:09 user nova-compute[72444]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1841165233</nova:name>
Aug 03 04:44:09 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:44:06</nova:creationTime>
Aug 03 04:44:09 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:44:09 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:44:09 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:44:09 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:44:09 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:44:09 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:44:09 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:44:09 user nova-compute[72444]:       <nova:owner>
Aug 03 04:44:09 user nova-compute[72444]:         <nova:user uuid="ceede92aa3a74060a7f57d29d0d97aee">tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member</nova:user>
Aug 03 04:44:09 user nova-compute[72444]:         <nova:project uuid="929fd4a3127b475282426d4412e58def">tempest-ServerBootFromVolumeStableRescueTest-1082770125</nova:project>
Aug 03 04:44:09 user nova-compute[72444]:       </nova:owner>
Aug 03 04:44:09 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:44:09 user nova-compute[72444]:       <nova:ports>
Aug 03 04:44:09 user nova-compute[72444]:         <nova:port uuid="c14e16af-c17e-4152-a400-cbb8fb4f41fa">
Aug 03 04:44:09 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 03 04:44:09 user nova-compute[72444]:         </nova:port>
Aug 03 04:44:09 user nova-compute[72444]:       </nova:ports>
Aug 03 04:44:09 user nova-compute[72444]:     </nova:instance>
Aug 03 04:44:09 user nova-compute[72444]:   </metadata>
Aug 03 04:44:09 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:44:09 user nova-compute[72444]:     <system>
Aug 03 04:44:09 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:44:09 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:44:09 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:44:09 user nova-compute[72444]:       <entry name="serial">2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15</entry>
Aug 03 04:44:09 user nova-compute[72444]:       <entry name="uuid">2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15</entry>
Aug 03 04:44:09 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:44:09 user nova-compute[72444]:     </system>
Aug 03 04:44:09 user nova-compute[72444]:   </sysinfo>
Aug 03 04:44:09 user nova-compute[72444]:   <os>
Aug 03 04:44:09 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:44:09 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:44:09 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:44:09 user nova-compute[72444]:   </os>
Aug 03 04:44:09 user nova-compute[72444]:   <features>
Aug 03 04:44:09 user nova-compute[72444]:     <acpi/>
Aug 03 04:44:09 user nova-compute[72444]:     <apic/>
Aug 03 04:44:09 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:44:09 user nova-compute[72444]:   </features>
Aug 03 04:44:09 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:44:09 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:44:09 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:44:09 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:44:09 user nova-compute[72444]:   </clock>
Aug 03 04:44:09 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:44:09 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:44:09 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:44:09 user nova-compute[72444]:   </cpu>
Aug 03 04:44:09 user nova-compute[72444]:   <devices>
Aug 03 04:44:09 user nova-compute[72444]:     <disk type="block" device="disk">
Aug 03 04:44:09 user nova-compute[72444]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:44:09 user nova-compute[72444]:       <source dev="/dev/sdf"/>
Aug 03 04:44:09 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:44:09 user nova-compute[72444]:       <serial>fe332412-b62b-4f63-abe0-b743ff189828</serial>
Aug 03 04:44:09 user nova-compute[72444]:     </disk>
Aug 03 04:44:09 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:44:09 user nova-compute[72444]:       <mac address="fa:16:3e:05:10:6a"/>
Aug 03 04:44:09 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:44:09 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:44:09 user nova-compute[72444]:       <target dev="tapc14e16af-c1"/>
Aug 03 04:44:09 user nova-compute[72444]:     </interface>
Aug 03 04:44:09 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:44:09 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15/console.log" append="off"/>
Aug 03 04:44:09 user nova-compute[72444]:     </serial>
Aug 03 04:44:09 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:44:09 user nova-compute[72444]:     <video>
Aug 03 04:44:09 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:44:09 user nova-compute[72444]:     </video>
Aug 03 04:44:09 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:44:09 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:44:09 user nova-compute[72444]:     </rng>
Aug 03 04:44:09 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:44:09 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:44:09 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:44:09 user nova-compute[72444]:     </memballoon>
Aug 03 04:44:09 user nova-compute[72444]:   </devices>
Aug 03 04:44:09 user nova-compute[72444]: </domain>
Aug 03 04:44:09 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:44:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:43:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1841165233',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1841165233',id=15,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='929fd4a3127b475282426d4412e58def',ramdisk_id='',reservation_id='r-p417nobm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1082770125',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:43:42Z,user_data=None,user_id='ceede92aa3a74060a7f57d29d0d97aee',uuid=2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c14e16af-c17e-4152-a400-cbb8fb4f41fa", "address": "fa:16:3e:05:10:6a", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14e16af-c1", "ovs_interfaceid": "c14e16af-c17e-4152-a400-cbb8fb4f41fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:44:09 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Converting VIF {"id": "c14e16af-c17e-4152-a400-cbb8fb4f41fa", "address": "fa:16:3e:05:10:6a", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14e16af-c1", "ovs_interfaceid": "c14e16af-c17e-4152-a400-cbb8fb4f41fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:44:09 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:10:6a,bridge_name='br-int',has_traffic_filtering=True,id=c14e16af-c17e-4152-a400-cbb8fb4f41fa,network=Network(0e8b3ddd-e35a-45eb-a34c-614654c25549),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc14e16af-c1') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:44:09 user nova-compute[72444]: DEBUG os_vif [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:10:6a,bridge_name='br-int',has_traffic_filtering=True,id=c14e16af-c17e-4152-a400-cbb8fb4f41fa,network=Network(0e8b3ddd-e35a-45eb-a34c-614654c25549),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc14e16af-c1') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:44:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:44:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:44:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc14e16af-c1, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:44:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc14e16af-c1, col_values=(('external_ids', {'iface-id': 'c14e16af-c17e-4152-a400-cbb8fb4f41fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:10:6a', 'vm-uuid': '2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:44:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:44:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] COPY block job progress, current cursor: 301989888 final cursor: 1073741824 {{(pid=72444) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 03 04:44:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:09 user nova-compute[72444]: INFO os_vif [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:10:6a,bridge_name='br-int',has_traffic_filtering=True,id=c14e16af-c17e-4152-a400-cbb8fb4f41fa,network=Network(0e8b3ddd-e35a-45eb-a34c-614654c25549),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc14e16af-c1')
Aug 03 04:44:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:44:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] No VIF found with MAC fa:16:3e:05:10:6a, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:44:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] COPY block job progress, current cursor: 427819008 final cursor: 1073741824 {{(pid=72444) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 03 04:44:10 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] COPY block job progress, current cursor: 592445440 final cursor: 1073741824 {{(pid=72444) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 03 04:44:10 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] COPY block job progress, current cursor: 760217600 final cursor: 1073741824 {{(pid=72444) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 03 04:44:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] COPY block job progress, current cursor: 925892608 final cursor: 1073741824 {{(pid=72444) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 03 04:44:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:11 user nova-compute[72444]: DEBUG nova.compute.manager [req-2d0ec9c6-2612-40fd-a7d7-db460555e222 req-647efc23-6bac-4325-a958-bcbdd90c7ed5 service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Received event network-vif-plugged-c14e16af-c17e-4152-a400-cbb8fb4f41fa {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:44:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2d0ec9c6-2612-40fd-a7d7-db460555e222 req-647efc23-6bac-4325-a958-bcbdd90c7ed5 service nova] Acquiring lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:44:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2d0ec9c6-2612-40fd-a7d7-db460555e222 req-647efc23-6bac-4325-a958-bcbdd90c7ed5 service nova] Lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:44:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2d0ec9c6-2612-40fd-a7d7-db460555e222 req-647efc23-6bac-4325-a958-bcbdd90c7ed5 service nova] Lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:44:11 user nova-compute[72444]: DEBUG nova.compute.manager [req-2d0ec9c6-2612-40fd-a7d7-db460555e222 req-647efc23-6bac-4325-a958-bcbdd90c7ed5 service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] No waiting events found dispatching network-vif-plugged-c14e16af-c17e-4152-a400-cbb8fb4f41fa {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:44:11 user nova-compute[72444]: WARNING nova.compute.manager [req-2d0ec9c6-2612-40fd-a7d7-db460555e222 req-647efc23-6bac-4325-a958-bcbdd90c7ed5 service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Received unexpected event network-vif-plugged-c14e16af-c17e-4152-a400-cbb8fb4f41fa for instance with vm_state building and task_state spawning.
Aug 03 04:44:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] COPY block job progress, current cursor: 1046478848 final cursor: 1073741824 {{(pid=72444) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72444) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VadZkgvF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '96716d59-f823-422e-83c6-0f9448733af5'}, None), 'kwargs': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:44:12 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:44:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9220d0e8-cdc1-4618-8768-b3d8657fea46]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dedd1df-706e-4322-87fe-f689497445dc]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:44:12 user nova-compute[72444]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:44:12 user nova-compute[72444]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 (non-flash)
Aug 03 04:44:12 user nova-compute[72444]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd (non-flash)
Aug 03 04:44:12 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:44:12 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:44:12 user nova-compute[72444]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:44:12 user nova-compute[72444]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 (non-flash)
Aug 03 04:44:12 user nova-compute[72444]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd (non-flash)
Aug 03 04:44:12 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:44:12 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f309412dcf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5'): ({'sde'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Removing single pathed devices sde {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1ac748-4e63-4a24-afff-3c1fec1d4379]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6704bea3-081b-4108-be3c-0d42f23f383e]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Flushing IO for device /dev/sde {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0014ce7-c9b7-4a1b-967e-d0ce8006ad72]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4518be19-b651-4d0d-bfca-befa51436532]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] SCSI volumes sde have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1667dd58-87a9-4772-b174-4106103443eb]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bc0981-ecae-4706-8453-9941123f927f]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5, portal: 172.16.0.220,3260]
Aug 03 04:44:12 user nova-compute[72444]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5, portal: 172.16.0.220,3260] successful.
Aug 03 04:44:12 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96716d59-f823-422e-83c6-0f9448733af5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ceb095-eaa8-457e-b0f2-5ccdbd5b4504]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] <== disconnect_volume: return (292ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG nova.compute.manager [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TveiztUW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '42f131f8-83ac-4fd4-b056-f8dac3d32c55', 'attached_at': '', 'detached_at': '', 'volume_id': 'f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd', 'serial'} {{(pid=72444) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 03 04:44:12 user nova-compute[72444]: DEBUG nova.compute.manager [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] swap_volume: removing Cinder connection for volume 96716d59-f823-422e-83c6-0f9448733af5 {{(pid=72444) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 03 04:44:13 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037853.5313556, 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:44:13 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] VM Resumed (Lifecycle Event)
Aug 03 04:44:13 user nova-compute[72444]: DEBUG nova.compute.manager [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:44:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 04:44:13 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Instance spawned successfully.
Aug 03 04:44:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 04:44:13 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:44:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:44:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:44:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:44:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:44:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:44:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:44:13 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:44:13 user nova-compute[72444]: DEBUG nova.compute.manager [req-d1f888ea-db65-45c8-96e8-c574c808ec18 req-8cdd22a8-2381-4453-9ee6-d48e70a1cda7 service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Received event network-vif-plugged-c14e16af-c17e-4152-a400-cbb8fb4f41fa {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:44:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d1f888ea-db65-45c8-96e8-c574c808ec18 req-8cdd22a8-2381-4453-9ee6-d48e70a1cda7 service nova] Acquiring lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:44:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d1f888ea-db65-45c8-96e8-c574c808ec18 req-8cdd22a8-2381-4453-9ee6-d48e70a1cda7 service nova] Lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:44:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d1f888ea-db65-45c8-96e8-c574c808ec18 req-8cdd22a8-2381-4453-9ee6-d48e70a1cda7 service nova] Lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:44:13 user nova-compute[72444]: DEBUG nova.compute.manager [req-d1f888ea-db65-45c8-96e8-c574c808ec18 req-8cdd22a8-2381-4453-9ee6-d48e70a1cda7 service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] No waiting events found dispatching network-vif-plugged-c14e16af-c17e-4152-a400-cbb8fb4f41fa {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:44:13 user nova-compute[72444]: WARNING nova.compute.manager [req-d1f888ea-db65-45c8-96e8-c574c808ec18 req-8cdd22a8-2381-4453-9ee6-d48e70a1cda7 service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Received unexpected event network-vif-plugged-c14e16af-c17e-4152-a400-cbb8fb4f41fa for instance with vm_state building and task_state spawning.
Aug 03 04:44:13 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:44:13 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037853.5325904, 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:44:13 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] VM Started (Lifecycle Event)
Aug 03 04:44:13 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:44:13 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:44:13 user nova-compute[72444]: INFO nova.compute.manager [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Took 7.00 seconds to spawn the instance on the hypervisor.
Aug 03 04:44:13 user nova-compute[72444]: DEBUG nova.compute.manager [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:44:13 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:44:13 user nova-compute[72444]: INFO nova.compute.manager [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Took 32.63 seconds to build instance.
Aug 03 04:44:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-62f4da00-f269-49be-a547-5b93498f8392 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.925s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:44:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:17 user nova-compute[72444]: DEBUG nova.compute.manager [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] swap_volume: Updating volume 96716d59-f823-422e-83c6-0f9448733af5 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "TveiztUW", "auth_password": "cuIwNxr6ipsA1M", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdd", "volume_id": "f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd"}, "status": "reserved", "instance": "42f131f8-83ac-4fd4-b056-f8dac3d32c55", "attached_at": "", "detached_at": "", "volume_id": "f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd", "serial": "f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd', 'no_device': None, 'attachment_id': 'ee4c4293-06d3-47a3-b596-131e15136ba4'} {{(pid=72444) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 03 04:44:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0b005b2a-d1e8-485a-9a56-0425e15c476b tempest-TestVolumeSwap-1374865034 tempest-TestVolumeSwap-1374865034-project-admin] Lock "42f131f8-83ac-4fd4-b056-f8dac3d32c55" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 29.312s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:44:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f2bfb8b2-79bf-44eb-81a4-75084637a7d0 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Acquiring lock "42f131f8-83ac-4fd4-b056-f8dac3d32c55" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:44:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f2bfb8b2-79bf-44eb-81a4-75084637a7d0 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Lock "42f131f8-83ac-4fd4-b056-f8dac3d32c55" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:44:18 user nova-compute[72444]: INFO nova.compute.manager [None req-f2bfb8b2-79bf-44eb-81a4-75084637a7d0 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Detaching volume f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd
Aug 03 04:44:18 user nova-compute[72444]: INFO nova.virt.block_device [None req-f2bfb8b2-79bf-44eb-81a4-75084637a7d0 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Attempting to driver detach volume f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd from mountpoint /dev/vdb
Aug 03 04:44:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f2bfb8b2-79bf-44eb-81a4-75084637a7d0 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Attempting to detach device vdb from instance 42f131f8-83ac-4fd4-b056-f8dac3d32c55 from the persistent domain config. {{(pid=72444) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 04:44:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-f2bfb8b2-79bf-44eb-81a4-75084637a7d0 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 04:44:18 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:44:18 user nova-compute[72444]:   <source dev="/dev/sdd"/>
Aug 03 04:44:18 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:44:18 user nova-compute[72444]:   <serial>f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd</serial>
Aug 03 04:44:18 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 04:44:18 user nova-compute[72444]: </disk>
Aug 03 04:44:18 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:44:18 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-f2bfb8b2-79bf-44eb-81a4-75084637a7d0 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Successfully detached device vdb from instance 42f131f8-83ac-4fd4-b056-f8dac3d32c55 from the persistent domain config.
Aug 03 04:44:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f2bfb8b2-79bf-44eb-81a4-75084637a7d0 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 42f131f8-83ac-4fd4-b056-f8dac3d32c55 from the live domain config. {{(pid=72444) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 04:44:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-f2bfb8b2-79bf-44eb-81a4-75084637a7d0 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 04:44:18 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:44:18 user nova-compute[72444]:   <source dev="/dev/sdd"/>
Aug 03 04:44:18 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:44:18 user nova-compute[72444]:   <serial>f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd</serial>
Aug 03 04:44:18 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 04:44:18 user nova-compute[72444]: </disk>
Aug 03 04:44:18 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:44:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Received event <DeviceRemovedEvent: 1691037858.8080604, 42f131f8-83ac-4fd4-b056-f8dac3d32c55 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72444) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 04:44:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f2bfb8b2-79bf-44eb-81a4-75084637a7d0 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 42f131f8-83ac-4fd4-b056-f8dac3d32c55 {{(pid=72444) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 04:44:18 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-f2bfb8b2-79bf-44eb-81a4-75084637a7d0 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Successfully detached device vdb from instance 42f131f8-83ac-4fd4-b056-f8dac3d32c55 from the live domain config.
Aug 03 04:44:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2bfb8b2-79bf-44eb-81a4-75084637a7d0 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:44:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2bfb8b2-79bf-44eb-81a4-75084637a7d0 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TveiztUW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': 'f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd'}, None), 'kwargs': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:44:18 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-f2bfb8b2-79bf-44eb-81a4-75084637a7d0 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:44:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-f2bfb8b2-79bf-44eb-81a4-75084637a7d0 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:44:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-f2bfb8b2-79bf-44eb-81a4-75084637a7d0 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:44:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2bfb8b2-79bf-44eb-81a4-75084637a7d0 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:44:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:18 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9d18a2-49e3-4569-9d11-ce8a59060e17]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:18 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[474b8eb2-a6e5-4c8f-8b8a-a75259d601d4]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2bfb8b2-79bf-44eb-81a4-75084637a7d0 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:44:18 user nova-compute[72444]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:44:18 user nova-compute[72444]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd (non-flash)
Aug 03 04:44:18 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:44:18 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:44:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2bfb8b2-79bf-44eb-81a4-75084637a7d0 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:44:18 user nova-compute[72444]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:44:18 user nova-compute[72444]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd (non-flash)
Aug 03 04:44:18 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:44:18 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:44:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2bfb8b2-79bf-44eb-81a4-75084637a7d0 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3094331510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd'): ({'sdd'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:44:18 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-f2bfb8b2-79bf-44eb-81a4-75084637a7d0 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Removing single pathed devices sdd {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 04:44:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:18 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:18 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff60430b-cd9c-4af9-b75d-785dfc045b59]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:18 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2229d42b-c2c2-4f30-bd26-d270ff89ef39]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:18 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-f2bfb8b2-79bf-44eb-81a4-75084637a7d0 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Flushing IO for device /dev/sdd {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 04:44:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:18 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d361778-a86c-4b4c-b469-044e6cc84faf]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:18 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-f2bfb8b2-79bf-44eb-81a4-75084637a7d0 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 04:44:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:18 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3004cb-d5d3-4fc4-ba1f-790009f1ee65]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:18 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-f2bfb8b2-79bf-44eb-81a4-75084637a7d0 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 04:44:18 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-f2bfb8b2-79bf-44eb-81a4-75084637a7d0 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] SCSI volumes sdd have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 04:44:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2bfb8b2-79bf-44eb-81a4-75084637a7d0 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:44:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:19 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:19 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd5c1ee-df37-4ad2-a42f-b4d8467d32cf]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:19 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2bfb8b2-79bf-44eb-81a4-75084637a7d0 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:44:19 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:19 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:19 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e190b332-ee78-4297-846f-7d7537621ae7]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:19 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2bfb8b2-79bf-44eb-81a4-75084637a7d0 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd, portal: 172.16.0.220,3260]
Aug 03 04:44:19 user nova-compute[72444]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd, portal: 172.16.0.220,3260] successful.
Aug 03 04:44:19 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:44:19 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:19 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2d3bcd7-bab2-4f8f-b7c1-406fb8b1bedd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:19 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a23a48-8e7a-4cc7-88ac-9cc0a400b189]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:19 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2bfb8b2-79bf-44eb-81a4-75084637a7d0 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:44:19 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-f2bfb8b2-79bf-44eb-81a4-75084637a7d0 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:44:19 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2bfb8b2-79bf-44eb-81a4-75084637a7d0 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] <== disconnect_volume: return (268ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:44:19 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2bfb8b2-79bf-44eb-81a4-75084637a7d0 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:44:19 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:19 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Acquiring lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:44:19 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:44:19 user nova-compute[72444]: DEBUG nova.compute.manager [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 04:44:19 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:44:19 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:44:19 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 04:44:19 user nova-compute[72444]: INFO nova.compute.claims [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Claim successful on node user
Aug 03 04:44:19 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:44:19 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:44:19 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.526s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:44:19 user nova-compute[72444]: DEBUG nova.compute.manager [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 04:44:19 user nova-compute[72444]: DEBUG nova.compute.manager [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 04:44:19 user nova-compute[72444]: DEBUG nova.network.neutron [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 04:44:19 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 04:44:19 user nova-compute[72444]: DEBUG nova.compute.manager [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 04:44:20 user nova-compute[72444]: DEBUG nova.compute.manager [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 04:44:20 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 04:44:20 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Creating image(s)
Aug 03 04:44:20 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f1a45af-977b-43e2-a7dd-7a9c402840d1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:44:20 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lock "/opt/stack/data/nova/instances/6f1a45af-977b-43e2-a7dd-7a9c402840d1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:44:20 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lock "/opt/stack/data/nova/instances/6f1a45af-977b-43e2-a7dd-7a9c402840d1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:44:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.137s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:20 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:44:20 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:44:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:20 user nova-compute[72444]: DEBUG nova.policy [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0bdf7a13912407ea16fd1999be5ede0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dee6e42044847209f1357b13d6d126a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 04:44:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.140s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/6f1a45af-977b-43e2-a7dd-7a9c402840d1/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/6f1a45af-977b-43e2-a7dd-7a9c402840d1/disk 1073741824" returned: 0 in 0.054s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:20 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:44:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.131s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:20 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6f1a45af-977b-43e2-a7dd-7a9c402840d1/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 04:44:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f1a45af-977b-43e2-a7dd-7a9c402840d1/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f1a45af-977b-43e2-a7dd-7a9c402840d1/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:20 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Cannot resize image /opt/stack/data/nova/instances/6f1a45af-977b-43e2-a7dd-7a9c402840d1/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 04:44:20 user nova-compute[72444]: DEBUG nova.objects.instance [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lazy-loading 'migration_context' on Instance uuid 6f1a45af-977b-43e2-a7dd-7a9c402840d1 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:44:20 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 04:44:20 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Ensure instance console log exists: /opt/stack/data/nova/instances/6f1a45af-977b-43e2-a7dd-7a9c402840d1/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 04:44:20 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:44:20 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:44:20 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:44:21 user nova-compute[72444]: DEBUG nova.network.neutron [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Successfully created port: 5119da23-2d00-4603-ba9f-a9d0c35bf261 {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:44:21 user nova-compute[72444]: DEBUG nova.network.neutron [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Successfully updated port: 5119da23-2d00-4603-ba9f-a9d0c35bf261 {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:44:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Acquiring lock "refresh_cache-6f1a45af-977b-43e2-a7dd-7a9c402840d1" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:44:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Acquired lock "refresh_cache-6f1a45af-977b-43e2-a7dd-7a9c402840d1" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:44:21 user nova-compute[72444]: DEBUG nova.network.neutron [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:44:21 user nova-compute[72444]: DEBUG nova.compute.manager [req-b988482d-e593-4dc4-931b-644b44df0399 req-16350f96-53ec-4736-bc99-dc7ed67a1150 service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Received event network-changed-5119da23-2d00-4603-ba9f-a9d0c35bf261 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:44:21 user nova-compute[72444]: DEBUG nova.compute.manager [req-b988482d-e593-4dc4-931b-644b44df0399 req-16350f96-53ec-4736-bc99-dc7ed67a1150 service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Refreshing instance network info cache due to event network-changed-5119da23-2d00-4603-ba9f-a9d0c35bf261. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:44:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b988482d-e593-4dc4-931b-644b44df0399 req-16350f96-53ec-4736-bc99-dc7ed67a1150 service nova] Acquiring lock "refresh_cache-6f1a45af-977b-43e2-a7dd-7a9c402840d1" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:44:21 user nova-compute[72444]: DEBUG nova.network.neutron [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG nova.network.neutron [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Updating instance_info_cache with network_info: [{"id": "5119da23-2d00-4603-ba9f-a9d0c35bf261", "address": "fa:16:3e:b0:20:5c", "network": {"id": "609944ea-0d2a-43ad-9d2b-f06d1c67d9de", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1126534592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1dee6e42044847209f1357b13d6d126a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5119da23-2d", "ovs_interfaceid": "5119da23-2d00-4603-ba9f-a9d0c35bf261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Releasing lock "refresh_cache-6f1a45af-977b-43e2-a7dd-7a9c402840d1" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG nova.compute.manager [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Instance network_info: |[{"id": "5119da23-2d00-4603-ba9f-a9d0c35bf261", "address": "fa:16:3e:b0:20:5c", "network": {"id": "609944ea-0d2a-43ad-9d2b-f06d1c67d9de", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1126534592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1dee6e42044847209f1357b13d6d126a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5119da23-2d", "ovs_interfaceid": "5119da23-2d00-4603-ba9f-a9d0c35bf261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b988482d-e593-4dc4-931b-644b44df0399 req-16350f96-53ec-4736-bc99-dc7ed67a1150 service nova] Acquired lock "refresh_cache-6f1a45af-977b-43e2-a7dd-7a9c402840d1" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG nova.network.neutron [req-b988482d-e593-4dc4-931b-644b44df0399 req-16350f96-53ec-4736-bc99-dc7ed67a1150 service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Refreshing network info cache for port 5119da23-2d00-4603-ba9f-a9d0c35bf261 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Start _get_guest_xml network_info=[{"id": "5119da23-2d00-4603-ba9f-a9d0c35bf261", "address": "fa:16:3e:b0:20:5c", "network": {"id": "609944ea-0d2a-43ad-9d2b-f06d1c67d9de", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1126534592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1dee6e42044847209f1357b13d6d126a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5119da23-2d", "ovs_interfaceid": "5119da23-2d00-4603-ba9f-a9d0c35bf261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:44:22 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:44:22 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:44:22 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:44:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1468224080',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1468224080',id=16,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaZFwRNEZpiQfGHLwHZY0lzzbAVIRwXRC0MqbLmO16AzRtkc1PNUMZriWOCxZ3hf+0jC1htGoMbWFCsoXZ1AlanFdwAoHBAD6We6zi7g38fpOwMHB+xi90mEeGWehYqlA==',key_name='tempest-keypair-1754610092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1dee6e42044847209f1357b13d6d126a',ramdisk_id='',reservation_id='r-qunvoqox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1101837971',owner_user_name='tempest-TaggedAttachmentsTest-1101837971-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:44:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0bdf7a13912407ea16fd1999be5ede0',uuid=6f1a45af-977b-43e2-a7dd-7a9c402840d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5119da23-2d00-4603-ba9f-a9d0c35bf261", "address": "fa:16:3e:b0:20:5c", "network": {"id": "609944ea-0d2a-43ad-9d2b-f06d1c67d9de", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1126534592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1dee6e42044847209f1357b13d6d126a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5119da23-2d", "ovs_interfaceid": "5119da23-2d00-4603-ba9f-a9d0c35bf261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Converting VIF {"id": "5119da23-2d00-4603-ba9f-a9d0c35bf261", "address": "fa:16:3e:b0:20:5c", "network": {"id": "609944ea-0d2a-43ad-9d2b-f06d1c67d9de", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1126534592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1dee6e42044847209f1357b13d6d126a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5119da23-2d", "ovs_interfaceid": "5119da23-2d00-4603-ba9f-a9d0c35bf261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:20:5c,bridge_name='br-int',has_traffic_filtering=True,id=5119da23-2d00-4603-ba9f-a9d0c35bf261,network=Network(609944ea-0d2a-43ad-9d2b-f06d1c67d9de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5119da23-2d') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG nova.objects.instance [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f1a45af-977b-43e2-a7dd-7a9c402840d1 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:44:22 user nova-compute[72444]:   <uuid>6f1a45af-977b-43e2-a7dd-7a9c402840d1</uuid>
Aug 03 04:44:22 user nova-compute[72444]:   <name>instance-00000010</name>
Aug 03 04:44:22 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:44:22 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:44:22 user nova-compute[72444]:   <metadata>
Aug 03 04:44:22 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:44:22 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:44:22 user nova-compute[72444]:       <nova:name>tempest-device-tagging-server-1468224080</nova:name>
Aug 03 04:44:22 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:44:22</nova:creationTime>
Aug 03 04:44:22 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:44:22 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:44:22 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:44:22 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:44:22 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:44:22 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:44:22 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:44:22 user nova-compute[72444]:       <nova:owner>
Aug 03 04:44:22 user nova-compute[72444]:         <nova:user uuid="c0bdf7a13912407ea16fd1999be5ede0">tempest-TaggedAttachmentsTest-1101837971-project-member</nova:user>
Aug 03 04:44:22 user nova-compute[72444]:         <nova:project uuid="1dee6e42044847209f1357b13d6d126a">tempest-TaggedAttachmentsTest-1101837971</nova:project>
Aug 03 04:44:22 user nova-compute[72444]:       </nova:owner>
Aug 03 04:44:22 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:44:22 user nova-compute[72444]:       <nova:ports>
Aug 03 04:44:22 user nova-compute[72444]:         <nova:port uuid="5119da23-2d00-4603-ba9f-a9d0c35bf261">
Aug 03 04:44:22 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 03 04:44:22 user nova-compute[72444]:         </nova:port>
Aug 03 04:44:22 user nova-compute[72444]:       </nova:ports>
Aug 03 04:44:22 user nova-compute[72444]:     </nova:instance>
Aug 03 04:44:22 user nova-compute[72444]:   </metadata>
Aug 03 04:44:22 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:44:22 user nova-compute[72444]:     <system>
Aug 03 04:44:22 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:44:22 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:44:22 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:44:22 user nova-compute[72444]:       <entry name="serial">6f1a45af-977b-43e2-a7dd-7a9c402840d1</entry>
Aug 03 04:44:22 user nova-compute[72444]:       <entry name="uuid">6f1a45af-977b-43e2-a7dd-7a9c402840d1</entry>
Aug 03 04:44:22 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:44:22 user nova-compute[72444]:     </system>
Aug 03 04:44:22 user nova-compute[72444]:   </sysinfo>
Aug 03 04:44:22 user nova-compute[72444]:   <os>
Aug 03 04:44:22 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:44:22 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:44:22 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:44:22 user nova-compute[72444]:   </os>
Aug 03 04:44:22 user nova-compute[72444]:   <features>
Aug 03 04:44:22 user nova-compute[72444]:     <acpi/>
Aug 03 04:44:22 user nova-compute[72444]:     <apic/>
Aug 03 04:44:22 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:44:22 user nova-compute[72444]:   </features>
Aug 03 04:44:22 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:44:22 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:44:22 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:44:22 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:44:22 user nova-compute[72444]:   </clock>
Aug 03 04:44:22 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:44:22 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:44:22 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:44:22 user nova-compute[72444]:   </cpu>
Aug 03 04:44:22 user nova-compute[72444]:   <devices>
Aug 03 04:44:22 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:44:22 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:44:22 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/6f1a45af-977b-43e2-a7dd-7a9c402840d1/disk"/>
Aug 03 04:44:22 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:44:22 user nova-compute[72444]:     </disk>
Aug 03 04:44:22 user nova-compute[72444]:     <disk type="file" device="cdrom">
Aug 03 04:44:22 user nova-compute[72444]:       <driver name="qemu" type="raw" cache="none"/>
Aug 03 04:44:22 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/6f1a45af-977b-43e2-a7dd-7a9c402840d1/disk.config"/>
Aug 03 04:44:22 user nova-compute[72444]:       <target dev="hda" bus="ide"/>
Aug 03 04:44:22 user nova-compute[72444]:     </disk>
Aug 03 04:44:22 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:44:22 user nova-compute[72444]:       <mac address="fa:16:3e:b0:20:5c"/>
Aug 03 04:44:22 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:44:22 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:44:22 user nova-compute[72444]:       <target dev="tap5119da23-2d"/>
Aug 03 04:44:22 user nova-compute[72444]:     </interface>
Aug 03 04:44:22 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:44:22 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/6f1a45af-977b-43e2-a7dd-7a9c402840d1/console.log" append="off"/>
Aug 03 04:44:22 user nova-compute[72444]:     </serial>
Aug 03 04:44:22 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:44:22 user nova-compute[72444]:     <video>
Aug 03 04:44:22 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:44:22 user nova-compute[72444]:     </video>
Aug 03 04:44:22 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:44:22 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:44:22 user nova-compute[72444]:     </rng>
Aug 03 04:44:22 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:44:22 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:44:22 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:44:22 user nova-compute[72444]:     </memballoon>
Aug 03 04:44:22 user nova-compute[72444]:   </devices>
Aug 03 04:44:22 user nova-compute[72444]: </domain>
Aug 03 04:44:22 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:44:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1468224080',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1468224080',id=16,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaZFwRNEZpiQfGHLwHZY0lzzbAVIRwXRC0MqbLmO16AzRtkc1PNUMZriWOCxZ3hf+0jC1htGoMbWFCsoXZ1AlanFdwAoHBAD6We6zi7g38fpOwMHB+xi90mEeGWehYqlA==',key_name='tempest-keypair-1754610092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1dee6e42044847209f1357b13d6d126a',ramdisk_id='',reservation_id='r-qunvoqox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1101837971',owner_user_name='tempest-TaggedAttachmentsTest-1101837971-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:44:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0bdf7a13912407ea16fd1999be5ede0',uuid=6f1a45af-977b-43e2-a7dd-7a9c402840d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5119da23-2d00-4603-ba9f-a9d0c35bf261", "address": "fa:16:3e:b0:20:5c", "network": {"id": "609944ea-0d2a-43ad-9d2b-f06d1c67d9de", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1126534592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1dee6e42044847209f1357b13d6d126a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5119da23-2d", "ovs_interfaceid": "5119da23-2d00-4603-ba9f-a9d0c35bf261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Converting VIF {"id": "5119da23-2d00-4603-ba9f-a9d0c35bf261", "address": "fa:16:3e:b0:20:5c", "network": {"id": "609944ea-0d2a-43ad-9d2b-f06d1c67d9de", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1126534592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1dee6e42044847209f1357b13d6d126a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5119da23-2d", "ovs_interfaceid": "5119da23-2d00-4603-ba9f-a9d0c35bf261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:20:5c,bridge_name='br-int',has_traffic_filtering=True,id=5119da23-2d00-4603-ba9f-a9d0c35bf261,network=Network(609944ea-0d2a-43ad-9d2b-f06d1c67d9de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5119da23-2d') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG os_vif [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:20:5c,bridge_name='br-int',has_traffic_filtering=True,id=5119da23-2d00-4603-ba9f-a9d0c35bf261,network=Network(609944ea-0d2a-43ad-9d2b-f06d1c67d9de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5119da23-2d') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5119da23-2d, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5119da23-2d, col_values=(('external_ids', {'iface-id': '5119da23-2d00-4603-ba9f-a9d0c35bf261', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:20:5c', 'vm-uuid': '6f1a45af-977b-43e2-a7dd-7a9c402840d1'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:22 user nova-compute[72444]: INFO os_vif [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:20:5c,bridge_name='br-int',has_traffic_filtering=True,id=5119da23-2d00-4603-ba9f-a9d0c35bf261,network=Network(609944ea-0d2a-43ad-9d2b-f06d1c67d9de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5119da23-2d')
Aug 03 04:44:22 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] No BDM found with device name hda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] No VIF found with MAC fa:16:3e:b0:20:5c, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:44:22 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Using config drive
Aug 03 04:44:22 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Creating config drive at /opt/stack/data/nova/instances/6f1a45af-977b-43e2-a7dd-7a9c402840d1/disk.config
Aug 03 04:44:22 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6f1a45af-977b-43e2-a7dd-7a9c402840d1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpfd8v_b5s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6f1a45af-977b-43e2-a7dd-7a9c402840d1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpfd8v_b5s" returned: 0 in 0.066s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG nova.network.neutron [req-b988482d-e593-4dc4-931b-644b44df0399 req-16350f96-53ec-4736-bc99-dc7ed67a1150 service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Updated VIF entry in instance network info cache for port 5119da23-2d00-4603-ba9f-a9d0c35bf261. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG nova.network.neutron [req-b988482d-e593-4dc4-931b-644b44df0399 req-16350f96-53ec-4736-bc99-dc7ed67a1150 service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Updating instance_info_cache with network_info: [{"id": "5119da23-2d00-4603-ba9f-a9d0c35bf261", "address": "fa:16:3e:b0:20:5c", "network": {"id": "609944ea-0d2a-43ad-9d2b-f06d1c67d9de", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1126534592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1dee6e42044847209f1357b13d6d126a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5119da23-2d", "ovs_interfaceid": "5119da23-2d00-4603-ba9f-a9d0c35bf261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:44:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b988482d-e593-4dc4-931b-644b44df0399 req-16350f96-53ec-4736-bc99-dc7ed67a1150 service nova] Releasing lock "refresh_cache-6f1a45af-977b-43e2-a7dd-7a9c402840d1" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:44:23 user nova-compute[72444]: DEBUG nova.objects.instance [None req-f2bfb8b2-79bf-44eb-81a4-75084637a7d0 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Lazy-loading 'flavor' on Instance uuid 42f131f8-83ac-4fd4-b056-f8dac3d32c55 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:44:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f2bfb8b2-79bf-44eb-81a4-75084637a7d0 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Lock "42f131f8-83ac-4fd4-b056-f8dac3d32c55" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.252s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:44:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:24 user nova-compute[72444]: DEBUG nova.compute.manager [req-d050a6e9-518a-46d0-8d0f-e8ca8d321f23 req-8eae37bf-2727-4ac1-a8f5-4ada3e51a0c3 service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Received event network-vif-plugged-5119da23-2d00-4603-ba9f-a9d0c35bf261 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:44:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d050a6e9-518a-46d0-8d0f-e8ca8d321f23 req-8eae37bf-2727-4ac1-a8f5-4ada3e51a0c3 service nova] Acquiring lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:44:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d050a6e9-518a-46d0-8d0f-e8ca8d321f23 req-8eae37bf-2727-4ac1-a8f5-4ada3e51a0c3 service nova] Lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:44:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d050a6e9-518a-46d0-8d0f-e8ca8d321f23 req-8eae37bf-2727-4ac1-a8f5-4ada3e51a0c3 service nova] Lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:44:24 user nova-compute[72444]: DEBUG nova.compute.manager [req-d050a6e9-518a-46d0-8d0f-e8ca8d321f23 req-8eae37bf-2727-4ac1-a8f5-4ada3e51a0c3 service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] No waiting events found dispatching network-vif-plugged-5119da23-2d00-4603-ba9f-a9d0c35bf261 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:44:24 user nova-compute[72444]: WARNING nova.compute.manager [req-d050a6e9-518a-46d0-8d0f-e8ca8d321f23 req-8eae37bf-2727-4ac1-a8f5-4ada3e51a0c3 service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Received unexpected event network-vif-plugged-5119da23-2d00-4603-ba9f-a9d0c35bf261 for instance with vm_state building and task_state spawning.
Aug 03 04:44:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:26 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037866.439007, 6f1a45af-977b-43e2-a7dd-7a9c402840d1 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:44:26 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] VM Resumed (Lifecycle Event)
Aug 03 04:44:26 user nova-compute[72444]: DEBUG nova.compute.manager [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:44:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 04:44:26 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Instance spawned successfully.
Aug 03 04:44:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 04:44:26 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:44:26 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:44:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:44:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:44:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:44:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:44:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:44:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:44:26 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:44:26 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037866.4436235, 6f1a45af-977b-43e2-a7dd-7a9c402840d1 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:44:26 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] VM Started (Lifecycle Event)
Aug 03 04:44:26 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:44:26 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:44:26 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:44:26 user nova-compute[72444]: INFO nova.compute.manager [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Took 6.47 seconds to spawn the instance on the hypervisor.
Aug 03 04:44:26 user nova-compute[72444]: DEBUG nova.compute.manager [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:44:26 user nova-compute[72444]: INFO nova.compute.manager [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Took 7.35 seconds to build instance.
Aug 03 04:44:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-24521137-36c7-45e9-aab6-5cb3f0ad24c2 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.459s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:44:26 user nova-compute[72444]: DEBUG nova.compute.manager [req-d0ceafb5-0569-4c47-a3b0-2618314dbb78 req-a14693ce-2905-4b1e-8b42-1f93d4b6db03 service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Received event network-vif-plugged-5119da23-2d00-4603-ba9f-a9d0c35bf261 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:44:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d0ceafb5-0569-4c47-a3b0-2618314dbb78 req-a14693ce-2905-4b1e-8b42-1f93d4b6db03 service nova] Acquiring lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:44:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d0ceafb5-0569-4c47-a3b0-2618314dbb78 req-a14693ce-2905-4b1e-8b42-1f93d4b6db03 service nova] Lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:44:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d0ceafb5-0569-4c47-a3b0-2618314dbb78 req-a14693ce-2905-4b1e-8b42-1f93d4b6db03 service nova] Lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:44:26 user nova-compute[72444]: DEBUG nova.compute.manager [req-d0ceafb5-0569-4c47-a3b0-2618314dbb78 req-a14693ce-2905-4b1e-8b42-1f93d4b6db03 service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] No waiting events found dispatching network-vif-plugged-5119da23-2d00-4603-ba9f-a9d0c35bf261 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:44:26 user nova-compute[72444]: WARNING nova.compute.manager [req-d0ceafb5-0569-4c47-a3b0-2618314dbb78 req-a14693ce-2905-4b1e-8b42-1f93d4b6db03 service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Received unexpected event network-vif-plugged-5119da23-2d00-4603-ba9f-a9d0c35bf261 for instance with vm_state active and task_state None.
Aug 03 04:44:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-eb843a81-bcb9-49b0-8ecb-cb19f592eb48 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Acquiring lock "619ce0f2-51f9-4b87-9709-a736db645218" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:44:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-eb843a81-bcb9-49b0-8ecb-cb19f592eb48 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Lock "619ce0f2-51f9-4b87-9709-a736db645218" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:44:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-eb843a81-bcb9-49b0-8ecb-cb19f592eb48 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Acquiring lock "619ce0f2-51f9-4b87-9709-a736db645218-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:44:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-eb843a81-bcb9-49b0-8ecb-cb19f592eb48 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Lock "619ce0f2-51f9-4b87-9709-a736db645218-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:44:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-eb843a81-bcb9-49b0-8ecb-cb19f592eb48 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Lock "619ce0f2-51f9-4b87-9709-a736db645218-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:44:29 user nova-compute[72444]: INFO nova.compute.manager [None req-eb843a81-bcb9-49b0-8ecb-cb19f592eb48 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Terminating instance
Aug 03 04:44:29 user nova-compute[72444]: DEBUG nova.compute.manager [None req-eb843a81-bcb9-49b0-8ecb-cb19f592eb48 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 04:44:29 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:29 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:30 user nova-compute[72444]: DEBUG nova.compute.manager [req-56d65a54-8a49-4ece-b4c2-14b0e4c32637 req-4e671ab2-24a4-4622-add9-057ee2389e38 service nova] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Received event network-vif-unplugged-60932a4b-e500-42ba-b61b-997a0ec85e0c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:44:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-56d65a54-8a49-4ece-b4c2-14b0e4c32637 req-4e671ab2-24a4-4622-add9-057ee2389e38 service nova] Acquiring lock "619ce0f2-51f9-4b87-9709-a736db645218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:44:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-56d65a54-8a49-4ece-b4c2-14b0e4c32637 req-4e671ab2-24a4-4622-add9-057ee2389e38 service nova] Lock "619ce0f2-51f9-4b87-9709-a736db645218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:44:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-56d65a54-8a49-4ece-b4c2-14b0e4c32637 req-4e671ab2-24a4-4622-add9-057ee2389e38 service nova] Lock "619ce0f2-51f9-4b87-9709-a736db645218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:44:30 user nova-compute[72444]: DEBUG nova.compute.manager [req-56d65a54-8a49-4ece-b4c2-14b0e4c32637 req-4e671ab2-24a4-4622-add9-057ee2389e38 service nova] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] No waiting events found dispatching network-vif-unplugged-60932a4b-e500-42ba-b61b-997a0ec85e0c {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:44:30 user nova-compute[72444]: DEBUG nova.compute.manager [req-56d65a54-8a49-4ece-b4c2-14b0e4c32637 req-4e671ab2-24a4-4622-add9-057ee2389e38 service nova] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Received event network-vif-unplugged-60932a4b-e500-42ba-b61b-997a0ec85e0c for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:44:30 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Instance destroyed successfully.
Aug 03 04:44:30 user nova-compute[72444]: DEBUG nova.objects.instance [None req-eb843a81-bcb9-49b0-8ecb-cb19f592eb48 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Lazy-loading 'resources' on Instance uuid 619ce0f2-51f9-4b87-9709-a736db645218 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:44:30 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-eb843a81-bcb9-49b0-8ecb-cb19f592eb48 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:42:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1126375205',display_name='tempest-ServersNegativeTestJSON-server-1126375205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1126375205',id=12,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:42:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81df940dade241e1a3560045086f8699',ramdisk_id='',reservation_id='r-6mbcm7zi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-2144635638',owner_user_name='tempest-ServersNegativeTestJSON-2144635638-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:42:48Z,user_data=None,user_id='f3d18e55922c4d41bea8cc96c6c7cae3',uuid=619ce0f2-51f9-4b87-9709-a736db645218,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60932a4b-e500-42ba-b61b-997a0ec85e0c", "address": "fa:16:3e:2f:31:01", "network": {"id": "6ec6c203-3446-4671-84b4-9d6a55757afb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1998429186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81df940dade241e1a3560045086f8699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60932a4b-e5", "ovs_interfaceid": "60932a4b-e500-42ba-b61b-997a0ec85e0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:44:30 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-eb843a81-bcb9-49b0-8ecb-cb19f592eb48 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Converting VIF {"id": "60932a4b-e500-42ba-b61b-997a0ec85e0c", "address": "fa:16:3e:2f:31:01", "network": {"id": "6ec6c203-3446-4671-84b4-9d6a55757afb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1998429186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81df940dade241e1a3560045086f8699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60932a4b-e5", "ovs_interfaceid": "60932a4b-e500-42ba-b61b-997a0ec85e0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:44:30 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-eb843a81-bcb9-49b0-8ecb-cb19f592eb48 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:31:01,bridge_name='br-int',has_traffic_filtering=True,id=60932a4b-e500-42ba-b61b-997a0ec85e0c,network=Network(6ec6c203-3446-4671-84b4-9d6a55757afb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60932a4b-e5') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:44:30 user nova-compute[72444]: DEBUG os_vif [None req-eb843a81-bcb9-49b0-8ecb-cb19f592eb48 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:31:01,bridge_name='br-int',has_traffic_filtering=True,id=60932a4b-e500-42ba-b61b-997a0ec85e0c,network=Network(6ec6c203-3446-4671-84b4-9d6a55757afb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60932a4b-e5') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:44:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60932a4b-e5, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:44:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:44:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:30 user nova-compute[72444]: INFO os_vif [None req-eb843a81-bcb9-49b0-8ecb-cb19f592eb48 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:31:01,bridge_name='br-int',has_traffic_filtering=True,id=60932a4b-e500-42ba-b61b-997a0ec85e0c,network=Network(6ec6c203-3446-4671-84b4-9d6a55757afb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60932a4b-e5')
Aug 03 04:44:30 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-eb843a81-bcb9-49b0-8ecb-cb19f592eb48 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Deleting instance files /opt/stack/data/nova/instances/619ce0f2-51f9-4b87-9709-a736db645218_del
Aug 03 04:44:30 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-eb843a81-bcb9-49b0-8ecb-cb19f592eb48 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Deletion of /opt/stack/data/nova/instances/619ce0f2-51f9-4b87-9709-a736db645218_del complete
Aug 03 04:44:30 user nova-compute[72444]: INFO nova.compute.manager [None req-eb843a81-bcb9-49b0-8ecb-cb19f592eb48 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Took 1.04 seconds to destroy the instance on the hypervisor.
Aug 03 04:44:30 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-eb843a81-bcb9-49b0-8ecb-cb19f592eb48 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 04:44:30 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 04:44:30 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 04:44:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-6a33d367-0200-46a4-881b-a12039fbc590 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Acquiring lock "445ab78e-a1f6-4a4c-bd63-44d149f88b35" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:44:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-6a33d367-0200-46a4-881b-a12039fbc590 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Lock "445ab78e-a1f6-4a4c-bd63-44d149f88b35" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:44:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-6a33d367-0200-46a4-881b-a12039fbc590 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Acquiring lock "445ab78e-a1f6-4a4c-bd63-44d149f88b35-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:44:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-6a33d367-0200-46a4-881b-a12039fbc590 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Lock "445ab78e-a1f6-4a4c-bd63-44d149f88b35-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:44:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-6a33d367-0200-46a4-881b-a12039fbc590 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Lock "445ab78e-a1f6-4a4c-bd63-44d149f88b35-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:44:31 user nova-compute[72444]: INFO nova.compute.manager [None req-6a33d367-0200-46a4-881b-a12039fbc590 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Terminating instance
Aug 03 04:44:31 user nova-compute[72444]: DEBUG nova.compute.manager [None req-6a33d367-0200-46a4-881b-a12039fbc590 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 04:44:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:31 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:44:32 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Took 1.26 seconds to deallocate network for instance.
Aug 03 04:44:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-eb843a81-bcb9-49b0-8ecb-cb19f592eb48 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:44:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-eb843a81-bcb9-49b0-8ecb-cb19f592eb48 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:44:32 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Instance destroyed successfully.
Aug 03 04:44:32 user nova-compute[72444]: DEBUG nova.objects.instance [None req-6a33d367-0200-46a4-881b-a12039fbc590 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Lazy-loading 'resources' on Instance uuid 445ab78e-a1f6-4a4c-bd63-44d149f88b35 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:44:32 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-6a33d367-0200-46a4-881b-a12039fbc590 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-407780263',display_name='tempest-VolumesActionsTest-instance-407780263',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-407780263',id=13,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:42:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c520dc44eff4401789ef1ff61cc24cd4',ramdisk_id='',reservation_id='r-asomca4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-684402275',owner_user_name='tempest-VolumesActionsTest-684402275-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:42:53Z,user_data=None,user_id='099a590e90f043cba5b076c8dd75999d',uuid=445ab78e-a1f6-4a4c-bd63-44d149f88b35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24", "address": "fa:16:3e:27:2b:3b", "network": {"id": "23b52932-5969-4b02-8d35-6cbc7f007838", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1885096873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c520dc44eff4401789ef1ff61cc24cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b3b54c1-f1", "ovs_interfaceid": "7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:44:32 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-6a33d367-0200-46a4-881b-a12039fbc590 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Converting VIF {"id": "7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24", "address": "fa:16:3e:27:2b:3b", "network": {"id": "23b52932-5969-4b02-8d35-6cbc7f007838", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1885096873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c520dc44eff4401789ef1ff61cc24cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b3b54c1-f1", "ovs_interfaceid": "7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:44:32 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-6a33d367-0200-46a4-881b-a12039fbc590 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:2b:3b,bridge_name='br-int',has_traffic_filtering=True,id=7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24,network=Network(23b52932-5969-4b02-8d35-6cbc7f007838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b3b54c1-f1') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:44:32 user nova-compute[72444]: DEBUG os_vif [None req-6a33d367-0200-46a4-881b-a12039fbc590 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:2b:3b,bridge_name='br-int',has_traffic_filtering=True,id=7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24,network=Network(23b52932-5969-4b02-8d35-6cbc7f007838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b3b54c1-f1') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:44:32 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:32 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b3b54c1-f1, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:44:32 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:32 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:44:32 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:32 user nova-compute[72444]: INFO os_vif [None req-6a33d367-0200-46a4-881b-a12039fbc590 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:2b:3b,bridge_name='br-int',has_traffic_filtering=True,id=7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24,network=Network(23b52932-5969-4b02-8d35-6cbc7f007838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b3b54c1-f1')
Aug 03 04:44:32 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-6a33d367-0200-46a4-881b-a12039fbc590 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Deleting instance files /opt/stack/data/nova/instances/445ab78e-a1f6-4a4c-bd63-44d149f88b35_del
Aug 03 04:44:32 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-6a33d367-0200-46a4-881b-a12039fbc590 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Deletion of /opt/stack/data/nova/instances/445ab78e-a1f6-4a4c-bd63-44d149f88b35_del complete
Aug 03 04:44:32 user nova-compute[72444]: DEBUG nova.compute.manager [req-73f19b37-5fd5-4cd1-87f8-c4b489d8ec87 req-a03107ab-49f5-4475-9f61-60ad2b62ddcd service nova] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Received event network-vif-plugged-60932a4b-e500-42ba-b61b-997a0ec85e0c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:44:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-73f19b37-5fd5-4cd1-87f8-c4b489d8ec87 req-a03107ab-49f5-4475-9f61-60ad2b62ddcd service nova] Acquiring lock "619ce0f2-51f9-4b87-9709-a736db645218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:44:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-73f19b37-5fd5-4cd1-87f8-c4b489d8ec87 req-a03107ab-49f5-4475-9f61-60ad2b62ddcd service nova] Lock "619ce0f2-51f9-4b87-9709-a736db645218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:44:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-73f19b37-5fd5-4cd1-87f8-c4b489d8ec87 req-a03107ab-49f5-4475-9f61-60ad2b62ddcd service nova] Lock "619ce0f2-51f9-4b87-9709-a736db645218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:44:32 user nova-compute[72444]: DEBUG nova.compute.manager [req-73f19b37-5fd5-4cd1-87f8-c4b489d8ec87 req-a03107ab-49f5-4475-9f61-60ad2b62ddcd service nova] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] No waiting events found dispatching network-vif-plugged-60932a4b-e500-42ba-b61b-997a0ec85e0c {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:44:32 user nova-compute[72444]: WARNING nova.compute.manager [req-73f19b37-5fd5-4cd1-87f8-c4b489d8ec87 req-a03107ab-49f5-4475-9f61-60ad2b62ddcd service nova] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Received unexpected event network-vif-plugged-60932a4b-e500-42ba-b61b-997a0ec85e0c for instance with vm_state deleted and task_state None.
Aug 03 04:44:32 user nova-compute[72444]: DEBUG nova.compute.manager [req-73f19b37-5fd5-4cd1-87f8-c4b489d8ec87 req-a03107ab-49f5-4475-9f61-60ad2b62ddcd service nova] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Received event network-vif-unplugged-7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:44:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-73f19b37-5fd5-4cd1-87f8-c4b489d8ec87 req-a03107ab-49f5-4475-9f61-60ad2b62ddcd service nova] Acquiring lock "445ab78e-a1f6-4a4c-bd63-44d149f88b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:44:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-73f19b37-5fd5-4cd1-87f8-c4b489d8ec87 req-a03107ab-49f5-4475-9f61-60ad2b62ddcd service nova] Lock "445ab78e-a1f6-4a4c-bd63-44d149f88b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:44:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-73f19b37-5fd5-4cd1-87f8-c4b489d8ec87 req-a03107ab-49f5-4475-9f61-60ad2b62ddcd service nova] Lock "445ab78e-a1f6-4a4c-bd63-44d149f88b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:44:32 user nova-compute[72444]: DEBUG nova.compute.manager [req-73f19b37-5fd5-4cd1-87f8-c4b489d8ec87 req-a03107ab-49f5-4475-9f61-60ad2b62ddcd service nova] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] No waiting events found dispatching network-vif-unplugged-7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:44:32 user nova-compute[72444]: DEBUG nova.compute.manager [req-73f19b37-5fd5-4cd1-87f8-c4b489d8ec87 req-a03107ab-49f5-4475-9f61-60ad2b62ddcd service nova] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Received event network-vif-unplugged-7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24 for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:44:32 user nova-compute[72444]: DEBUG nova.compute.manager [req-73f19b37-5fd5-4cd1-87f8-c4b489d8ec87 req-a03107ab-49f5-4475-9f61-60ad2b62ddcd service nova] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Received event network-vif-deleted-60932a4b-e500-42ba-b61b-997a0ec85e0c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:44:32 user nova-compute[72444]: DEBUG nova.compute.manager [req-73f19b37-5fd5-4cd1-87f8-c4b489d8ec87 req-a03107ab-49f5-4475-9f61-60ad2b62ddcd service nova] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Received event network-vif-plugged-7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:44:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-73f19b37-5fd5-4cd1-87f8-c4b489d8ec87 req-a03107ab-49f5-4475-9f61-60ad2b62ddcd service nova] Acquiring lock "445ab78e-a1f6-4a4c-bd63-44d149f88b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:44:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-73f19b37-5fd5-4cd1-87f8-c4b489d8ec87 req-a03107ab-49f5-4475-9f61-60ad2b62ddcd service nova] Lock "445ab78e-a1f6-4a4c-bd63-44d149f88b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:44:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-73f19b37-5fd5-4cd1-87f8-c4b489d8ec87 req-a03107ab-49f5-4475-9f61-60ad2b62ddcd service nova] Lock "445ab78e-a1f6-4a4c-bd63-44d149f88b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:44:32 user nova-compute[72444]: DEBUG nova.compute.manager [req-73f19b37-5fd5-4cd1-87f8-c4b489d8ec87 req-a03107ab-49f5-4475-9f61-60ad2b62ddcd service nova] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] No waiting events found dispatching network-vif-plugged-7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:44:32 user nova-compute[72444]: WARNING nova.compute.manager [req-73f19b37-5fd5-4cd1-87f8-c4b489d8ec87 req-a03107ab-49f5-4475-9f61-60ad2b62ddcd service nova] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Received unexpected event network-vif-plugged-7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24 for instance with vm_state active and task_state deleting.
Aug 03 04:44:32 user nova-compute[72444]: INFO nova.compute.manager [None req-6a33d367-0200-46a4-881b-a12039fbc590 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Took 1.05 seconds to destroy the instance on the hypervisor.
Aug 03 04:44:32 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-6a33d367-0200-46a4-881b-a12039fbc590 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 04:44:32 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 04:44:32 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 04:44:32 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-eb843a81-bcb9-49b0-8ecb-cb19f592eb48 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:44:32 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-eb843a81-bcb9-49b0-8ecb-cb19f592eb48 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:44:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-eb843a81-bcb9-49b0-8ecb-cb19f592eb48 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.566s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:44:32 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-eb843a81-bcb9-49b0-8ecb-cb19f592eb48 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Deleted allocations for instance 619ce0f2-51f9-4b87-9709-a736db645218
Aug 03 04:44:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-eb843a81-bcb9-49b0-8ecb-cb19f592eb48 tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Lock "619ce0f2-51f9-4b87-9709-a736db645218" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.100s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:44:32 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:44:32 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Took 0.72 seconds to deallocate network for instance.
Aug 03 04:44:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-6a33d367-0200-46a4-881b-a12039fbc590 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:44:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-6a33d367-0200-46a4-881b-a12039fbc590 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:44:33 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-6a33d367-0200-46a4-881b-a12039fbc590 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:44:33 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-6a33d367-0200-46a4-881b-a12039fbc590 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:44:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-6a33d367-0200-46a4-881b-a12039fbc590 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.585s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:44:33 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-6a33d367-0200-46a4-881b-a12039fbc590 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Deleted allocations for instance 445ab78e-a1f6-4a4c-bd63-44d149f88b35
Aug 03 04:44:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-6a33d367-0200-46a4-881b-a12039fbc590 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Lock "445ab78e-a1f6-4a4c-bd63-44d149f88b35" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.575s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:44:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:34 user nova-compute[72444]: DEBUG nova.compute.manager [req-d023808f-0c40-4ed6-840d-621a89da5678 req-7573741a-2583-4484-aca5-3d37fc619d5f service nova] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Received event network-vif-deleted-7b3b54c1-f1a8-4b8a-90dd-76ad0b9ccc24 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:44:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:37 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:44:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:38 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:44:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:39 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:44:40 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:44:40 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:44:40 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 04:44:41 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:44:41 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:44:41 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:44:41 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:44:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:44:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:44:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:44:41 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 04:44:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:44:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f131f8-83ac-4fd4-b056-f8dac3d32c55/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f131f8-83ac-4fd4-b056-f8dac3d32c55/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f131f8-83ac-4fd4-b056-f8dac3d32c55/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f131f8-83ac-4fd4-b056-f8dac3d32c55/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:43 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "e2859322-6f99-442d-bee1-65fe49ce6360" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:44:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "e2859322-6f99-442d-bee1-65fe49ce6360" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:44:44 user nova-compute[72444]: DEBUG nova.objects.instance [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lazy-loading 'flavor' on Instance uuid e2859322-6f99-442d-bee1-65fe49ce6360 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:44:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "e2859322-6f99-442d-bee1-65fe49ce6360" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:44:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07450ea8-cb80-4318-9fc9-4268944d2cae/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07450ea8-cb80-4318-9fc9-4268944d2cae/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07450ea8-cb80-4318-9fc9-4268944d2cae/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "e2859322-6f99-442d-bee1-65fe49ce6360" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:44:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "e2859322-6f99-442d-bee1-65fe49ce6360" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:44:44 user nova-compute[72444]: INFO nova.compute.manager [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Attaching volume 6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 to /dev/vdb
Aug 03 04:44:44 user nova-compute[72444]: DEBUG os_brick.utils [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:44:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:44 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96fa200-acdf-4c1e-97e1-1119d00d050f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07450ea8-cb80-4318-9fc9-4268944d2cae/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:44 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[36627c82-c27d-4ba0-9382-ac0b74326798]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:44 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[37732d71-e09c-4154-a877-c52fcbc39404]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:44 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7267df9-6bd5-4335-9953-00279b0496d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:44:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 04:44:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:44:44 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 04:44:44 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2587c5-7c3e-4c9a-b036-320d738269b4]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 04:44:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 04:44:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 04:44:44 user nova-compute[72444]: DEBUG os_brick.utils [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:44:44 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Updating existing volume attachment record: 547f0d75-469c-43f6-b571-d277c6ed2835 {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 04:44:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:45 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:44:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f1a45af-977b-43e2-a7dd-7a9c402840d1/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f1a45af-977b-43e2-a7dd-7a9c402840d1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f1a45af-977b-43e2-a7dd-7a9c402840d1/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f1a45af-977b-43e2-a7dd-7a9c402840d1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:45 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:44:45 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691037870.580356, 619ce0f2-51f9-4b87-9709-a736db645218 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:44:45 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] VM Stopped (Lifecycle Event)
Aug 03 04:44:45 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:44:45 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:44:45 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=7381MB free_disk=25.755802154541016GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 04:44:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:44:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:44:46 user nova-compute[72444]: DEBUG nova.compute.manager [None req-3af717b0-def2-4474-a2fc-22eb9786b7de None None] [instance: 619ce0f2-51f9-4b87-9709-a736db645218] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:44:46 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:44:46 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 81725845-6158-4e34-bedb-6e41219bc227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:44:46 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance b6ed9c42-fa6e-4a0d-8312-588471e157f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:44:46 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance e3089887-56df-42de-bc62-88e6db28daf0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:44:46 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance e2859322-6f99-442d-bee1-65fe49ce6360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:44:46 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 07450ea8-cb80-4318-9fc9-4268944d2cae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:44:46 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:44:46 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 42f131f8-83ac-4fd4-b056-f8dac3d32c55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:44:46 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance ba7bd541-c761-4e4a-ac7c-7dd2cb89150d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:44:46 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:44:46 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 6f1a45af-977b-43e2-a7dd-7a9c402840d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:44:46 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 04:44:46 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 04:44:46 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:44:46 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:44:46 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 04:44:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.545s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:44:47 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691037872.0800946, 445ab78e-a1f6-4a4c-bd63-44d149f88b35 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:44:47 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] VM Stopped (Lifecycle Event)
Aug 03 04:44:47 user nova-compute[72444]: DEBUG nova.compute.manager [None req-1e8b06af-b90e-4f77-b9d2-34b4d4e76d39 None None] [instance: 445ab78e-a1f6-4a4c-bd63-44d149f88b35] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:44:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:48 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:48 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:49 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:44:49 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 04:44:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-e3089887-56df-42de-bc62-88e6db28daf0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:44:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-e3089887-56df-42de-bc62-88e6db28daf0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:44:49 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 04:44:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:50 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Updating instance_info_cache with network_info: [{"id": "6eadddef-1b9b-4a34-8217-dc485697332f", "address": "fa:16:3e:d5:f4:36", "network": {"id": "6ec6c203-3446-4671-84b4-9d6a55757afb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1998429186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81df940dade241e1a3560045086f8699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eadddef-1b", "ovs_interfaceid": "6eadddef-1b9b-4a34-8217-dc485697332f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:44:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-e3089887-56df-42de-bc62-88e6db28daf0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:44:50 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 04:44:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Acquiring lock "26922d3f-0a2d-48d1-b758-9c87e0621fef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "26922d3f-0a2d-48d1-b758-9c87e0621fef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG nova.compute.manager [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 04:44:53 user nova-compute[72444]: INFO nova.compute.claims [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Claim successful on node user
Aug 03 04:44:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'unJWagdE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:44:53 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:44:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:44:53 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:44:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:44:53 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:44:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[472b73bb-1cc2-4b14-8a76-5f01e67412cd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 04:44:53 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6322fddd-1305-404d-94ab-d7245b191ccb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2] added
Aug 03 04:44:53 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[62045855-5162-4a8a-85b0-80ee95e2f477]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf2b67f-a95e-4c2c-9572-e593d591a69d]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v unJWagdE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v unJWagdE" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d4a194-d165-47ed-88a2-105fe258f8c1]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'unJWagdE'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca0e72d-3b05-40fd-ad08-85dde2cf90bd]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d0a9ed-2c7f-451d-9d27-99a256df2aec]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:44:53 user nova-compute[72444]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:44:53 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:44:53 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:44:53 user nova-compute[72444]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:44:53 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:44:53 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[58936399-8429-4933-b731-78834cfea480]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2, portal: 172.16.0.220,3260]
Aug 03 04:44:53 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2, portal: 172.16.0.220,3260] successful.
Aug 03 04:44:53 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb3ccc3-0cdb-4145-9023-0a1a619834c3]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e3e909-c87a-49d5-9dd5-94dc8b856e4c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)
Aug 03 04:44:53 user nova-compute[72444]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:44:53 user nova-compute[72444]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:44:53 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:44:53 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)
Aug 03 04:44:53 user nova-compute[72444]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:44:53 user nova-compute[72444]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:44:53 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:44:53 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] HCTL ('35', '-', '-', 0) found on session 10 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:53 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:44:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:54 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13f6a54-77e2-4ad0-92a4-c723494a1ecc]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:54 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Searching for a device in session 10 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:44:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'unJWagdE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:44:54 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:44:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.446s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:44:54 user nova-compute[72444]: DEBUG nova.compute.manager [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 04:44:54 user nova-compute[72444]: DEBUG nova.compute.manager [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 04:44:54 user nova-compute[72444]: DEBUG nova.network.neutron [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 04:44:54 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 04:44:54 user nova-compute[72444]: DEBUG nova.policy [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d998191ef0943ed95ba213e84d87bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccbd62645f54327a2b8999dcd9736ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 04:44:54 user nova-compute[72444]: DEBUG nova.compute.manager [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 04:44:54 user nova-compute[72444]: DEBUG nova.compute.manager [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 04:44:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 04:44:54 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Creating image(s)
Aug 03 04:44:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Acquiring lock "/opt/stack/data/nova/instances/26922d3f-0a2d-48d1-b758-9c87e0621fef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:44:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "/opt/stack/data/nova/instances/26922d3f-0a2d-48d1-b758-9c87e0621fef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:44:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "/opt/stack/data/nova/instances/26922d3f-0a2d-48d1-b758-9c87e0621fef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:44:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.148s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:44:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:44:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.142s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/26922d3f-0a2d-48d1-b758-9c87e0621fef/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/26922d3f-0a2d-48d1-b758-9c87e0621fef/disk 1073741824" returned: 0 in 0.054s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:44:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.142s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:54 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Checking if we can resize image /opt/stack/data/nova/instances/26922d3f-0a2d-48d1-b758-9c87e0621fef/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 04:44:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26922d3f-0a2d-48d1-b758-9c87e0621fef/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:54 user nova-compute[72444]: DEBUG nova.network.neutron [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Successfully created port: 9e663e87-4907-4b83-9c78-22674d4fe471 {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:44:55 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:44:55 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23435376434666139', 'path': '/dev/sdd'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:44:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435376434666139', 'path': '/dev/sdd'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:44:55 user nova-compute[72444]: DEBUG nova.objects.instance [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lazy-loading 'flavor' on Instance uuid e2859322-6f99-442d-bee1-65fe49ce6360 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:44:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26922d3f-0a2d-48d1-b758-9c87e0621fef/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:55 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Cannot resize image /opt/stack/data/nova/instances/26922d3f-0a2d-48d1-b758-9c87e0621fef/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 04:44:55 user nova-compute[72444]: DEBUG nova.objects.instance [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lazy-loading 'migration_context' on Instance uuid 26922d3f-0a2d-48d1-b758-9c87e0621fef {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:44:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 04:44:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Ensure instance console log exists: /opt/stack/data/nova/instances/26922d3f-0a2d-48d1-b758-9c87e0621fef/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 04:44:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:44:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:44:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:44:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 04:44:55 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:44:55 user nova-compute[72444]:   <source dev="/dev/sdd"/>
Aug 03 04:44:55 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:44:55 user nova-compute[72444]:   <serial>6ea0c40c-f48f-4312-a6d2-229e3ab09ec2</serial>
Aug 03 04:44:55 user nova-compute[72444]: </disk>
Aug 03 04:44:55 user nova-compute[72444]:  {{(pid=72444) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 04:44:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:44:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:44:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] No VIF found with MAC fa:16:3e:bd:11:20, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:44:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-49ea0dbd-c502-41a2-b30f-7c08859271d4 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "e2859322-6f99-442d-bee1-65fe49ce6360" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.960s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:44:55 user nova-compute[72444]: DEBUG nova.compute.manager [req-e8d7b88d-4e43-4ab6-9cdb-222ea24f811f req-759db42a-ecac-4892-997c-a12c3800aaeb service nova] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Received event network-changed-5e00edc4-284f-4e60-b3f6-75ab3df268dc {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:44:55 user nova-compute[72444]: DEBUG nova.compute.manager [req-e8d7b88d-4e43-4ab6-9cdb-222ea24f811f req-759db42a-ecac-4892-997c-a12c3800aaeb service nova] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Refreshing instance network info cache due to event network-changed-5e00edc4-284f-4e60-b3f6-75ab3df268dc. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:44:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e8d7b88d-4e43-4ab6-9cdb-222ea24f811f req-759db42a-ecac-4892-997c-a12c3800aaeb service nova] Acquiring lock "refresh_cache-ba7bd541-c761-4e4a-ac7c-7dd2cb89150d" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:44:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e8d7b88d-4e43-4ab6-9cdb-222ea24f811f req-759db42a-ecac-4892-997c-a12c3800aaeb service nova] Acquired lock "refresh_cache-ba7bd541-c761-4e4a-ac7c-7dd2cb89150d" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:44:55 user nova-compute[72444]: DEBUG nova.network.neutron [req-e8d7b88d-4e43-4ab6-9cdb-222ea24f811f req-759db42a-ecac-4892-997c-a12c3800aaeb service nova] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Refreshing network info cache for port 5e00edc4-284f-4e60-b3f6-75ab3df268dc {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:44:55 user nova-compute[72444]: DEBUG nova.network.neutron [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Successfully updated port: 9e663e87-4907-4b83-9c78-22674d4fe471 {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:44:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Acquiring lock "refresh_cache-26922d3f-0a2d-48d1-b758-9c87e0621fef" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:44:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Acquired lock "refresh_cache-26922d3f-0a2d-48d1-b758-9c87e0621fef" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:44:55 user nova-compute[72444]: DEBUG nova.network.neutron [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG nova.compute.manager [req-6a6dd687-d13c-419e-9fc9-7c8cb7ea40bf req-bd80fd20-41f2-4730-a558-473e9d6549c3 service nova] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Received event network-changed-9e663e87-4907-4b83-9c78-22674d4fe471 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG nova.compute.manager [req-6a6dd687-d13c-419e-9fc9-7c8cb7ea40bf req-bd80fd20-41f2-4730-a558-473e9d6549c3 service nova] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Refreshing instance network info cache due to event network-changed-9e663e87-4907-4b83-9c78-22674d4fe471. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6a6dd687-d13c-419e-9fc9-7c8cb7ea40bf req-bd80fd20-41f2-4730-a558-473e9d6549c3 service nova] Acquiring lock "refresh_cache-26922d3f-0a2d-48d1-b758-9c87e0621fef" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG nova.network.neutron [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG nova.network.neutron [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Updating instance_info_cache with network_info: [{"id": "9e663e87-4907-4b83-9c78-22674d4fe471", "address": "fa:16:3e:c9:2c:bd", "network": {"id": "dc891e23-2b3b-44ae-8110-60fe01fe5e24", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1956899419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ccbd62645f54327a2b8999dcd9736ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e663e87-49", "ovs_interfaceid": "9e663e87-4907-4b83-9c78-22674d4fe471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Releasing lock "refresh_cache-26922d3f-0a2d-48d1-b758-9c87e0621fef" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG nova.compute.manager [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Instance network_info: |[{"id": "9e663e87-4907-4b83-9c78-22674d4fe471", "address": "fa:16:3e:c9:2c:bd", "network": {"id": "dc891e23-2b3b-44ae-8110-60fe01fe5e24", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1956899419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ccbd62645f54327a2b8999dcd9736ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e663e87-49", "ovs_interfaceid": "9e663e87-4907-4b83-9c78-22674d4fe471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6a6dd687-d13c-419e-9fc9-7c8cb7ea40bf req-bd80fd20-41f2-4730-a558-473e9d6549c3 service nova] Acquired lock "refresh_cache-26922d3f-0a2d-48d1-b758-9c87e0621fef" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG nova.network.neutron [req-6a6dd687-d13c-419e-9fc9-7c8cb7ea40bf req-bd80fd20-41f2-4730-a558-473e9d6549c3 service nova] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Refreshing network info cache for port 9e663e87-4907-4b83-9c78-22674d4fe471 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Start _get_guest_xml network_info=[{"id": "9e663e87-4907-4b83-9c78-22674d4fe471", "address": "fa:16:3e:c9:2c:bd", "network": {"id": "dc891e23-2b3b-44ae-8110-60fe01fe5e24", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1956899419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ccbd62645f54327a2b8999dcd9736ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e663e87-49", "ovs_interfaceid": "9e663e87-4907-4b83-9c78-22674d4fe471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:44:56 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:44:56 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:44:56 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:44:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2040565375',display_name='tempest-VolumesAdminNegativeTest-server-2040565375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2040565375',id=17,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdnQBQ6jPTeRUPqgJe8hMG5Ws5rQcF1uzQvFAptSxcvaVQ3UUFvTYe6M9LbXKTouVc7FFElaEDinh19e5u1wM6o14vTZU7VEDdz86mX7HmHRIsKxyR7VJ9BEO7p5bzroA==',key_name='tempest-keypair-596854044',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ccbd62645f54327a2b8999dcd9736ce',ramdisk_id='',reservation_id='r-w8lq7oyo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1069854833',owner_user_name='tempest-VolumesAdminNegativeTest-1069854833-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:44:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d998191ef0943ed95ba213e84d87bdc',uuid=26922d3f-0a2d-48d1-b758-9c87e0621fef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e663e87-4907-4b83-9c78-22674d4fe471", "address": "fa:16:3e:c9:2c:bd", "network": {"id": "dc891e23-2b3b-44ae-8110-60fe01fe5e24", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1956899419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ccbd62645f54327a2b8999dcd9736ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e663e87-49", "ovs_interfaceid": "9e663e87-4907-4b83-9c78-22674d4fe471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Converting VIF {"id": "9e663e87-4907-4b83-9c78-22674d4fe471", "address": "fa:16:3e:c9:2c:bd", "network": {"id": "dc891e23-2b3b-44ae-8110-60fe01fe5e24", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1956899419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ccbd62645f54327a2b8999dcd9736ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e663e87-49", "ovs_interfaceid": "9e663e87-4907-4b83-9c78-22674d4fe471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:2c:bd,bridge_name='br-int',has_traffic_filtering=True,id=9e663e87-4907-4b83-9c78-22674d4fe471,network=Network(dc891e23-2b3b-44ae-8110-60fe01fe5e24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e663e87-49') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG nova.objects.instance [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lazy-loading 'pci_devices' on Instance uuid 26922d3f-0a2d-48d1-b758-9c87e0621fef {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:44:56 user nova-compute[72444]:   <uuid>26922d3f-0a2d-48d1-b758-9c87e0621fef</uuid>
Aug 03 04:44:56 user nova-compute[72444]:   <name>instance-00000011</name>
Aug 03 04:44:56 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:44:56 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:44:56 user nova-compute[72444]:   <metadata>
Aug 03 04:44:56 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:44:56 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:44:56 user nova-compute[72444]:       <nova:name>tempest-VolumesAdminNegativeTest-server-2040565375</nova:name>
Aug 03 04:44:56 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:44:56</nova:creationTime>
Aug 03 04:44:56 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:44:56 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:44:56 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:44:56 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:44:56 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:44:56 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:44:56 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:44:56 user nova-compute[72444]:       <nova:owner>
Aug 03 04:44:56 user nova-compute[72444]:         <nova:user uuid="4d998191ef0943ed95ba213e84d87bdc">tempest-VolumesAdminNegativeTest-1069854833-project-member</nova:user>
Aug 03 04:44:56 user nova-compute[72444]:         <nova:project uuid="5ccbd62645f54327a2b8999dcd9736ce">tempest-VolumesAdminNegativeTest-1069854833</nova:project>
Aug 03 04:44:56 user nova-compute[72444]:       </nova:owner>
Aug 03 04:44:56 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:44:56 user nova-compute[72444]:       <nova:ports>
Aug 03 04:44:56 user nova-compute[72444]:         <nova:port uuid="9e663e87-4907-4b83-9c78-22674d4fe471">
Aug 03 04:44:56 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 03 04:44:56 user nova-compute[72444]:         </nova:port>
Aug 03 04:44:56 user nova-compute[72444]:       </nova:ports>
Aug 03 04:44:56 user nova-compute[72444]:     </nova:instance>
Aug 03 04:44:56 user nova-compute[72444]:   </metadata>
Aug 03 04:44:56 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:44:56 user nova-compute[72444]:     <system>
Aug 03 04:44:56 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:44:56 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:44:56 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:44:56 user nova-compute[72444]:       <entry name="serial">26922d3f-0a2d-48d1-b758-9c87e0621fef</entry>
Aug 03 04:44:56 user nova-compute[72444]:       <entry name="uuid">26922d3f-0a2d-48d1-b758-9c87e0621fef</entry>
Aug 03 04:44:56 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:44:56 user nova-compute[72444]:     </system>
Aug 03 04:44:56 user nova-compute[72444]:   </sysinfo>
Aug 03 04:44:56 user nova-compute[72444]:   <os>
Aug 03 04:44:56 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:44:56 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:44:56 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:44:56 user nova-compute[72444]:   </os>
Aug 03 04:44:56 user nova-compute[72444]:   <features>
Aug 03 04:44:56 user nova-compute[72444]:     <acpi/>
Aug 03 04:44:56 user nova-compute[72444]:     <apic/>
Aug 03 04:44:56 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:44:56 user nova-compute[72444]:   </features>
Aug 03 04:44:56 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:44:56 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:44:56 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:44:56 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:44:56 user nova-compute[72444]:   </clock>
Aug 03 04:44:56 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:44:56 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:44:56 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:44:56 user nova-compute[72444]:   </cpu>
Aug 03 04:44:56 user nova-compute[72444]:   <devices>
Aug 03 04:44:56 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:44:56 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:44:56 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/26922d3f-0a2d-48d1-b758-9c87e0621fef/disk"/>
Aug 03 04:44:56 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:44:56 user nova-compute[72444]:     </disk>
Aug 03 04:44:56 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:44:56 user nova-compute[72444]:       <mac address="fa:16:3e:c9:2c:bd"/>
Aug 03 04:44:56 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:44:56 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:44:56 user nova-compute[72444]:       <target dev="tap9e663e87-49"/>
Aug 03 04:44:56 user nova-compute[72444]:     </interface>
Aug 03 04:44:56 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:44:56 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/26922d3f-0a2d-48d1-b758-9c87e0621fef/console.log" append="off"/>
Aug 03 04:44:56 user nova-compute[72444]:     </serial>
Aug 03 04:44:56 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:44:56 user nova-compute[72444]:     <video>
Aug 03 04:44:56 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:44:56 user nova-compute[72444]:     </video>
Aug 03 04:44:56 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:44:56 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:44:56 user nova-compute[72444]:     </rng>
Aug 03 04:44:56 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:44:56 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:44:56 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:44:56 user nova-compute[72444]:     </memballoon>
Aug 03 04:44:56 user nova-compute[72444]:   </devices>
Aug 03 04:44:56 user nova-compute[72444]: </domain>
Aug 03 04:44:56 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:44:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2040565375',display_name='tempest-VolumesAdminNegativeTest-server-2040565375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2040565375',id=17,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdnQBQ6jPTeRUPqgJe8hMG5Ws5rQcF1uzQvFAptSxcvaVQ3UUFvTYe6M9LbXKTouVc7FFElaEDinh19e5u1wM6o14vTZU7VEDdz86mX7HmHRIsKxyR7VJ9BEO7p5bzroA==',key_name='tempest-keypair-596854044',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ccbd62645f54327a2b8999dcd9736ce',ramdisk_id='',reservation_id='r-w8lq7oyo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1069854833',owner_user_name='tempest-VolumesAdminNegativeTest-1069854833-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:44:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d998191ef0943ed95ba213e84d87bdc',uuid=26922d3f-0a2d-48d1-b758-9c87e0621fef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e663e87-4907-4b83-9c78-22674d4fe471", "address": "fa:16:3e:c9:2c:bd", "network": {"id": "dc891e23-2b3b-44ae-8110-60fe01fe5e24", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1956899419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ccbd62645f54327a2b8999dcd9736ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e663e87-49", "ovs_interfaceid": "9e663e87-4907-4b83-9c78-22674d4fe471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Converting VIF {"id": "9e663e87-4907-4b83-9c78-22674d4fe471", "address": "fa:16:3e:c9:2c:bd", "network": {"id": "dc891e23-2b3b-44ae-8110-60fe01fe5e24", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1956899419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ccbd62645f54327a2b8999dcd9736ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e663e87-49", "ovs_interfaceid": "9e663e87-4907-4b83-9c78-22674d4fe471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:2c:bd,bridge_name='br-int',has_traffic_filtering=True,id=9e663e87-4907-4b83-9c78-22674d4fe471,network=Network(dc891e23-2b3b-44ae-8110-60fe01fe5e24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e663e87-49') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG os_vif [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:2c:bd,bridge_name='br-int',has_traffic_filtering=True,id=9e663e87-4907-4b83-9c78-22674d4fe471,network=Network(dc891e23-2b3b-44ae-8110-60fe01fe5e24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e663e87-49') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e663e87-49, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9e663e87-49, col_values=(('external_ids', {'iface-id': '9e663e87-4907-4b83-9c78-22674d4fe471', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:2c:bd', 'vm-uuid': '26922d3f-0a2d-48d1-b758-9c87e0621fef'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:56 user nova-compute[72444]: INFO os_vif [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:2c:bd,bridge_name='br-int',has_traffic_filtering=True,id=9e663e87-4907-4b83-9c78-22674d4fe471,network=Network(dc891e23-2b3b-44ae-8110-60fe01fe5e24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e663e87-49')
Aug 03 04:44:56 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] No VIF found with MAC fa:16:3e:c9:2c:bd, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG nova.network.neutron [req-6a6dd687-d13c-419e-9fc9-7c8cb7ea40bf req-bd80fd20-41f2-4730-a558-473e9d6549c3 service nova] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Updated VIF entry in instance network info cache for port 9e663e87-4907-4b83-9c78-22674d4fe471. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG nova.network.neutron [req-6a6dd687-d13c-419e-9fc9-7c8cb7ea40bf req-bd80fd20-41f2-4730-a558-473e9d6549c3 service nova] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Updating instance_info_cache with network_info: [{"id": "9e663e87-4907-4b83-9c78-22674d4fe471", "address": "fa:16:3e:c9:2c:bd", "network": {"id": "dc891e23-2b3b-44ae-8110-60fe01fe5e24", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1956899419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ccbd62645f54327a2b8999dcd9736ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e663e87-49", "ovs_interfaceid": "9e663e87-4907-4b83-9c78-22674d4fe471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:44:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6a6dd687-d13c-419e-9fc9-7c8cb7ea40bf req-bd80fd20-41f2-4730-a558-473e9d6549c3 service nova] Releasing lock "refresh_cache-26922d3f-0a2d-48d1-b758-9c87e0621fef" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:44:57 user nova-compute[72444]: DEBUG nova.network.neutron [req-e8d7b88d-4e43-4ab6-9cdb-222ea24f811f req-759db42a-ecac-4892-997c-a12c3800aaeb service nova] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Updated VIF entry in instance network info cache for port 5e00edc4-284f-4e60-b3f6-75ab3df268dc. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:44:57 user nova-compute[72444]: DEBUG nova.network.neutron [req-e8d7b88d-4e43-4ab6-9cdb-222ea24f811f req-759db42a-ecac-4892-997c-a12c3800aaeb service nova] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Updating instance_info_cache with network_info: [{"id": "5e00edc4-284f-4e60-b3f6-75ab3df268dc", "address": "fa:16:3e:49:68:54", "network": {"id": "f0b4a33e-e079-4817-8747-412ca56818fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1198621443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6037670c8c6450bb3663e55b50c6dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e00edc4-28", "ovs_interfaceid": "5e00edc4-284f-4e60-b3f6-75ab3df268dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:44:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e8d7b88d-4e43-4ab6-9cdb-222ea24f811f req-759db42a-ecac-4892-997c-a12c3800aaeb service nova] Releasing lock "refresh_cache-ba7bd541-c761-4e4a-ac7c-7dd2cb89150d" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:44:57 user nova-compute[72444]: INFO nova.compute.manager [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Rebuilding instance
Aug 03 04:44:57 user nova-compute[72444]: INFO nova.compute.manager [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Rebuilding instance
Aug 03 04:44:57 user nova-compute[72444]: DEBUG nova.objects.instance [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lazy-loading 'trusted_certs' on Instance uuid ba7bd541-c761-4e4a-ac7c-7dd2cb89150d {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:44:57 user nova-compute[72444]: DEBUG nova.compute.manager [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:44:57 user nova-compute[72444]: DEBUG nova.objects.instance [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lazy-loading 'trusted_certs' on Instance uuid e2859322-6f99-442d-bee1-65fe49ce6360 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:44:57 user nova-compute[72444]: DEBUG nova.compute.manager [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:44:57 user nova-compute[72444]: DEBUG nova.objects.instance [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lazy-loading 'pci_requests' on Instance uuid ba7bd541-c761-4e4a-ac7c-7dd2cb89150d {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:44:57 user nova-compute[72444]: DEBUG nova.objects.instance [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lazy-loading 'pci_devices' on Instance uuid ba7bd541-c761-4e4a-ac7c-7dd2cb89150d {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:44:57 user nova-compute[72444]: DEBUG nova.objects.instance [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lazy-loading 'pci_requests' on Instance uuid e2859322-6f99-442d-bee1-65fe49ce6360 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:44:57 user nova-compute[72444]: DEBUG nova.objects.instance [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lazy-loading 'resources' on Instance uuid ba7bd541-c761-4e4a-ac7c-7dd2cb89150d {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:44:57 user nova-compute[72444]: DEBUG nova.objects.instance [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lazy-loading 'migration_context' on Instance uuid ba7bd541-c761-4e4a-ac7c-7dd2cb89150d {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:44:57 user nova-compute[72444]: DEBUG nova.objects.instance [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lazy-loading 'pci_devices' on Instance uuid e2859322-6f99-442d-bee1-65fe49ce6360 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:44:57 user nova-compute[72444]: DEBUG nova.objects.instance [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72444) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 03 04:44:57 user nova-compute[72444]: DEBUG nova.objects.instance [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lazy-loading 'resources' on Instance uuid e2859322-6f99-442d-bee1-65fe49ce6360 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:44:57 user nova-compute[72444]: DEBUG nova.objects.instance [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lazy-loading 'migration_context' on Instance uuid e2859322-6f99-442d-bee1-65fe49ce6360 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:44:57 user nova-compute[72444]: DEBUG nova.objects.instance [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72444) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 03 04:44:57 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:57 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:57 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:58 user nova-compute[72444]: DEBUG nova.compute.manager [req-546307c1-d48e-4c07-86c5-108aa37c5c59 req-ac4d84de-d8eb-4955-9666-e729a9ebbabf service nova] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Received event network-vif-plugged-9e663e87-4907-4b83-9c78-22674d4fe471 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:44:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-546307c1-d48e-4c07-86c5-108aa37c5c59 req-ac4d84de-d8eb-4955-9666-e729a9ebbabf service nova] Acquiring lock "26922d3f-0a2d-48d1-b758-9c87e0621fef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:44:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-546307c1-d48e-4c07-86c5-108aa37c5c59 req-ac4d84de-d8eb-4955-9666-e729a9ebbabf service nova] Lock "26922d3f-0a2d-48d1-b758-9c87e0621fef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:44:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-546307c1-d48e-4c07-86c5-108aa37c5c59 req-ac4d84de-d8eb-4955-9666-e729a9ebbabf service nova] Lock "26922d3f-0a2d-48d1-b758-9c87e0621fef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:44:58 user nova-compute[72444]: DEBUG nova.compute.manager [req-546307c1-d48e-4c07-86c5-108aa37c5c59 req-ac4d84de-d8eb-4955-9666-e729a9ebbabf service nova] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] No waiting events found dispatching network-vif-plugged-9e663e87-4907-4b83-9c78-22674d4fe471 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:44:58 user nova-compute[72444]: WARNING nova.compute.manager [req-546307c1-d48e-4c07-86c5-108aa37c5c59 req-ac4d84de-d8eb-4955-9666-e729a9ebbabf service nova] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Received unexpected event network-vif-plugged-9e663e87-4907-4b83-9c78-22674d4fe471 for instance with vm_state building and task_state spawning.
Aug 03 04:44:58 user nova-compute[72444]: DEBUG nova.compute.manager [req-cc130354-358c-41ba-a9fc-cde371b6e9d1 req-f3438c09-b794-453b-8e31-a64ace627f52 service nova] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Received event network-vif-unplugged-5e00edc4-284f-4e60-b3f6-75ab3df268dc {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:44:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-cc130354-358c-41ba-a9fc-cde371b6e9d1 req-f3438c09-b794-453b-8e31-a64ace627f52 service nova] Acquiring lock "ba7bd541-c761-4e4a-ac7c-7dd2cb89150d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:44:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-cc130354-358c-41ba-a9fc-cde371b6e9d1 req-f3438c09-b794-453b-8e31-a64ace627f52 service nova] Lock "ba7bd541-c761-4e4a-ac7c-7dd2cb89150d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:44:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-cc130354-358c-41ba-a9fc-cde371b6e9d1 req-f3438c09-b794-453b-8e31-a64ace627f52 service nova] Lock "ba7bd541-c761-4e4a-ac7c-7dd2cb89150d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:44:58 user nova-compute[72444]: DEBUG nova.compute.manager [req-cc130354-358c-41ba-a9fc-cde371b6e9d1 req-f3438c09-b794-453b-8e31-a64ace627f52 service nova] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] No waiting events found dispatching network-vif-unplugged-5e00edc4-284f-4e60-b3f6-75ab3df268dc {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:44:58 user nova-compute[72444]: WARNING nova.compute.manager [req-cc130354-358c-41ba-a9fc-cde371b6e9d1 req-f3438c09-b794-453b-8e31-a64ace627f52 service nova] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Received unexpected event network-vif-unplugged-5e00edc4-284f-4e60-b3f6-75ab3df268dc for instance with vm_state active and task_state rebuilding.
Aug 03 04:44:58 user nova-compute[72444]: DEBUG nova.compute.manager [req-5cfaaf33-59a5-441c-b635-ee0ced3a0e70 req-7500b89c-7f36-41a1-a779-fe4a79de2ff9 service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Received event network-vif-unplugged-269c2e0d-94ee-4084-985a-58c5afed4411 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:44:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5cfaaf33-59a5-441c-b635-ee0ced3a0e70 req-7500b89c-7f36-41a1-a779-fe4a79de2ff9 service nova] Acquiring lock "e2859322-6f99-442d-bee1-65fe49ce6360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:44:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5cfaaf33-59a5-441c-b635-ee0ced3a0e70 req-7500b89c-7f36-41a1-a779-fe4a79de2ff9 service nova] Lock "e2859322-6f99-442d-bee1-65fe49ce6360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:44:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5cfaaf33-59a5-441c-b635-ee0ced3a0e70 req-7500b89c-7f36-41a1-a779-fe4a79de2ff9 service nova] Lock "e2859322-6f99-442d-bee1-65fe49ce6360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:44:58 user nova-compute[72444]: DEBUG nova.compute.manager [req-5cfaaf33-59a5-441c-b635-ee0ced3a0e70 req-7500b89c-7f36-41a1-a779-fe4a79de2ff9 service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] No waiting events found dispatching network-vif-unplugged-269c2e0d-94ee-4084-985a-58c5afed4411 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:44:58 user nova-compute[72444]: WARNING nova.compute.manager [req-5cfaaf33-59a5-441c-b635-ee0ced3a0e70 req-7500b89c-7f36-41a1-a779-fe4a79de2ff9 service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Received unexpected event network-vif-unplugged-269c2e0d-94ee-4084-985a-58c5afed4411 for instance with vm_state active and task_state rebuilding.
Aug 03 04:44:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:58 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Instance destroyed successfully.
Aug 03 04:44:58 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Instance destroyed successfully.
Aug 03 04:44:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:43:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1766085163',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1380099260',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxWTXqS2gTOwwksDvDA82ZhKXb+8OJ2l8zmonKnC8DV5DMkdpimVA0a9LAiDqgbZc2C7mTSh4D9lL13WOlFB3MFWXZFbpJsJYQhGkVl7O5aTGjbtLXsvFxHqIp9QmPVeg==',key_name='tempest-keypair-15472896',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:43:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f6037670c8c6450bb3663e55b50c6dd5',ramdisk_id='',reservation_id='r-91lxwkqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-780888408',owner_user_name='tempest-ServerActionsV293TestJSON-780888408-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:44:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6837fb4f8f04f38a0e429d8905eae54',uuid=ba7bd541-c761-4e4a-ac7c-7dd2cb89150d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e00edc4-284f-4e60-b3f6-75ab3df268dc", "address": "fa:16:3e:49:68:54", "network": {"id": "f0b4a33e-e079-4817-8747-412ca56818fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1198621443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6037670c8c6450bb3663e55b50c6dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e00edc4-28", "ovs_interfaceid": "5e00edc4-284f-4e60-b3f6-75ab3df268dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:44:58 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Converting VIF {"id": "5e00edc4-284f-4e60-b3f6-75ab3df268dc", "address": "fa:16:3e:49:68:54", "network": {"id": "f0b4a33e-e079-4817-8747-412ca56818fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1198621443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6037670c8c6450bb3663e55b50c6dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e00edc4-28", "ovs_interfaceid": "5e00edc4-284f-4e60-b3f6-75ab3df268dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:44:58 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:68:54,bridge_name='br-int',has_traffic_filtering=True,id=5e00edc4-284f-4e60-b3f6-75ab3df268dc,network=Network(f0b4a33e-e079-4817-8747-412ca56818fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e00edc4-28') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:44:58 user nova-compute[72444]: DEBUG os_vif [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:68:54,bridge_name='br-int',has_traffic_filtering=True,id=5e00edc4-284f-4e60-b3f6-75ab3df268dc,network=Network(f0b4a33e-e079-4817-8747-412ca56818fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e00edc4-28') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:44:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e00edc4-28, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:44:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:44:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:58 user nova-compute[72444]: INFO os_vif [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:68:54,bridge_name='br-int',has_traffic_filtering=True,id=5e00edc4-284f-4e60-b3f6-75ab3df268dc,network=Network(f0b4a33e-e079-4817-8747-412ca56818fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e00edc4-28')
Aug 03 04:44:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:44:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'voVSHFml', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:44:58 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 03 04:44:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:44:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:44:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:44:59 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Instance destroyed successfully.
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6fa63f-1ded-4148-91ef-adce49f3af68]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55b7b1b-d92e-446f-a95c-aae20260e168]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)
Aug 03 04:44:59 user nova-compute[72444]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:44:59 user nova-compute[72444]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:44:59 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:44:59 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)
Aug 03 04:44:59 user nova-compute[72444]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:44:59 user nova-compute[72444]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:44:59 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:44:59 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f309412c940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd'): ({'sdc'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Removing single pathed devices sdc {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e6d8bd-ba27-40cc-b39f-79cc199f22b9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b39449-92b4-4183-81a7-64bf74303ef1]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Flushing IO for device /dev/sdc {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:59 user nova-compute[72444]: INFO nova.compute.manager [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Detaching volume 6ea0c40c-f48f-4312-a6d2-229e3ab09ec2
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6468d9-b86c-43b8-98f9-c333c7d5e899]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67875c5-bdd7-4da6-b85a-c0c7f71f346a]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] SCSI volumes sdc have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:59 user nova-compute[72444]: INFO nova.virt.block_device [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Attempting to driver detach volume 6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 from mountpoint /dev/vdb
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f644da7-2f33-43b4-8053-210e7030a250]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Attempting to detach device vdb from instance e2859322-6f99-442d-bee1-65fe49ce6360 from the persistent domain config. {{(pid=72444) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 04:44:59 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:44:59 user nova-compute[72444]:   <source dev="/dev/sdd"/>
Aug 03 04:44:59 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:44:59 user nova-compute[72444]:   <serial>6ea0c40c-f48f-4312-a6d2-229e3ab09ec2</serial>
Aug 03 04:44:59 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 04:44:59 user nova-compute[72444]: </disk>
Aug 03 04:44:59 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:44:59 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Successfully detached device vdb from instance e2859322-6f99-442d-bee1-65fe49ce6360 from the persistent domain config.
Aug 03 04:44:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'unJWagdE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:44:59 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[13afe284-695b-4911-9cf3-b20bd4fb3d2f]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd, portal: 172.16.0.220,3260]
Aug 03 04:44:59 user nova-compute[72444]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd, portal: 172.16.0.220,3260] successful.
Aug 03 04:44:59 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d75828-eb80-4d63-be21-a5d388f49b35]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] <== disconnect_volume: return (320ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:44:59 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Deleting instance files /opt/stack/data/nova/instances/ba7bd541-c761-4e4a-ac7c-7dd2cb89150d_del
Aug 03 04:44:59 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Deletion of /opt/stack/data/nova/instances/ba7bd541-c761-4e4a-ac7c-7dd2cb89150d_del complete
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.047s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3937a175-b384-4972-bb0a-7a6c61b84910]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b73bc9-1ff4-47e1-8ea1-5380891d05cc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)
Aug 03 04:44:59 user nova-compute[72444]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:44:59 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:44:59 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)
Aug 03 04:44:59 user nova-compute[72444]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:44:59 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:44:59 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3094331360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2'): ({'sdd'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Removing single pathed devices sdd {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b5f9cd-0b9b-4d37-b2be-1e9d956d0ec9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b797b41-47c7-4af0-9d5b-cfbbd12f89d9]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Flushing IO for device /dev/sdd {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[862e4dc2-8cfe-4ae8-9a35-7801731cf20e]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6d826f-0c3a-4228-9149-bcdd0297da48]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] SCSI volumes sdd have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6879f0-4d76-46da-8a5f-89ec3341d839]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:59 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance ba7bd541-c761-4e4a-ac7c-7dd2cb89150d could not be found.
Aug 03 04:44:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'voVSHFml', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:44:59 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf337a0-52e9-415b-a7a9-52a68e60517f]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2, portal: 172.16.0.220,3260]
Aug 03 04:44:59 user nova-compute[72444]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2, portal: 172.16.0.220,3260] successful.
Aug 03 04:44:59 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[65eedb71-2dec-4f6a-8268-b0cb1923e8c9]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] <== disconnect_volume: return (358ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.048s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2831cd1b-77f6-490f-9c7c-3f5718df6c1c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b56cabb-03a4-45fb-9c63-3028ad0fc3ed]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:44:59 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:44:59 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:44:59 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:44:59 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308c5e5a20>, {}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Disconnecting from: [] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.056s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] <== disconnect_volume: return (104ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:44:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG nova.compute.manager [req-cd1e9085-e332-4e97-86f1-9479b5f90592 req-5104af08-7061-4a46-9fb9-d1c72c682b4e service nova] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Received event network-vif-plugged-9e663e87-4907-4b83-9c78-22674d4fe471 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-cd1e9085-e332-4e97-86f1-9479b5f90592 req-5104af08-7061-4a46-9fb9-d1c72c682b4e service nova] Acquiring lock "26922d3f-0a2d-48d1-b758-9c87e0621fef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-cd1e9085-e332-4e97-86f1-9479b5f90592 req-5104af08-7061-4a46-9fb9-d1c72c682b4e service nova] Lock "26922d3f-0a2d-48d1-b758-9c87e0621fef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-cd1e9085-e332-4e97-86f1-9479b5f90592 req-5104af08-7061-4a46-9fb9-d1c72c682b4e service nova] Lock "26922d3f-0a2d-48d1-b758-9c87e0621fef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG nova.compute.manager [req-cd1e9085-e332-4e97-86f1-9479b5f90592 req-5104af08-7061-4a46-9fb9-d1c72c682b4e service nova] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] No waiting events found dispatching network-vif-plugged-9e663e87-4907-4b83-9c78-22674d4fe471 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:45:00 user nova-compute[72444]: WARNING nova.compute.manager [req-cd1e9085-e332-4e97-86f1-9479b5f90592 req-5104af08-7061-4a46-9fb9-d1c72c682b4e service nova] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Received unexpected event network-vif-plugged-9e663e87-4907-4b83-9c78-22674d4fe471 for instance with vm_state building and task_state spawning.
Aug 03 04:45:00 user nova-compute[72444]: DEBUG nova.compute.manager [req-cfc1244b-8fc0-4407-8a21-b060fcea6654 req-f5c525e2-2ca2-4c41-ae44-f676cf1d6b13 service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Received event network-vif-plugged-269c2e0d-94ee-4084-985a-58c5afed4411 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-cfc1244b-8fc0-4407-8a21-b060fcea6654 req-f5c525e2-2ca2-4c41-ae44-f676cf1d6b13 service nova] Acquiring lock "e2859322-6f99-442d-bee1-65fe49ce6360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-cfc1244b-8fc0-4407-8a21-b060fcea6654 req-f5c525e2-2ca2-4c41-ae44-f676cf1d6b13 service nova] Lock "e2859322-6f99-442d-bee1-65fe49ce6360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-cfc1244b-8fc0-4407-8a21-b060fcea6654 req-f5c525e2-2ca2-4c41-ae44-f676cf1d6b13 service nova] Lock "e2859322-6f99-442d-bee1-65fe49ce6360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG nova.compute.manager [req-cfc1244b-8fc0-4407-8a21-b060fcea6654 req-f5c525e2-2ca2-4c41-ae44-f676cf1d6b13 service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] No waiting events found dispatching network-vif-plugged-269c2e0d-94ee-4084-985a-58c5afed4411 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:45:00 user nova-compute[72444]: WARNING nova.compute.manager [req-cfc1244b-8fc0-4407-8a21-b060fcea6654 req-f5c525e2-2ca2-4c41-ae44-f676cf1d6b13 service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Received unexpected event network-vif-plugged-269c2e0d-94ee-4084-985a-58c5afed4411 for instance with vm_state active and task_state rebuilding.
Aug 03 04:45:00 user nova-compute[72444]: DEBUG nova.compute.manager [req-07ac17c7-726b-46d0-b4dd-af07be6d0908 req-3936a3c6-f60f-46e1-b9f7-74ce2946f0a9 service nova] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Received event network-vif-plugged-5e00edc4-284f-4e60-b3f6-75ab3df268dc {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-07ac17c7-726b-46d0-b4dd-af07be6d0908 req-3936a3c6-f60f-46e1-b9f7-74ce2946f0a9 service nova] Acquiring lock "ba7bd541-c761-4e4a-ac7c-7dd2cb89150d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-07ac17c7-726b-46d0-b4dd-af07be6d0908 req-3936a3c6-f60f-46e1-b9f7-74ce2946f0a9 service nova] Lock "ba7bd541-c761-4e4a-ac7c-7dd2cb89150d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-07ac17c7-726b-46d0-b4dd-af07be6d0908 req-3936a3c6-f60f-46e1-b9f7-74ce2946f0a9 service nova] Lock "ba7bd541-c761-4e4a-ac7c-7dd2cb89150d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG nova.compute.manager [req-07ac17c7-726b-46d0-b4dd-af07be6d0908 req-3936a3c6-f60f-46e1-b9f7-74ce2946f0a9 service nova] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] No waiting events found dispatching network-vif-plugged-5e00edc4-284f-4e60-b3f6-75ab3df268dc {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:45:00 user nova-compute[72444]: WARNING nova.compute.manager [req-07ac17c7-726b-46d0-b4dd-af07be6d0908 req-3936a3c6-f60f-46e1-b9f7-74ce2946f0a9 service nova] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Received unexpected event network-vif-plugged-5e00edc4-284f-4e60-b3f6-75ab3df268dc for instance with vm_state active and task_state rebuilding.
Aug 03 04:45:00 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Instance destroyed successfully.
Aug 03 04:45:00 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:40:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-809781841',display_name='tempest-ServerActionsTestOtherA-server-2077801933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-809781841',id=6,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDRHy6esW1Y8XjdGq8kBFPOjS8VFKeCY2PZq9mP7iSJL6lEWXDaTZRjD+kixW9a+QL5lbang2hEmB7Vd5YkTr9lWHW5QxoFRm5vUQ48SZ1Yf+s27SIuqNanyEMadE17HUA==',key_name='tempest-keypair-1657293229',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:41:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='56d17468ddd64dfabba3a2c7b6df71ef',ramdisk_id='',reservation_id='r-msbwrlvq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1629114222',owner_user_name='tempest-ServerActionsTestOtherA-1629114222-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:44:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7120445361dc4363b4cc6c7671a2716e',uuid=e2859322-6f99-442d-bee1-65fe49ce6360,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "269c2e0d-94ee-4084-985a-58c5afed4411", "address": "fa:16:3e:bd:11:20", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap269c2e0d-94", "ovs_interfaceid": "269c2e0d-94ee-4084-985a-58c5afed4411", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Converting VIF {"id": "269c2e0d-94ee-4084-985a-58c5afed4411", "address": "fa:16:3e:bd:11:20", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap269c2e0d-94", "ovs_interfaceid": "269c2e0d-94ee-4084-985a-58c5afed4411", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:11:20,bridge_name='br-int',has_traffic_filtering=True,id=269c2e0d-94ee-4084-985a-58c5afed4411,network=Network(95b97be9-d6db-45e9-b0f1-a72fc90b69d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap269c2e0d-94') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG os_vif [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:11:20,bridge_name='br-int',has_traffic_filtering=True,id=269c2e0d-94ee-4084-985a-58c5afed4411,network=Network(95b97be9-d6db-45e9-b0f1-a72fc90b69d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap269c2e0d-94') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap269c2e0d-94, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:00 user nova-compute[72444]: INFO os_vif [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:11:20,bridge_name='br-int',has_traffic_filtering=True,id=269c2e0d-94ee-4084-985a-58c5afed4411,network=Network(95b97be9-d6db-45e9-b0f1-a72fc90b69d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap269c2e0d-94')
Aug 03 04:45:00 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'unJWagdE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:45:00 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 03 04:45:00 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f51714-ef62-49bf-866e-d5f852fefcb3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2d070d-2792-4966-8199-ceb7107c2468]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:45:00 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:45:00 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:45:00 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:45:00 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f309435b7f0>, {}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Disconnecting from: [] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.055s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] <== disconnect_volume: return (57ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:45:00 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Deleting instance files /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360_del
Aug 03 04:45:00 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Deletion of /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360_del complete
Aug 03 04:45:00 user nova-compute[72444]: INFO nova.virt.block_device [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Booting with volume 6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 at /dev/vdb
Aug 03 04:45:00 user nova-compute[72444]: DEBUG os_brick.utils [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[27adbaf4-0f37-4986-b09f-50083e9b9d84]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[26034395-0908-4c1f-949f-bd34c0c27fef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[11235f45-ec5c-4225-9da5-48d3cb395714]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9478d3ce-529b-4671-8af8-043efe8d6bec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037900.8524714, 26922d3f-0a2d-48d1-b758-9c87e0621fef => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:45:00 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] VM Resumed (Lifecycle Event)
Aug 03 04:45:00 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG nova.compute.manager [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:00 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Instance spawned successfully.
Aug 03 04:45:00 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:45:00 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 04:45:00 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fd4fae-5e44-4160-9f3e-c7cece8f3c2e]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG os_brick.utils [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Updating existing volume attachment record: dbc0a8ae-6851-4346-86f3-23b05fa5e8f7 {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:45:00 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:45:00 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037900.853915, 26922d3f-0a2d-48d1-b758-9c87e0621fef => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:45:00 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] VM Started (Lifecycle Event)
Aug 03 04:45:00 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:45:00 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:45:00 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:45:01 user nova-compute[72444]: INFO nova.compute.manager [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Took 6.63 seconds to spawn the instance on the hypervisor.
Aug 03 04:45:01 user nova-compute[72444]: DEBUG nova.compute.manager [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:45:01 user nova-compute[72444]: INFO nova.compute.manager [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Took 7.52 seconds to build instance.
Aug 03 04:45:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b5263cab-0778-43d6-9666-de4dd8cb2dc2 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "26922d3f-0a2d-48d1-b758-9c87e0621fef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.719s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:01 user nova-compute[72444]: DEBUG nova.objects.instance [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lazy-loading 'flavor' on Instance uuid 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "refresh_cache-7daab2c6-8768-46ed-a7bb-0ffbd107cf82" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquired lock "refresh_cache-7daab2c6-8768-46ed-a7bb-0ffbd107cf82" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG nova.network.neutron [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG nova.objects.instance [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lazy-loading 'info_cache' on Instance uuid 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG nova.compute.manager [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Preparing to wait for external event volume-reimaged-fbd912dd-0923-470a-8a00-ee611de909cd {{(pid=72444) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Acquiring lock "ba7bd541-c761-4e4a-ac7c-7dd2cb89150d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "ba7bd541-c761-4e4a-ac7c-7dd2cb89150d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "ba7bd541-c761-4e4a-ac7c-7dd2cb89150d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG nova.network.neutron [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Updating instance_info_cache with network_info: [{"id": "841a11a2-ffb3-44cf-9e15-c8099578d405", "address": "fa:16:3e:12:4d:37", "network": {"id": "628fbd1c-7104-4911-9eb9-1f38c394bebd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-366258398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a65efd00e0ac4039bf1d6429787b8595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841a11a2-ff", "ovs_interfaceid": "841a11a2-ffb3-44cf-9e15-c8099578d405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Releasing lock "refresh_cache-7daab2c6-8768-46ed-a7bb-0ffbd107cf82" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:45:02 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Instance destroyed successfully.
Aug 03 04:45:02 user nova-compute[72444]: DEBUG nova.objects.instance [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lazy-loading 'resources' on Instance uuid 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1937092257',display_name='tempest-AttachVolumeTestJSON-server-1937092257',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1937092257',id=8,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4GYonfRcDLCfzVaxO6+Z3h0SUoVfhhQmBtRpHMqljFVb2ikupLBIuKrpUkeWbdkWIlD6P8Fdx/ixyrvXF+8nK0TaaJy2ZUXJb0m3JpcoPOM4+0nQ1vkeu15aXRWeoGNg==',key_name='tempest-keypair-142269823',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:41:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a65efd00e0ac4039bf1d6429787b8595',ramdisk_id='',reservation_id='r-gcoy75p0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1814863301',owner_user_name='tempest-AttachVolumeTestJSON-1814863301-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:43:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e44603a26afa49098e76422420c825c2',uuid=7daab2c6-8768-46ed-a7bb-0ffbd107cf82,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "841a11a2-ffb3-44cf-9e15-c8099578d405", "address": "fa:16:3e:12:4d:37", "network": {"id": "628fbd1c-7104-4911-9eb9-1f38c394bebd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-366258398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a65efd00e0ac4039bf1d6429787b8595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841a11a2-ff", "ovs_interfaceid": "841a11a2-ffb3-44cf-9e15-c8099578d405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Converting VIF {"id": "841a11a2-ffb3-44cf-9e15-c8099578d405", "address": "fa:16:3e:12:4d:37", "network": {"id": "628fbd1c-7104-4911-9eb9-1f38c394bebd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-366258398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a65efd00e0ac4039bf1d6429787b8595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841a11a2-ff", "ovs_interfaceid": "841a11a2-ffb3-44cf-9e15-c8099578d405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:4d:37,bridge_name='br-int',has_traffic_filtering=True,id=841a11a2-ffb3-44cf-9e15-c8099578d405,network=Network(628fbd1c-7104-4911-9eb9-1f38c394bebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841a11a2-ff') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG os_vif [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:4d:37,bridge_name='br-int',has_traffic_filtering=True,id=841a11a2-ffb3-44cf-9e15-c8099578d405,network=Network(628fbd1c-7104-4911-9eb9-1f38c394bebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841a11a2-ff') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap841a11a2-ff, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:45:02 user nova-compute[72444]: INFO os_vif [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:4d:37,bridge_name='br-int',has_traffic_filtering=True,id=841a11a2-ffb3-44cf-9e15-c8099578d405,network=Network(628fbd1c-7104-4911-9eb9-1f38c394bebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841a11a2-ff')
Aug 03 04:45:02 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiwnchLG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:45:02 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:45:02 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b173b789-b2f7-494f-b482-74fc8112f3a8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8782a569-0ec9-417e-83eb-8316016b8226]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:45:02 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:45:02 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:45:02 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:45:02 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3094358550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574'): ({'sdb'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Removing single pathed devices sdb {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[867f710f-d0da-49a9-ba9b-d57f1f6e097f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e39fb05-afce-4536-9673-80e0b9e4808c]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Flushing IO for device /dev/sdb {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a54df0-daff-4260-a1f9-12a913a4e170]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 04:45:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d06245-251d-44c5-8837-8a4885f3cf9b]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9a47a9-6b13-4382-967d-dc735cfe650b]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c77efd-70a5-4e17-b8c0-165ae6ad2a7c]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574, portal: 172.16.0.220,3260]
Aug 03 04:45:03 user nova-compute[72444]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574, portal: 172.16.0.220,3260] successful.
Aug 03 04:45:03 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[600df8c0-670d-46a6-8124-656351050957]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] <== disconnect_volume: return (287ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Start _get_guest_xml network_info=[{"id": "841a11a2-ffb3-44cf-9e15-c8099578d405", "address": "fa:16:3e:12:4d:37", "network": {"id": "628fbd1c-7104-4911-9eb9-1f38c394bebd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-366258398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a65efd00e0ac4039bf1d6429787b8595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841a11a2-ff", "ovs_interfaceid": "841a11a2-ffb3-44cf-9e15-c8099578d405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiwnchLG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '7daab2c6-8768-46ed-a7bb-0ffbd107cf82', 'attached_at': '', 'detached_at': '', 'volume_id': 'cd7ca08c-42db-4007-a06b-e327179ac574', 'serial': 'cd7ca08c-42db-4007-a06b-e327179ac574'}, 'disk_bus': 'virtio', 'attachment_id': '375331ab-d25a-47bb-bd1d-e038e8a4d350', 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG nova.objects.instance [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lazy-loading 'numa_topology' on Instance uuid 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:45:03 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:45:03 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:45:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG nova.objects.instance [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiwnchLG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:45:03 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:45:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:45:03 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:45:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:45:03 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec21927d-3c62-4441-a198-09fc655715b4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 04:45:03 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cb7ce0-e74e-4b6e-a79f-40d65903bb7a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574] added
Aug 03 04:45:03 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6987fb8d-c70a-4305-ae49-b8cd48623c03]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada98c85-e6ba-48f2-9cb1-1a52ac4f2988]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qiwnchLG {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qiwnchLG" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefa7c1a-7257-4e88-a2db-e111fbd7d2c4]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qiwnchLG'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b55a93-b3b4-4a49-8c7a-2e9ff7f2745d]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d43762b-a5a2-4029-b6b6-4abefa575cfa]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:45:03 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:45:03 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[428c3b2b-cede-4940-97b0-0e0da5853be6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574, portal: 172.16.0.220,3260]
Aug 03 04:45:03 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574, portal: 172.16.0.220,3260] successful.
Aug 03 04:45:03 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[659f99e7-4d21-4f6c-90dc-e0ba8328733f]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df0f0aa-0614-4b5b-9107-535e7d99a07f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:45:03 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:45:03 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:45:03 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:45:03 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] HCTL ('33', '-', '-', 0) found on session 11 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[893a6ec4-1974-4f27-8d11-2e459561b009]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiwnchLG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:45:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:04 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:45:04 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23964393636333465', 'path': '/dev/sdb'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:45:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964393636333465', 'path': '/dev/sdb'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:45:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1937092257',display_name='tempest-AttachVolumeTestJSON-server-1937092257',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1937092257',id=8,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4GYonfRcDLCfzVaxO6+Z3h0SUoVfhhQmBtRpHMqljFVb2ikupLBIuKrpUkeWbdkWIlD6P8Fdx/ixyrvXF+8nK0TaaJy2ZUXJb0m3JpcoPOM4+0nQ1vkeu15aXRWeoGNg==',key_name='tempest-keypair-142269823',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:41:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a65efd00e0ac4039bf1d6429787b8595',ramdisk_id='',reservation_id='r-gcoy75p0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1814863301',owner_user_name='tempest-AttachVolumeTestJSON-1814863301-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:43:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e44603a26afa49098e76422420c825c2',uuid=7daab2c6-8768-46ed-a7bb-0ffbd107cf82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "841a11a2-ffb3-44cf-9e15-c8099578d405", "address": "fa:16:3e:12:4d:37", "network": {"id": "628fbd1c-7104-4911-9eb9-1f38c394bebd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-366258398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a65efd00e0ac4039bf1d6429787b8595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841a11a2-ff", "ovs_interfaceid": "841a11a2-ffb3-44cf-9e15-c8099578d405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:45:04 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Converting VIF {"id": "841a11a2-ffb3-44cf-9e15-c8099578d405", "address": "fa:16:3e:12:4d:37", "network": {"id": "628fbd1c-7104-4911-9eb9-1f38c394bebd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-366258398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a65efd00e0ac4039bf1d6429787b8595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841a11a2-ff", "ovs_interfaceid": "841a11a2-ffb3-44cf-9e15-c8099578d405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:45:04 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:4d:37,bridge_name='br-int',has_traffic_filtering=True,id=841a11a2-ffb3-44cf-9e15-c8099578d405,network=Network(628fbd1c-7104-4911-9eb9-1f38c394bebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841a11a2-ff') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:45:04 user nova-compute[72444]: DEBUG nova.objects.instance [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lazy-loading 'pci_devices' on Instance uuid 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:45:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:45:04 user nova-compute[72444]:   <uuid>7daab2c6-8768-46ed-a7bb-0ffbd107cf82</uuid>
Aug 03 04:45:04 user nova-compute[72444]:   <name>instance-00000008</name>
Aug 03 04:45:04 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:45:04 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:45:04 user nova-compute[72444]:   <metadata>
Aug 03 04:45:04 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:45:04 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:45:04 user nova-compute[72444]:       <nova:name>tempest-AttachVolumeTestJSON-server-1937092257</nova:name>
Aug 03 04:45:04 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:45:03</nova:creationTime>
Aug 03 04:45:04 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:45:04 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:45:04 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:45:04 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:45:04 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:45:04 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:45:04 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:45:04 user nova-compute[72444]:       <nova:owner>
Aug 03 04:45:04 user nova-compute[72444]:         <nova:user uuid="e44603a26afa49098e76422420c825c2">tempest-AttachVolumeTestJSON-1814863301-project-member</nova:user>
Aug 03 04:45:04 user nova-compute[72444]:         <nova:project uuid="a65efd00e0ac4039bf1d6429787b8595">tempest-AttachVolumeTestJSON-1814863301</nova:project>
Aug 03 04:45:04 user nova-compute[72444]:       </nova:owner>
Aug 03 04:45:04 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:45:04 user nova-compute[72444]:       <nova:ports>
Aug 03 04:45:04 user nova-compute[72444]:         <nova:port uuid="841a11a2-ffb3-44cf-9e15-c8099578d405">
Aug 03 04:45:04 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 03 04:45:04 user nova-compute[72444]:         </nova:port>
Aug 03 04:45:04 user nova-compute[72444]:       </nova:ports>
Aug 03 04:45:04 user nova-compute[72444]:     </nova:instance>
Aug 03 04:45:04 user nova-compute[72444]:   </metadata>
Aug 03 04:45:04 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:45:04 user nova-compute[72444]:     <system>
Aug 03 04:45:04 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:45:04 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:45:04 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:45:04 user nova-compute[72444]:       <entry name="serial">7daab2c6-8768-46ed-a7bb-0ffbd107cf82</entry>
Aug 03 04:45:04 user nova-compute[72444]:       <entry name="uuid">7daab2c6-8768-46ed-a7bb-0ffbd107cf82</entry>
Aug 03 04:45:04 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:45:04 user nova-compute[72444]:     </system>
Aug 03 04:45:04 user nova-compute[72444]:   </sysinfo>
Aug 03 04:45:04 user nova-compute[72444]:   <os>
Aug 03 04:45:04 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:45:04 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:45:04 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:45:04 user nova-compute[72444]:   </os>
Aug 03 04:45:04 user nova-compute[72444]:   <features>
Aug 03 04:45:04 user nova-compute[72444]:     <acpi/>
Aug 03 04:45:04 user nova-compute[72444]:     <apic/>
Aug 03 04:45:04 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:45:04 user nova-compute[72444]:   </features>
Aug 03 04:45:04 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:45:04 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:45:04 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:45:04 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:45:04 user nova-compute[72444]:   </clock>
Aug 03 04:45:04 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:45:04 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:45:04 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:45:04 user nova-compute[72444]:   </cpu>
Aug 03 04:45:04 user nova-compute[72444]:   <devices>
Aug 03 04:45:04 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:45:04 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:45:04 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk"/>
Aug 03 04:45:04 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:45:04 user nova-compute[72444]:     </disk>
Aug 03 04:45:04 user nova-compute[72444]:     <disk type="block" device="disk">
Aug 03 04:45:04 user nova-compute[72444]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:45:04 user nova-compute[72444]:       <source dev="/dev/sdb"/>
Aug 03 04:45:04 user nova-compute[72444]:       <target dev="vdb" bus="virtio"/>
Aug 03 04:45:04 user nova-compute[72444]:       <serial>cd7ca08c-42db-4007-a06b-e327179ac574</serial>
Aug 03 04:45:04 user nova-compute[72444]:     </disk>
Aug 03 04:45:04 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:45:04 user nova-compute[72444]:       <mac address="fa:16:3e:12:4d:37"/>
Aug 03 04:45:04 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:45:04 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:45:04 user nova-compute[72444]:       <target dev="tap841a11a2-ff"/>
Aug 03 04:45:04 user nova-compute[72444]:     </interface>
Aug 03 04:45:04 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:45:04 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/console.log" append="off"/>
Aug 03 04:45:04 user nova-compute[72444]:     </serial>
Aug 03 04:45:04 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:45:04 user nova-compute[72444]:     <video>
Aug 03 04:45:04 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:45:04 user nova-compute[72444]:     </video>
Aug 03 04:45:04 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:45:04 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:45:04 user nova-compute[72444]:     </rng>
Aug 03 04:45:04 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:45:04 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:45:04 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:45:04 user nova-compute[72444]:     </memballoon>
Aug 03 04:45:04 user nova-compute[72444]:   </devices>
Aug 03 04:45:04 user nova-compute[72444]: </domain>
Aug 03 04:45:04 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:45:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:45:04 user nova-compute[72444]: DEBUG nova.objects.instance [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:45:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.154s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:05 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 04:45:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:05 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Cannot resize image /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 04:45:05 user nova-compute[72444]: DEBUG nova.objects.instance [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lazy-loading 'migration_context' on Instance uuid 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:45:05 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1937092257',display_name='tempest-AttachVolumeTestJSON-server-1937092257',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1937092257',id=8,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4GYonfRcDLCfzVaxO6+Z3h0SUoVfhhQmBtRpHMqljFVb2ikupLBIuKrpUkeWbdkWIlD6P8Fdx/ixyrvXF+8nK0TaaJy2ZUXJb0m3JpcoPOM4+0nQ1vkeu15aXRWeoGNg==',key_name='tempest-keypair-142269823',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:41:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='a65efd00e0ac4039bf1d6429787b8595',ramdisk_id='',reservation_id='r-gcoy75p0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1814863301',owner_user_name='tempest-AttachVolumeTestJSON-1814863301-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:43:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e44603a26afa49098e76422420c825c2',uuid=7daab2c6-8768-46ed-a7bb-0ffbd107cf82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "841a11a2-ffb3-44cf-9e15-c8099578d405", "address": "fa:16:3e:12:4d:37", "network": {"id": "628fbd1c-7104-4911-9eb9-1f38c394bebd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-366258398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a65efd00e0ac4039bf1d6429787b8595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841a11a2-ff", "ovs_interfaceid": "841a11a2-ffb3-44cf-9e15-c8099578d405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:45:05 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Converting VIF {"id": "841a11a2-ffb3-44cf-9e15-c8099578d405", "address": "fa:16:3e:12:4d:37", "network": {"id": "628fbd1c-7104-4911-9eb9-1f38c394bebd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-366258398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a65efd00e0ac4039bf1d6429787b8595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841a11a2-ff", "ovs_interfaceid": "841a11a2-ffb3-44cf-9e15-c8099578d405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:45:05 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:4d:37,bridge_name='br-int',has_traffic_filtering=True,id=841a11a2-ffb3-44cf-9e15-c8099578d405,network=Network(628fbd1c-7104-4911-9eb9-1f38c394bebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841a11a2-ff') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:45:05 user nova-compute[72444]: DEBUG os_vif [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:4d:37,bridge_name='br-int',has_traffic_filtering=True,id=841a11a2-ffb3-44cf-9e15-c8099578d405,network=Network(628fbd1c-7104-4911-9eb9-1f38c394bebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841a11a2-ff') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:45:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:45:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:45:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap841a11a2-ff, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:45:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap841a11a2-ff, col_values=(('external_ids', {'iface-id': '841a11a2-ffb3-44cf-9e15-c8099578d405', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:4d:37', 'vm-uuid': '7daab2c6-8768-46ed-a7bb-0ffbd107cf82'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:45:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:45:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:05 user nova-compute[72444]: INFO os_vif [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:4d:37,bridge_name='br-int',has_traffic_filtering=True,id=841a11a2-ffb3-44cf-9e15-c8099578d405,network=Network(628fbd1c-7104-4911-9eb9-1f38c394bebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841a11a2-ff')
Aug 03 04:45:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:06 user nova-compute[72444]: DEBUG nova.compute.manager [req-1ee47c5e-75b2-41af-a345-4b00cda87636 req-158fafe7-a7bf-401e-8212-57413016ef4a service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Received event network-vif-plugged-841a11a2-ffb3-44cf-9e15-c8099578d405 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:45:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-1ee47c5e-75b2-41af-a345-4b00cda87636 req-158fafe7-a7bf-401e-8212-57413016ef4a service nova] Acquiring lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-1ee47c5e-75b2-41af-a345-4b00cda87636 req-158fafe7-a7bf-401e-8212-57413016ef4a service nova] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-1ee47c5e-75b2-41af-a345-4b00cda87636 req-158fafe7-a7bf-401e-8212-57413016ef4a service nova] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:06 user nova-compute[72444]: DEBUG nova.compute.manager [req-1ee47c5e-75b2-41af-a345-4b00cda87636 req-158fafe7-a7bf-401e-8212-57413016ef4a service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] No waiting events found dispatching network-vif-plugged-841a11a2-ffb3-44cf-9e15-c8099578d405 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:45:06 user nova-compute[72444]: WARNING nova.compute.manager [req-1ee47c5e-75b2-41af-a345-4b00cda87636 req-158fafe7-a7bf-401e-8212-57413016ef4a service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Received unexpected event network-vif-plugged-841a11a2-ffb3-44cf-9e15-c8099578d405 for instance with vm_state stopped and task_state powering-on.
Aug 03 04:45:07 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:07 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:07 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:07 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-275d31f5-df1a-4d54-b196-a4a998f4d1d1 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Acquiring lock "42f131f8-83ac-4fd4-b056-f8dac3d32c55" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-275d31f5-df1a-4d54-b196-a4a998f4d1d1 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Lock "42f131f8-83ac-4fd4-b056-f8dac3d32c55" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-275d31f5-df1a-4d54-b196-a4a998f4d1d1 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Acquiring lock "42f131f8-83ac-4fd4-b056-f8dac3d32c55-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-275d31f5-df1a-4d54-b196-a4a998f4d1d1 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Lock "42f131f8-83ac-4fd4-b056-f8dac3d32c55-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-275d31f5-df1a-4d54-b196-a4a998f4d1d1 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Lock "42f131f8-83ac-4fd4-b056-f8dac3d32c55-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:08 user nova-compute[72444]: INFO nova.compute.manager [None req-275d31f5-df1a-4d54-b196-a4a998f4d1d1 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Terminating instance
Aug 03 04:45:08 user nova-compute[72444]: DEBUG nova.compute.manager [None req-275d31f5-df1a-4d54-b196-a4a998f4d1d1 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 04:45:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:09 user nova-compute[72444]: DEBUG nova.compute.manager [req-2c0aed96-fd3f-4d7a-962e-98664a528cb3 req-9e522e97-b143-4c55-bd15-a903fd481b2e service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Received event network-vif-plugged-841a11a2-ffb3-44cf-9e15-c8099578d405 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:45:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2c0aed96-fd3f-4d7a-962e-98664a528cb3 req-9e522e97-b143-4c55-bd15-a903fd481b2e service nova] Acquiring lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2c0aed96-fd3f-4d7a-962e-98664a528cb3 req-9e522e97-b143-4c55-bd15-a903fd481b2e service nova] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2c0aed96-fd3f-4d7a-962e-98664a528cb3 req-9e522e97-b143-4c55-bd15-a903fd481b2e service nova] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:09 user nova-compute[72444]: DEBUG nova.compute.manager [req-2c0aed96-fd3f-4d7a-962e-98664a528cb3 req-9e522e97-b143-4c55-bd15-a903fd481b2e service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] No waiting events found dispatching network-vif-plugged-841a11a2-ffb3-44cf-9e15-c8099578d405 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:45:09 user nova-compute[72444]: WARNING nova.compute.manager [req-2c0aed96-fd3f-4d7a-962e-98664a528cb3 req-9e522e97-b143-4c55-bd15-a903fd481b2e service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Received unexpected event network-vif-plugged-841a11a2-ffb3-44cf-9e15-c8099578d405 for instance with vm_state stopped and task_state powering-on.
Aug 03 04:45:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:09 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037909.3427732, 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:45:09 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] VM Resumed (Lifecycle Event)
Aug 03 04:45:09 user nova-compute[72444]: DEBUG nova.compute.manager [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:45:09 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Instance rebooted successfully.
Aug 03 04:45:09 user nova-compute[72444]: DEBUG nova.compute.manager [None req-5443e05b-bc69-4fea-9119-29ff750d6eff tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:45:09 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:45:09 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:45:09 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 03 04:45:09 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037909.3455198, 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:45:09 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] VM Started (Lifecycle Event)
Aug 03 04:45:09 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:45:09 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:45:09 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Instance destroyed successfully.
Aug 03 04:45:09 user nova-compute[72444]: DEBUG nova.objects.instance [None req-275d31f5-df1a-4d54-b196-a4a998f4d1d1 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Lazy-loading 'resources' on Instance uuid 42f131f8-83ac-4fd4-b056-f8dac3d32c55 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:45:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-275d31f5-df1a-4d54-b196-a4a998f4d1d1 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-929066832',display_name='tempest-TestVolumeSwap-server-929066832',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-929066832',id=10,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7z6imjkIlWYfGq7p19wtDVMvC2U8evNKNgz62Mnc3jca8/p8hAkswDV/XSPWqB8py8JC4iZmd/PIBCINsekLfJKeuZCftJa99vNkZU3MTbxsd5XyhWwbCZuNqH4no9Hg==',key_name='tempest-keypair-75219721',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:41:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5432e4ac5443489a923966c0c85ef140',ramdisk_id='',reservation_id='r-7x0kr6u2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1765317655',owner_user_name='tempest-TestVolumeSwap-1765317655-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:41:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bb66f8aaf9d4274890e912fa56778be',uuid=42f131f8-83ac-4fd4-b056-f8dac3d32c55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b3c7303-d2c6-4bab-96ad-a43903c2c28d", "address": "fa:16:3e:72:9e:bf", "network": {"id": "0b4f64f0-db21-4355-ba1c-32275f0d8b34", "bridge": "br-int", "label": "tempest-TestVolumeSwap-815026343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5432e4ac5443489a923966c0c85ef140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3c7303-d2", "ovs_interfaceid": "2b3c7303-d2c6-4bab-96ad-a43903c2c28d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:45:09 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-275d31f5-df1a-4d54-b196-a4a998f4d1d1 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Converting VIF {"id": "2b3c7303-d2c6-4bab-96ad-a43903c2c28d", "address": "fa:16:3e:72:9e:bf", "network": {"id": "0b4f64f0-db21-4355-ba1c-32275f0d8b34", "bridge": "br-int", "label": "tempest-TestVolumeSwap-815026343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5432e4ac5443489a923966c0c85ef140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3c7303-d2", "ovs_interfaceid": "2b3c7303-d2c6-4bab-96ad-a43903c2c28d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:45:09 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-275d31f5-df1a-4d54-b196-a4a998f4d1d1 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:9e:bf,bridge_name='br-int',has_traffic_filtering=True,id=2b3c7303-d2c6-4bab-96ad-a43903c2c28d,network=Network(0b4f64f0-db21-4355-ba1c-32275f0d8b34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b3c7303-d2') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:45:09 user nova-compute[72444]: DEBUG os_vif [None req-275d31f5-df1a-4d54-b196-a4a998f4d1d1 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:9e:bf,bridge_name='br-int',has_traffic_filtering=True,id=2b3c7303-d2c6-4bab-96ad-a43903c2c28d,network=Network(0b4f64f0-db21-4355-ba1c-32275f0d8b34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b3c7303-d2') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:45:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b3c7303-d2, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:45:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:45:09 user nova-compute[72444]: INFO os_vif [None req-275d31f5-df1a-4d54-b196-a4a998f4d1d1 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:9e:bf,bridge_name='br-int',has_traffic_filtering=True,id=2b3c7303-d2c6-4bab-96ad-a43903c2c28d,network=Network(0b4f64f0-db21-4355-ba1c-32275f0d8b34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b3c7303-d2')
Aug 03 04:45:09 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-275d31f5-df1a-4d54-b196-a4a998f4d1d1 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Deleting instance files /opt/stack/data/nova/instances/42f131f8-83ac-4fd4-b056-f8dac3d32c55_del
Aug 03 04:45:09 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-275d31f5-df1a-4d54-b196-a4a998f4d1d1 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Deletion of /opt/stack/data/nova/instances/42f131f8-83ac-4fd4-b056-f8dac3d32c55_del complete
Aug 03 04:45:10 user nova-compute[72444]: INFO nova.compute.manager [None req-275d31f5-df1a-4d54-b196-a4a998f4d1d1 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 03 04:45:10 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-275d31f5-df1a-4d54-b196-a4a998f4d1d1 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 04:45:10 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 04:45:10 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 04:45:10 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 04:45:10 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Creating image(s)
Aug 03 04:45:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "/opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "/opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "/opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:10 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:10 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.173s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:10 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:10 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.190s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:10 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:10 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk 1073741824" returned: 0 in 0.067s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:10 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:10 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.204s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:10 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 04:45:10 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Cannot resize image /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Ensure instance console log exists: /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Start _get_guest_xml network_info=[{"id": "269c2e0d-94ee-4084-985a-58c5afed4411", "address": "fa:16:3e:bd:11:20", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap269c2e0d-94", "ovs_interfaceid": "269c2e0d-94ee-4084-985a-58c5afed4411", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'unJWagdE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e2859322-6f99-442d-bee1-65fe49ce6360', 'attached_at': '', 'detached_at': '', 'volume_id': '6ea0c40c-f48f-4312-a6d2-229e3ab09ec2', 'serial': '6ea0c40c-f48f-4312-a6d2-229e3ab09ec2'}, 'disk_bus': 'virtio', 'attachment_id': 'dbc0a8ae-6851-4346-86f3-23b05fa5e8f7', 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:45:11 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 03 04:45:11 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 03 04:45:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG nova.objects.instance [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lazy-loading 'vcpu_model' on Instance uuid e2859322-6f99-442d-bee1-65fe49ce6360 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG nova.compute.manager [req-6505df34-7369-4632-9f3d-dc6808be921a req-ebe3a16d-e524-4865-83cc-92546cd797d5 service nova] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Received event network-vif-unplugged-2b3c7303-d2c6-4bab-96ad-a43903c2c28d {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6505df34-7369-4632-9f3d-dc6808be921a req-ebe3a16d-e524-4865-83cc-92546cd797d5 service nova] Acquiring lock "42f131f8-83ac-4fd4-b056-f8dac3d32c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6505df34-7369-4632-9f3d-dc6808be921a req-ebe3a16d-e524-4865-83cc-92546cd797d5 service nova] Lock "42f131f8-83ac-4fd4-b056-f8dac3d32c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6505df34-7369-4632-9f3d-dc6808be921a req-ebe3a16d-e524-4865-83cc-92546cd797d5 service nova] Lock "42f131f8-83ac-4fd4-b056-f8dac3d32c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG nova.compute.manager [req-6505df34-7369-4632-9f3d-dc6808be921a req-ebe3a16d-e524-4865-83cc-92546cd797d5 service nova] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] No waiting events found dispatching network-vif-unplugged-2b3c7303-d2c6-4bab-96ad-a43903c2c28d {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG nova.compute.manager [req-6505df34-7369-4632-9f3d-dc6808be921a req-ebe3a16d-e524-4865-83cc-92546cd797d5 service nova] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Received event network-vif-unplugged-2b3c7303-d2c6-4bab-96ad-a43903c2c28d for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG nova.compute.manager [req-6505df34-7369-4632-9f3d-dc6808be921a req-ebe3a16d-e524-4865-83cc-92546cd797d5 service nova] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Received event network-vif-plugged-2b3c7303-d2c6-4bab-96ad-a43903c2c28d {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6505df34-7369-4632-9f3d-dc6808be921a req-ebe3a16d-e524-4865-83cc-92546cd797d5 service nova] Acquiring lock "42f131f8-83ac-4fd4-b056-f8dac3d32c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6505df34-7369-4632-9f3d-dc6808be921a req-ebe3a16d-e524-4865-83cc-92546cd797d5 service nova] Lock "42f131f8-83ac-4fd4-b056-f8dac3d32c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6505df34-7369-4632-9f3d-dc6808be921a req-ebe3a16d-e524-4865-83cc-92546cd797d5 service nova] Lock "42f131f8-83ac-4fd4-b056-f8dac3d32c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG nova.compute.manager [req-6505df34-7369-4632-9f3d-dc6808be921a req-ebe3a16d-e524-4865-83cc-92546cd797d5 service nova] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] No waiting events found dispatching network-vif-plugged-2b3c7303-d2c6-4bab-96ad-a43903c2c28d {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:45:11 user nova-compute[72444]: WARNING nova.compute.manager [req-6505df34-7369-4632-9f3d-dc6808be921a req-ebe3a16d-e524-4865-83cc-92546cd797d5 service nova] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Received unexpected event network-vif-plugged-2b3c7303-d2c6-4bab-96ad-a43903c2c28d for instance with vm_state active and task_state deleting.
Aug 03 04:45:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'unJWagdE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:45:11 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 03 04:45:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:45:11 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 03 04:45:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:45:11 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[00798f1f-78a1-4927-ad72-d849ad0df4f5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 04:45:11 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f5b7ff-779c-4723-89e7-d4c59837c0ad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2] added
Aug 03 04:45:11 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9dd2e1-68e6-442e-b752-bc23472b0b8c]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a86f67-6815-4ef7-8cc4-727fc98798c4]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v unJWagdE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v unJWagdE" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a312bc-9a3c-433a-a71c-942e876c4369]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'unJWagdE'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[09244bf9-583a-4b4e-ace0-5f3493788c30]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[861dbb36-27d7-452f-9b01-e90ed9dc6b03]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:45:11 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:45:11 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:45:11 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:45:11 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:45:11 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Took 1.32 seconds to deallocate network for instance.
Aug 03 04:45:11 user nova-compute[72444]: DEBUG nova.compute.manager [req-6a6008e2-b5af-4b01-85f4-c4aedd7cbe15 req-70dd1d2e-f7cc-4216-8396-812f386a5ae0 service nova] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Received event network-vif-deleted-2b3c7303-d2c6-4bab-96ad-a43903c2c28d {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:45:11 user nova-compute[72444]: INFO nova.compute.manager [req-6a6008e2-b5af-4b01-85f4-c4aedd7cbe15 req-70dd1d2e-f7cc-4216-8396-812f386a5ae0 service nova] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Neutron deleted interface 2b3c7303-d2c6-4bab-96ad-a43903c2c28d; detaching it from the instance and deleting it from the info cache
Aug 03 04:45:11 user nova-compute[72444]: DEBUG nova.network.neutron [req-6a6008e2-b5af-4b01-85f4-c4aedd7cbe15 req-70dd1d2e-f7cc-4216-8396-812f386a5ae0 service nova] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG nova.compute.manager [req-6a6008e2-b5af-4b01-85f4-c4aedd7cbe15 req-70dd1d2e-f7cc-4216-8396-812f386a5ae0 service nova] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Detach interface failed, port_id=2b3c7303-d2c6-4bab-96ad-a43903c2c28d, reason: Instance 42f131f8-83ac-4fd4-b056-f8dac3d32c55 could not be found. {{(pid=72444) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-275d31f5-df1a-4d54-b196-a4a998f4d1d1 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-275d31f5-df1a-4d54-b196-a4a998f4d1d1 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --login" returned: 0 in 0.124s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a80b29e-9962-4cfb-b815-1e043093186d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2, portal: 172.16.0.220,3260]
Aug 03 04:45:11 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2, portal: 172.16.0.220,3260] successful.
Aug 03 04:45:11 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf94a90-d173-4a4c-81cb-c44a3da2d715]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d849e6-9466-4b77-b645-11577652f984]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:45:11 user nova-compute[72444]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)
Aug 03 04:45:11 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:45:11 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:45:11 user nova-compute[72444]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)
Aug 03 04:45:11 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:45:11 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] HCTL ('34', '-', '-', 0) found on session 12 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.029s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d365945-db9c-4c7a-b467-af4f3142b1cc]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: None {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-275d31f5-df1a-4d54-b196-a4a998f4d1d1 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-275d31f5-df1a-4d54-b196-a4a998f4d1d1 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:45:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-275d31f5-df1a-4d54-b196-a4a998f4d1d1 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.495s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:12 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-275d31f5-df1a-4d54-b196-a4a998f4d1d1 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Deleted allocations for instance 42f131f8-83ac-4fd4-b056-f8dac3d32c55
Aug 03 04:45:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-275d31f5-df1a-4d54-b196-a4a998f4d1d1 tempest-TestVolumeSwap-1765317655 tempest-TestVolumeSwap-1765317655-project-member] Lock "42f131f8-83ac-4fd4-b056-f8dac3d32c55" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.224s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:12 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:45:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'unJWagdE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:45:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:45:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '23435376434666139', 'path': '/dev/sdc'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:45:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435376434666139', 'path': '/dev/sdc'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:45:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-03T04:40:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-809781841',display_name='tempest-ServerActionsTestOtherA-server-2077801933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-809781841',id=6,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDRHy6esW1Y8XjdGq8kBFPOjS8VFKeCY2PZq9mP7iSJL6lEWXDaTZRjD+kixW9a+QL5lbang2hEmB7Vd5YkTr9lWHW5QxoFRm5vUQ48SZ1Yf+s27SIuqNanyEMadE17HUA==',key_name='tempest-keypair-1657293229',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:41:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='56d17468ddd64dfabba3a2c7b6df71ef',ramdisk_id='',reservation_id='r-msbwrlvq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1629114222',owner_user_name='tempest-ServerActionsTestOtherA-1629114222-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:45:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7120445361dc4363b4cc6c7671a2716e',uuid=e2859322-6f99-442d-bee1-65fe49ce6360,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "269c2e0d-94ee-4084-985a-58c5afed4411", "address": "fa:16:3e:bd:11:20", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap269c2e0d-94", "ovs_interfaceid": "269c2e0d-94ee-4084-985a-58c5afed4411", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:45:12 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Converting VIF {"id": "269c2e0d-94ee-4084-985a-58c5afed4411", "address": "fa:16:3e:bd:11:20", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap269c2e0d-94", "ovs_interfaceid": "269c2e0d-94ee-4084-985a-58c5afed4411", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:45:12 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:11:20,bridge_name='br-int',has_traffic_filtering=True,id=269c2e0d-94ee-4084-985a-58c5afed4411,network=Network(95b97be9-d6db-45e9-b0f1-a72fc90b69d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap269c2e0d-94') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:45:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:45:12 user nova-compute[72444]:   <uuid>e2859322-6f99-442d-bee1-65fe49ce6360</uuid>
Aug 03 04:45:12 user nova-compute[72444]:   <name>instance-00000006</name>
Aug 03 04:45:12 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:45:12 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:45:12 user nova-compute[72444]:   <metadata>
Aug 03 04:45:12 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:45:12 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:45:12 user nova-compute[72444]:       <nova:name>tempest-ServerActionsTestOtherA-server-2077801933</nova:name>
Aug 03 04:45:12 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:45:11</nova:creationTime>
Aug 03 04:45:12 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:45:12 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:45:12 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:45:12 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:45:12 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:45:12 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:45:12 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:45:12 user nova-compute[72444]:       <nova:owner>
Aug 03 04:45:12 user nova-compute[72444]:         <nova:user uuid="7120445361dc4363b4cc6c7671a2716e">tempest-ServerActionsTestOtherA-1629114222-project-member</nova:user>
Aug 03 04:45:12 user nova-compute[72444]:         <nova:project uuid="56d17468ddd64dfabba3a2c7b6df71ef">tempest-ServerActionsTestOtherA-1629114222</nova:project>
Aug 03 04:45:12 user nova-compute[72444]:       </nova:owner>
Aug 03 04:45:12 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:45:12 user nova-compute[72444]:       <nova:ports>
Aug 03 04:45:12 user nova-compute[72444]:         <nova:port uuid="269c2e0d-94ee-4084-985a-58c5afed4411">
Aug 03 04:45:12 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 03 04:45:12 user nova-compute[72444]:         </nova:port>
Aug 03 04:45:12 user nova-compute[72444]:       </nova:ports>
Aug 03 04:45:12 user nova-compute[72444]:     </nova:instance>
Aug 03 04:45:12 user nova-compute[72444]:   </metadata>
Aug 03 04:45:12 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:45:12 user nova-compute[72444]:     <system>
Aug 03 04:45:12 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:45:12 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:45:12 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:45:12 user nova-compute[72444]:       <entry name="serial">e2859322-6f99-442d-bee1-65fe49ce6360</entry>
Aug 03 04:45:12 user nova-compute[72444]:       <entry name="uuid">e2859322-6f99-442d-bee1-65fe49ce6360</entry>
Aug 03 04:45:12 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:45:12 user nova-compute[72444]:     </system>
Aug 03 04:45:12 user nova-compute[72444]:   </sysinfo>
Aug 03 04:45:12 user nova-compute[72444]:   <os>
Aug 03 04:45:12 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:45:12 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:45:12 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:45:12 user nova-compute[72444]:   </os>
Aug 03 04:45:12 user nova-compute[72444]:   <features>
Aug 03 04:45:12 user nova-compute[72444]:     <acpi/>
Aug 03 04:45:12 user nova-compute[72444]:     <apic/>
Aug 03 04:45:12 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:45:12 user nova-compute[72444]:   </features>
Aug 03 04:45:12 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:45:12 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:45:12 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:45:12 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:45:12 user nova-compute[72444]:   </clock>
Aug 03 04:45:12 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:45:12 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:45:12 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:45:12 user nova-compute[72444]:   </cpu>
Aug 03 04:45:12 user nova-compute[72444]:   <devices>
Aug 03 04:45:12 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:45:12 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:45:12 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk"/>
Aug 03 04:45:12 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:45:12 user nova-compute[72444]:     </disk>
Aug 03 04:45:12 user nova-compute[72444]:     <disk type="block" device="disk">
Aug 03 04:45:12 user nova-compute[72444]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:45:12 user nova-compute[72444]:       <source dev="/dev/sdc"/>
Aug 03 04:45:12 user nova-compute[72444]:       <target dev="vdb" bus="virtio"/>
Aug 03 04:45:12 user nova-compute[72444]:       <serial>6ea0c40c-f48f-4312-a6d2-229e3ab09ec2</serial>
Aug 03 04:45:12 user nova-compute[72444]:     </disk>
Aug 03 04:45:12 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:45:12 user nova-compute[72444]:       <mac address="fa:16:3e:bd:11:20"/>
Aug 03 04:45:12 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:45:12 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:45:12 user nova-compute[72444]:       <target dev="tap269c2e0d-94"/>
Aug 03 04:45:12 user nova-compute[72444]:     </interface>
Aug 03 04:45:12 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:45:12 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/console.log" append="off"/>
Aug 03 04:45:12 user nova-compute[72444]:     </serial>
Aug 03 04:45:12 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:45:12 user nova-compute[72444]:     <video>
Aug 03 04:45:12 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:45:12 user nova-compute[72444]:     </video>
Aug 03 04:45:12 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:45:12 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:45:12 user nova-compute[72444]:     </rng>
Aug 03 04:45:12 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:45:12 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:45:12 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:45:12 user nova-compute[72444]:     </memballoon>
Aug 03 04:45:12 user nova-compute[72444]:   </devices>
Aug 03 04:45:12 user nova-compute[72444]: </domain>
Aug 03 04:45:12 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:45:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-03T04:40:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-809781841',display_name='tempest-ServerActionsTestOtherA-server-2077801933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-809781841',id=6,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDRHy6esW1Y8XjdGq8kBFPOjS8VFKeCY2PZq9mP7iSJL6lEWXDaTZRjD+kixW9a+QL5lbang2hEmB7Vd5YkTr9lWHW5QxoFRm5vUQ48SZ1Yf+s27SIuqNanyEMadE17HUA==',key_name='tempest-keypair-1657293229',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:41:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='56d17468ddd64dfabba3a2c7b6df71ef',ramdisk_id='',reservation_id='r-msbwrlvq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1629114222',owner_user_name='tempest-ServerActionsTestOtherA-1629114222-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:45:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7120445361dc4363b4cc6c7671a2716e',uuid=e2859322-6f99-442d-bee1-65fe49ce6360,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "269c2e0d-94ee-4084-985a-58c5afed4411", "address": "fa:16:3e:bd:11:20", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap269c2e0d-94", "ovs_interfaceid": "269c2e0d-94ee-4084-985a-58c5afed4411", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:45:12 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Converting VIF {"id": "269c2e0d-94ee-4084-985a-58c5afed4411", "address": "fa:16:3e:bd:11:20", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap269c2e0d-94", "ovs_interfaceid": "269c2e0d-94ee-4084-985a-58c5afed4411", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:45:12 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:11:20,bridge_name='br-int',has_traffic_filtering=True,id=269c2e0d-94ee-4084-985a-58c5afed4411,network=Network(95b97be9-d6db-45e9-b0f1-a72fc90b69d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap269c2e0d-94') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:45:12 user nova-compute[72444]: DEBUG os_vif [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:11:20,bridge_name='br-int',has_traffic_filtering=True,id=269c2e0d-94ee-4084-985a-58c5afed4411,network=Network(95b97be9-d6db-45e9-b0f1-a72fc90b69d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap269c2e0d-94') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:45:12 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:12 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:45:12 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:45:12 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:12 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap269c2e0d-94, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:45:12 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap269c2e0d-94, col_values=(('external_ids', {'iface-id': '269c2e0d-94ee-4084-985a-58c5afed4411', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:11:20', 'vm-uuid': 'e2859322-6f99-442d-bee1-65fe49ce6360'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:45:12 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:12 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:45:12 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:12 user nova-compute[72444]: INFO os_vif [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:11:20,bridge_name='br-int',has_traffic_filtering=True,id=269c2e0d-94ee-4084-985a-58c5afed4411,network=Network(95b97be9-d6db-45e9-b0f1-a72fc90b69d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap269c2e0d-94')
Aug 03 04:45:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:45:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:45:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] No VIF found with MAC fa:16:3e:bd:11:20, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:45:13 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691037898.872612, ba7bd541-c761-4e4a-ac7c-7dd2cb89150d => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:45:13 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] VM Stopped (Lifecycle Event)
Aug 03 04:45:13 user nova-compute[72444]: DEBUG nova.compute.manager [None req-c9f1ed75-2487-488b-a5c2-2c61f65e62b5 None None] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:45:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:13 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691037898.976752, e2859322-6f99-442d-bee1-65fe49ce6360 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:45:13 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] VM Stopped (Lifecycle Event)
Aug 03 04:45:14 user nova-compute[72444]: DEBUG nova.compute.manager [None req-bd15c196-8140-4525-964d-3b7e4795f2fd None None] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:45:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:14 user nova-compute[72444]: DEBUG nova.compute.manager [req-f539cfca-23b2-499c-a209-0af34c33eae8 req-a04ec5c5-27dd-4502-9344-3ef39320bbb2 service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Received event network-vif-plugged-269c2e0d-94ee-4084-985a-58c5afed4411 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:45:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f539cfca-23b2-499c-a209-0af34c33eae8 req-a04ec5c5-27dd-4502-9344-3ef39320bbb2 service nova] Acquiring lock "e2859322-6f99-442d-bee1-65fe49ce6360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f539cfca-23b2-499c-a209-0af34c33eae8 req-a04ec5c5-27dd-4502-9344-3ef39320bbb2 service nova] Lock "e2859322-6f99-442d-bee1-65fe49ce6360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f539cfca-23b2-499c-a209-0af34c33eae8 req-a04ec5c5-27dd-4502-9344-3ef39320bbb2 service nova] Lock "e2859322-6f99-442d-bee1-65fe49ce6360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:14 user nova-compute[72444]: DEBUG nova.compute.manager [req-f539cfca-23b2-499c-a209-0af34c33eae8 req-a04ec5c5-27dd-4502-9344-3ef39320bbb2 service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] No waiting events found dispatching network-vif-plugged-269c2e0d-94ee-4084-985a-58c5afed4411 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:45:14 user nova-compute[72444]: WARNING nova.compute.manager [req-f539cfca-23b2-499c-a209-0af34c33eae8 req-a04ec5c5-27dd-4502-9344-3ef39320bbb2 service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Received unexpected event network-vif-plugged-269c2e0d-94ee-4084-985a-58c5afed4411 for instance with vm_state active and task_state rebuild_spawning.
Aug 03 04:45:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:16 user nova-compute[72444]: DEBUG nova.compute.manager [req-4897fc99-1c58-43a8-968e-d8dca2eb42b2 req-5ace9e9f-30c6-4ce7-b854-07d83824b151 service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Received event network-vif-plugged-269c2e0d-94ee-4084-985a-58c5afed4411 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:45:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4897fc99-1c58-43a8-968e-d8dca2eb42b2 req-5ace9e9f-30c6-4ce7-b854-07d83824b151 service nova] Acquiring lock "e2859322-6f99-442d-bee1-65fe49ce6360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4897fc99-1c58-43a8-968e-d8dca2eb42b2 req-5ace9e9f-30c6-4ce7-b854-07d83824b151 service nova] Lock "e2859322-6f99-442d-bee1-65fe49ce6360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4897fc99-1c58-43a8-968e-d8dca2eb42b2 req-5ace9e9f-30c6-4ce7-b854-07d83824b151 service nova] Lock "e2859322-6f99-442d-bee1-65fe49ce6360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:16 user nova-compute[72444]: DEBUG nova.compute.manager [req-4897fc99-1c58-43a8-968e-d8dca2eb42b2 req-5ace9e9f-30c6-4ce7-b854-07d83824b151 service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] No waiting events found dispatching network-vif-plugged-269c2e0d-94ee-4084-985a-58c5afed4411 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:45:16 user nova-compute[72444]: WARNING nova.compute.manager [req-4897fc99-1c58-43a8-968e-d8dca2eb42b2 req-5ace9e9f-30c6-4ce7-b854-07d83824b151 service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Received unexpected event network-vif-plugged-269c2e0d-94ee-4084-985a-58c5afed4411 for instance with vm_state active and task_state rebuild_spawning.
Aug 03 04:45:16 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037916.958843, e2859322-6f99-442d-bee1-65fe49ce6360 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:45:16 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] VM Resumed (Lifecycle Event)
Aug 03 04:45:16 user nova-compute[72444]: DEBUG nova.compute.manager [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:45:16 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 04:45:16 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Instance spawned successfully.
Aug 03 04:45:16 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 04:45:16 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:45:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:45:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:45:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:45:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:45:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:45:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:45:17 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:45:17 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 03 04:45:17 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037916.9609299, e2859322-6f99-442d-bee1-65fe49ce6360 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:45:17 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] VM Started (Lifecycle Event)
Aug 03 04:45:17 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:45:17 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:45:17 user nova-compute[72444]: DEBUG nova.compute.manager [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:45:17 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 03 04:45:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:17 user nova-compute[72444]: DEBUG nova.objects.instance [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72444) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 03 04:45:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ab44b799-7f5c-4956-888f-96adb79ace13 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.102s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:17 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:18 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:18 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:21 user nova-compute[72444]: DEBUG nova.compute.manager [req-551f2a36-cd68-4e5f-a98a-17f3ee440759 req-b706233d-94f5-46f9-97e8-e967b283f9e7 service nova] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Received event volume-reimaged-fbd912dd-0923-470a-8a00-ee611de909cd {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:45:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-551f2a36-cd68-4e5f-a98a-17f3ee440759 req-b706233d-94f5-46f9-97e8-e967b283f9e7 service nova] Acquiring lock "ba7bd541-c761-4e4a-ac7c-7dd2cb89150d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-551f2a36-cd68-4e5f-a98a-17f3ee440759 req-b706233d-94f5-46f9-97e8-e967b283f9e7 service nova] Lock "ba7bd541-c761-4e4a-ac7c-7dd2cb89150d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-551f2a36-cd68-4e5f-a98a-17f3ee440759 req-b706233d-94f5-46f9-97e8-e967b283f9e7 service nova] Lock "ba7bd541-c761-4e4a-ac7c-7dd2cb89150d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:21 user nova-compute[72444]: DEBUG nova.compute.manager [req-551f2a36-cd68-4e5f-a98a-17f3ee440759 req-b706233d-94f5-46f9-97e8-e967b283f9e7 service nova] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Processing event volume-reimaged-fbd912dd-0923-470a-8a00-ee611de909cd {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 03 04:45:21 user nova-compute[72444]: DEBUG nova.compute.manager [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Instance event wait completed in 18 seconds for volume-reimaged {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:45:21 user nova-compute[72444]: INFO nova.virt.block_device [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Booting with volume fbd912dd-0923-470a-8a00-ee611de909cd at /dev/vda
Aug 03 04:45:21 user nova-compute[72444]: DEBUG os_brick.utils [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:45:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:21 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a92dadb-6fc4-4f46-aa5e-3ed8b42775cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:21 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[230e00d2-d8fe-47cd-8652-a35ab0e81120]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:21 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[247f1d38-645f-424b-951a-2fb576895e83]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:21 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[43293045-9a35-4e7e-98ce-77fbafc52014]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:45:21 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 04:45:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:45:21 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 04:45:21 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d3193b-0d7c-40d2-ba1a-256e1972eb80]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:21 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 04:45:21 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 04:45:21 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 04:45:21 user nova-compute[72444]: DEBUG os_brick.utils [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:45:21 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Updating existing volume attachment record: 993338bf-df86-4b86-8e63-881a554d0161 {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 04:45:22 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:22 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Acquiring lock "fbaa8179-1294-41ec-88cd-e23a568c5468" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Lock "fbaa8179-1294-41ec-88cd-e23a568c5468" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:23 user nova-compute[72444]: DEBUG nova.compute.manager [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 04:45:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:23 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 04:45:23 user nova-compute[72444]: INFO nova.compute.claims [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Claim successful on node user
Aug 03 04:45:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:23 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:45:24 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:45:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:24 user nova-compute[72444]: DEBUG nova.compute.manager [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 04:45:24 user nova-compute[72444]: DEBUG nova.compute.manager [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 04:45:24 user nova-compute[72444]: DEBUG nova.network.neutron [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 04:45:24 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 04:45:24 user nova-compute[72444]: DEBUG nova.compute.manager [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 04:45:24 user nova-compute[72444]: DEBUG nova.policy [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '099a590e90f043cba5b076c8dd75999d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c520dc44eff4401789ef1ff61cc24cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 04:45:24 user nova-compute[72444]: DEBUG nova.compute.manager [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 04:45:24 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 04:45:24 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Creating image(s)
Aug 03 04:45:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Acquiring lock "/opt/stack/data/nova/instances/fbaa8179-1294-41ec-88cd-e23a568c5468/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Lock "/opt/stack/data/nova/instances/fbaa8179-1294-41ec-88cd-e23a568c5468/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Lock "/opt/stack/data/nova/instances/fbaa8179-1294-41ec-88cd-e23a568c5468/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.145s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.142s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/fbaa8179-1294-41ec-88cd-e23a568c5468/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/fbaa8179-1294-41ec-88cd-e23a568c5468/disk 1073741824" returned: 0 in 0.062s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:24 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691037909.7985418, 42f131f8-83ac-4fd4-b056-f8dac3d32c55 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:45:24 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] VM Stopped (Lifecycle Event)
Aug 03 04:45:24 user nova-compute[72444]: DEBUG nova.compute.manager [None req-77074ee6-f2f3-45b6-8314-2d4e94c61896 None None] [instance: 42f131f8-83ac-4fd4-b056-f8dac3d32c55] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:45:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.196s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:24 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fbaa8179-1294-41ec-88cd-e23a568c5468/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 04:45:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbaa8179-1294-41ec-88cd-e23a568c5468/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbaa8179-1294-41ec-88cd-e23a568c5468/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:25 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Cannot resize image /opt/stack/data/nova/instances/fbaa8179-1294-41ec-88cd-e23a568c5468/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 04:45:25 user nova-compute[72444]: DEBUG nova.objects.instance [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Lazy-loading 'migration_context' on Instance uuid fbaa8179-1294-41ec-88cd-e23a568c5468 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:45:25 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 04:45:25 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Ensure instance console log exists: /opt/stack/data/nova/instances/fbaa8179-1294-41ec-88cd-e23a568c5468/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 04:45:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:25 user nova-compute[72444]: DEBUG nova.network.neutron [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Successfully created port: 5534b301-8c40-45db-8ead-84de2782535b {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:45:25 user nova-compute[72444]: DEBUG nova.network.neutron [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Successfully updated port: 5534b301-8c40-45db-8ead-84de2782535b {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:45:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Acquiring lock "refresh_cache-fbaa8179-1294-41ec-88cd-e23a568c5468" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:45:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Acquired lock "refresh_cache-fbaa8179-1294-41ec-88cd-e23a568c5468" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:45:25 user nova-compute[72444]: DEBUG nova.network.neutron [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:45:25 user nova-compute[72444]: DEBUG nova.compute.manager [req-0f7b5723-2d81-4e97-8ee8-7b4af2f66046 req-500378cc-f611-4bf0-9e31-613b31b2e84a service nova] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Received event network-changed-5534b301-8c40-45db-8ead-84de2782535b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:45:25 user nova-compute[72444]: DEBUG nova.compute.manager [req-0f7b5723-2d81-4e97-8ee8-7b4af2f66046 req-500378cc-f611-4bf0-9e31-613b31b2e84a service nova] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Refreshing instance network info cache due to event network-changed-5534b301-8c40-45db-8ead-84de2782535b. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:45:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0f7b5723-2d81-4e97-8ee8-7b4af2f66046 req-500378cc-f611-4bf0-9e31-613b31b2e84a service nova] Acquiring lock "refresh_cache-fbaa8179-1294-41ec-88cd-e23a568c5468" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:45:25 user nova-compute[72444]: DEBUG nova.network.neutron [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG nova.network.neutron [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Updating instance_info_cache with network_info: [{"id": "5534b301-8c40-45db-8ead-84de2782535b", "address": "fa:16:3e:b9:8c:72", "network": {"id": "23b52932-5969-4b02-8d35-6cbc7f007838", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1885096873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c520dc44eff4401789ef1ff61cc24cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5534b301-8c", "ovs_interfaceid": "5534b301-8c40-45db-8ead-84de2782535b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Releasing lock "refresh_cache-fbaa8179-1294-41ec-88cd-e23a568c5468" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG nova.compute.manager [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Instance network_info: |[{"id": "5534b301-8c40-45db-8ead-84de2782535b", "address": "fa:16:3e:b9:8c:72", "network": {"id": "23b52932-5969-4b02-8d35-6cbc7f007838", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1885096873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c520dc44eff4401789ef1ff61cc24cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5534b301-8c", "ovs_interfaceid": "5534b301-8c40-45db-8ead-84de2782535b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0f7b5723-2d81-4e97-8ee8-7b4af2f66046 req-500378cc-f611-4bf0-9e31-613b31b2e84a service nova] Acquired lock "refresh_cache-fbaa8179-1294-41ec-88cd-e23a568c5468" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG nova.network.neutron [req-0f7b5723-2d81-4e97-8ee8-7b4af2f66046 req-500378cc-f611-4bf0-9e31-613b31b2e84a service nova] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Refreshing network info cache for port 5534b301-8c40-45db-8ead-84de2782535b {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Start _get_guest_xml network_info=[{"id": "5534b301-8c40-45db-8ead-84de2782535b", "address": "fa:16:3e:b9:8c:72", "network": {"id": "23b52932-5969-4b02-8d35-6cbc7f007838", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1885096873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c520dc44eff4401789ef1ff61cc24cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5534b301-8c", "ovs_interfaceid": "5534b301-8c40-45db-8ead-84de2782535b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:45:26 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:45:26 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:45:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:45:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-165254666',display_name='tempest-VolumesActionsTest-instance-165254666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-165254666',id=18,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c520dc44eff4401789ef1ff61cc24cd4',ramdisk_id='',reservation_id='r-1d08mpa9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-684402275',owner_user_name='tempest-VolumesActionsTest-684402275-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:45:24Z,user_data=None,user_id='099a590e90f043cba5b076c8dd75999d',uuid=fbaa8179-1294-41ec-88cd-e23a568c5468,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5534b301-8c40-45db-8ead-84de2782535b", "address": "fa:16:3e:b9:8c:72", "network": {"id": "23b52932-5969-4b02-8d35-6cbc7f007838", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1885096873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c520dc44eff4401789ef1ff61cc24cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5534b301-8c", "ovs_interfaceid": "5534b301-8c40-45db-8ead-84de2782535b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Converting VIF {"id": "5534b301-8c40-45db-8ead-84de2782535b", "address": "fa:16:3e:b9:8c:72", "network": {"id": "23b52932-5969-4b02-8d35-6cbc7f007838", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1885096873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c520dc44eff4401789ef1ff61cc24cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5534b301-8c", "ovs_interfaceid": "5534b301-8c40-45db-8ead-84de2782535b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:8c:72,bridge_name='br-int',has_traffic_filtering=True,id=5534b301-8c40-45db-8ead-84de2782535b,network=Network(23b52932-5969-4b02-8d35-6cbc7f007838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5534b301-8c') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG nova.objects.instance [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Lazy-loading 'pci_devices' on Instance uuid fbaa8179-1294-41ec-88cd-e23a568c5468 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:45:26 user nova-compute[72444]:   <uuid>fbaa8179-1294-41ec-88cd-e23a568c5468</uuid>
Aug 03 04:45:26 user nova-compute[72444]:   <name>instance-00000012</name>
Aug 03 04:45:26 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:45:26 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:45:26 user nova-compute[72444]:   <metadata>
Aug 03 04:45:26 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:45:26 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:45:26 user nova-compute[72444]:       <nova:name>tempest-VolumesActionsTest-instance-165254666</nova:name>
Aug 03 04:45:26 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:45:26</nova:creationTime>
Aug 03 04:45:26 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:45:26 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:45:26 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:45:26 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:45:26 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:45:26 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:45:26 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:45:26 user nova-compute[72444]:       <nova:owner>
Aug 03 04:45:26 user nova-compute[72444]:         <nova:user uuid="099a590e90f043cba5b076c8dd75999d">tempest-VolumesActionsTest-684402275-project-member</nova:user>
Aug 03 04:45:26 user nova-compute[72444]:         <nova:project uuid="c520dc44eff4401789ef1ff61cc24cd4">tempest-VolumesActionsTest-684402275</nova:project>
Aug 03 04:45:26 user nova-compute[72444]:       </nova:owner>
Aug 03 04:45:26 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:45:26 user nova-compute[72444]:       <nova:ports>
Aug 03 04:45:26 user nova-compute[72444]:         <nova:port uuid="5534b301-8c40-45db-8ead-84de2782535b">
Aug 03 04:45:26 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 03 04:45:26 user nova-compute[72444]:         </nova:port>
Aug 03 04:45:26 user nova-compute[72444]:       </nova:ports>
Aug 03 04:45:26 user nova-compute[72444]:     </nova:instance>
Aug 03 04:45:26 user nova-compute[72444]:   </metadata>
Aug 03 04:45:26 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:45:26 user nova-compute[72444]:     <system>
Aug 03 04:45:26 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:45:26 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:45:26 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:45:26 user nova-compute[72444]:       <entry name="serial">fbaa8179-1294-41ec-88cd-e23a568c5468</entry>
Aug 03 04:45:26 user nova-compute[72444]:       <entry name="uuid">fbaa8179-1294-41ec-88cd-e23a568c5468</entry>
Aug 03 04:45:26 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:45:26 user nova-compute[72444]:     </system>
Aug 03 04:45:26 user nova-compute[72444]:   </sysinfo>
Aug 03 04:45:26 user nova-compute[72444]:   <os>
Aug 03 04:45:26 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:45:26 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:45:26 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:45:26 user nova-compute[72444]:   </os>
Aug 03 04:45:26 user nova-compute[72444]:   <features>
Aug 03 04:45:26 user nova-compute[72444]:     <acpi/>
Aug 03 04:45:26 user nova-compute[72444]:     <apic/>
Aug 03 04:45:26 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:45:26 user nova-compute[72444]:   </features>
Aug 03 04:45:26 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:45:26 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:45:26 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:45:26 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:45:26 user nova-compute[72444]:   </clock>
Aug 03 04:45:26 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:45:26 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:45:26 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:45:26 user nova-compute[72444]:   </cpu>
Aug 03 04:45:26 user nova-compute[72444]:   <devices>
Aug 03 04:45:26 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:45:26 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:45:26 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/fbaa8179-1294-41ec-88cd-e23a568c5468/disk"/>
Aug 03 04:45:26 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:45:26 user nova-compute[72444]:     </disk>
Aug 03 04:45:26 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:45:26 user nova-compute[72444]:       <mac address="fa:16:3e:b9:8c:72"/>
Aug 03 04:45:26 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:45:26 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:45:26 user nova-compute[72444]:       <target dev="tap5534b301-8c"/>
Aug 03 04:45:26 user nova-compute[72444]:     </interface>
Aug 03 04:45:26 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:45:26 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/fbaa8179-1294-41ec-88cd-e23a568c5468/console.log" append="off"/>
Aug 03 04:45:26 user nova-compute[72444]:     </serial>
Aug 03 04:45:26 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:45:26 user nova-compute[72444]:     <video>
Aug 03 04:45:26 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:45:26 user nova-compute[72444]:     </video>
Aug 03 04:45:26 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:45:26 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:45:26 user nova-compute[72444]:     </rng>
Aug 03 04:45:26 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:45:26 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:45:26 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:45:26 user nova-compute[72444]:     </memballoon>
Aug 03 04:45:26 user nova-compute[72444]:   </devices>
Aug 03 04:45:26 user nova-compute[72444]: </domain>
Aug 03 04:45:26 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:45:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-165254666',display_name='tempest-VolumesActionsTest-instance-165254666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-165254666',id=18,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c520dc44eff4401789ef1ff61cc24cd4',ramdisk_id='',reservation_id='r-1d08mpa9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-684402275',owner_user_name='tempest-VolumesActionsTest-684402275-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:45:24Z,user_data=None,user_id='099a590e90f043cba5b076c8dd75999d',uuid=fbaa8179-1294-41ec-88cd-e23a568c5468,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5534b301-8c40-45db-8ead-84de2782535b", "address": "fa:16:3e:b9:8c:72", "network": {"id": "23b52932-5969-4b02-8d35-6cbc7f007838", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1885096873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c520dc44eff4401789ef1ff61cc24cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5534b301-8c", "ovs_interfaceid": "5534b301-8c40-45db-8ead-84de2782535b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Converting VIF {"id": "5534b301-8c40-45db-8ead-84de2782535b", "address": "fa:16:3e:b9:8c:72", "network": {"id": "23b52932-5969-4b02-8d35-6cbc7f007838", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1885096873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c520dc44eff4401789ef1ff61cc24cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5534b301-8c", "ovs_interfaceid": "5534b301-8c40-45db-8ead-84de2782535b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:8c:72,bridge_name='br-int',has_traffic_filtering=True,id=5534b301-8c40-45db-8ead-84de2782535b,network=Network(23b52932-5969-4b02-8d35-6cbc7f007838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5534b301-8c') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG os_vif [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:8c:72,bridge_name='br-int',has_traffic_filtering=True,id=5534b301-8c40-45db-8ead-84de2782535b,network=Network(23b52932-5969-4b02-8d35-6cbc7f007838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5534b301-8c') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5534b301-8c, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5534b301-8c, col_values=(('external_ids', {'iface-id': '5534b301-8c40-45db-8ead-84de2782535b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:8c:72', 'vm-uuid': 'fbaa8179-1294-41ec-88cd-e23a568c5468'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:26 user nova-compute[72444]: INFO os_vif [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:8c:72,bridge_name='br-int',has_traffic_filtering=True,id=5534b301-8c40-45db-8ead-84de2782535b,network=Network(23b52932-5969-4b02-8d35-6cbc7f007838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5534b301-8c')
Aug 03 04:45:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] No VIF found with MAC fa:16:3e:b9:8c:72, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG nova.network.neutron [req-0f7b5723-2d81-4e97-8ee8-7b4af2f66046 req-500378cc-f611-4bf0-9e31-613b31b2e84a service nova] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Updated VIF entry in instance network info cache for port 5534b301-8c40-45db-8ead-84de2782535b. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG nova.network.neutron [req-0f7b5723-2d81-4e97-8ee8-7b4af2f66046 req-500378cc-f611-4bf0-9e31-613b31b2e84a service nova] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Updating instance_info_cache with network_info: [{"id": "5534b301-8c40-45db-8ead-84de2782535b", "address": "fa:16:3e:b9:8c:72", "network": {"id": "23b52932-5969-4b02-8d35-6cbc7f007838", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1885096873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c520dc44eff4401789ef1ff61cc24cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5534b301-8c", "ovs_interfaceid": "5534b301-8c40-45db-8ead-84de2782535b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:45:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0f7b5723-2d81-4e97-8ee8-7b4af2f66046 req-500378cc-f611-4bf0-9e31-613b31b2e84a service nova] Releasing lock "refresh_cache-fbaa8179-1294-41ec-88cd-e23a568c5468" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:45:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:28 user nova-compute[72444]: DEBUG nova.compute.manager [req-78b6c909-a7fc-497c-9339-5680f77a43f4 req-487e9b6b-252b-4c9f-8552-7513e577a2c2 service nova] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Received event network-vif-plugged-5534b301-8c40-45db-8ead-84de2782535b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:45:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-78b6c909-a7fc-497c-9339-5680f77a43f4 req-487e9b6b-252b-4c9f-8552-7513e577a2c2 service nova] Acquiring lock "fbaa8179-1294-41ec-88cd-e23a568c5468-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-78b6c909-a7fc-497c-9339-5680f77a43f4 req-487e9b6b-252b-4c9f-8552-7513e577a2c2 service nova] Lock "fbaa8179-1294-41ec-88cd-e23a568c5468-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-78b6c909-a7fc-497c-9339-5680f77a43f4 req-487e9b6b-252b-4c9f-8552-7513e577a2c2 service nova] Lock "fbaa8179-1294-41ec-88cd-e23a568c5468-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:28 user nova-compute[72444]: DEBUG nova.compute.manager [req-78b6c909-a7fc-497c-9339-5680f77a43f4 req-487e9b6b-252b-4c9f-8552-7513e577a2c2 service nova] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] No waiting events found dispatching network-vif-plugged-5534b301-8c40-45db-8ead-84de2782535b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:45:28 user nova-compute[72444]: WARNING nova.compute.manager [req-78b6c909-a7fc-497c-9339-5680f77a43f4 req-487e9b6b-252b-4c9f-8552-7513e577a2c2 service nova] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Received unexpected event network-vif-plugged-5534b301-8c40-45db-8ead-84de2782535b for instance with vm_state building and task_state spawning.
Aug 03 04:45:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:29 user nova-compute[72444]: INFO nova.compute.manager [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Rescuing
Aug 03 04:45:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "refresh_cache-4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:45:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquired lock "refresh_cache-4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:45:29 user nova-compute[72444]: DEBUG nova.network.neutron [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:45:30 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037930.0549529, fbaa8179-1294-41ec-88cd-e23a568c5468 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:45:30 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] VM Resumed (Lifecycle Event)
Aug 03 04:45:30 user nova-compute[72444]: DEBUG nova.compute.manager [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:45:30 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 04:45:30 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Instance spawned successfully.
Aug 03 04:45:30 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 04:45:30 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:45:30 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:45:30 user nova-compute[72444]: DEBUG nova.compute.manager [req-34f02ccb-49b2-416f-b03e-a9b019ce667e req-5d57dfb5-6933-481a-9e21-be7533d93330 service nova] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Received event network-vif-plugged-5534b301-8c40-45db-8ead-84de2782535b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:45:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-34f02ccb-49b2-416f-b03e-a9b019ce667e req-5d57dfb5-6933-481a-9e21-be7533d93330 service nova] Acquiring lock "fbaa8179-1294-41ec-88cd-e23a568c5468-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-34f02ccb-49b2-416f-b03e-a9b019ce667e req-5d57dfb5-6933-481a-9e21-be7533d93330 service nova] Lock "fbaa8179-1294-41ec-88cd-e23a568c5468-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-34f02ccb-49b2-416f-b03e-a9b019ce667e req-5d57dfb5-6933-481a-9e21-be7533d93330 service nova] Lock "fbaa8179-1294-41ec-88cd-e23a568c5468-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:30 user nova-compute[72444]: DEBUG nova.compute.manager [req-34f02ccb-49b2-416f-b03e-a9b019ce667e req-5d57dfb5-6933-481a-9e21-be7533d93330 service nova] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] No waiting events found dispatching network-vif-plugged-5534b301-8c40-45db-8ead-84de2782535b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:45:30 user nova-compute[72444]: WARNING nova.compute.manager [req-34f02ccb-49b2-416f-b03e-a9b019ce667e req-5d57dfb5-6933-481a-9e21-be7533d93330 service nova] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Received unexpected event network-vif-plugged-5534b301-8c40-45db-8ead-84de2782535b for instance with vm_state building and task_state spawning.
Aug 03 04:45:30 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:45:30 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037930.060564, fbaa8179-1294-41ec-88cd-e23a568c5468 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:45:30 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] VM Started (Lifecycle Event)
Aug 03 04:45:30 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:45:30 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:45:30 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:45:30 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:45:30 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:45:30 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:45:30 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:45:30 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:45:30 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:45:30 user nova-compute[72444]: INFO nova.compute.manager [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Took 5.95 seconds to spawn the instance on the hypervisor.
Aug 03 04:45:30 user nova-compute[72444]: DEBUG nova.compute.manager [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:45:30 user nova-compute[72444]: INFO nova.compute.manager [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Took 6.86 seconds to build instance.
Aug 03 04:45:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-11ee00d8-7657-4623-9e65-4d6a43610922 tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Lock "fbaa8179-1294-41ec-88cd-e23a568c5468" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.039s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:30 user nova-compute[72444]: DEBUG nova.network.neutron [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Updating instance_info_cache with network_info: [{"id": "d0cfd0c0-ac67-4335-85d2-6f0b956fae5b", "address": "fa:16:3e:e0:f6:85", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cfd0c0-ac", "ovs_interfaceid": "d0cfd0c0-ac67-4335-85d2-6f0b956fae5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:45:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Releasing lock "refresh_cache-4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:45:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:31 user nova-compute[72444]: DEBUG nova.compute.manager [req-15752787-565c-4dde-9417-cb3f258b45e3 req-c2af4547-e3ab-4667-a2fa-741402246eff service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Received event network-vif-unplugged-d0cfd0c0-ac67-4335-85d2-6f0b956fae5b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:45:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-15752787-565c-4dde-9417-cb3f258b45e3 req-c2af4547-e3ab-4667-a2fa-741402246eff service nova] Acquiring lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-15752787-565c-4dde-9417-cb3f258b45e3 req-c2af4547-e3ab-4667-a2fa-741402246eff service nova] Lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-15752787-565c-4dde-9417-cb3f258b45e3 req-c2af4547-e3ab-4667-a2fa-741402246eff service nova] Lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:31 user nova-compute[72444]: DEBUG nova.compute.manager [req-15752787-565c-4dde-9417-cb3f258b45e3 req-c2af4547-e3ab-4667-a2fa-741402246eff service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] No waiting events found dispatching network-vif-unplugged-d0cfd0c0-ac67-4335-85d2-6f0b956fae5b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:45:31 user nova-compute[72444]: WARNING nova.compute.manager [req-15752787-565c-4dde-9417-cb3f258b45e3 req-c2af4547-e3ab-4667-a2fa-741402246eff service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Received unexpected event network-vif-unplugged-d0cfd0c0-ac67-4335-85d2-6f0b956fae5b for instance with vm_state active and task_state rescuing.
Aug 03 04:45:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:31 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Instance destroyed successfully.
Aug 03 04:45:31 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Attempting rescue
Aug 03 04:45:31 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72444) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 03 04:45:31 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Instance directory exists: not creating {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 03 04:45:31 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Creating image(s)
Aug 03 04:45:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "/opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "/opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "/opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:31 user nova-compute[72444]: DEBUG nova.objects.instance [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:45:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:31 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:31 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.145s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:31 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk.rescue {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:31 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk.rescue" returned: 0 in 0.130s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:31 user nova-compute[72444]: DEBUG nova.objects.instance [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lazy-loading 'migration_context' on Instance uuid 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:45:31 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 04:45:31 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Start _get_guest_xml network_info=[{"id": "d0cfd0c0-ac67-4335-85d2-6f0b956fae5b", "address": "fa:16:3e:e0:f6:85", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "vif_mac": "fa:16:3e:e0:f6:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cfd0c0-ac", "ovs_interfaceid": "d0cfd0c0-ac67-4335-85d2-6f0b956fae5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:45:31 user nova-compute[72444]: DEBUG nova.objects.instance [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lazy-loading 'resources' on Instance uuid 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:45:31 user nova-compute[72444]: DEBUG nova.objects.instance [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lazy-loading 'numa_topology' on Instance uuid 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:45:32 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:45:32 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.objects.instance [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:40:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-394752472',display_name='tempest-ServerRescueNegativeTestJSON-server-394752472',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-394752472',id=1,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:41:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='063a2a64796f4b87a44383014f0af3dc',ramdisk_id='',reservation_id='r-5uc5v2n5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-665683708',owner_user_name='tempest-ServerRescueNegativeTestJSON-665683708-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:41:04Z,user_data=None,user_id='07e8b540c9194e1195cb898ad08acaa0',uuid=4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0cfd0c0-ac67-4335-85d2-6f0b956fae5b", "address": "fa:16:3e:e0:f6:85", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "vif_mac": "fa:16:3e:e0:f6:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cfd0c0-ac", "ovs_interfaceid": "d0cfd0c0-ac67-4335-85d2-6f0b956fae5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Converting VIF {"id": "d0cfd0c0-ac67-4335-85d2-6f0b956fae5b", "address": "fa:16:3e:e0:f6:85", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "vif_mac": "fa:16:3e:e0:f6:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cfd0c0-ac", "ovs_interfaceid": "d0cfd0c0-ac67-4335-85d2-6f0b956fae5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:f6:85,bridge_name='br-int',has_traffic_filtering=True,id=d0cfd0c0-ac67-4335-85d2-6f0b956fae5b,network=Network(bc85da72-7764-4b65-a071-aec46e3a2398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0cfd0c0-ac') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.objects.instance [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:45:32 user nova-compute[72444]:   <uuid>4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0</uuid>
Aug 03 04:45:32 user nova-compute[72444]:   <name>instance-00000001</name>
Aug 03 04:45:32 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:45:32 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:45:32 user nova-compute[72444]:   <metadata>
Aug 03 04:45:32 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:45:32 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:45:32 user nova-compute[72444]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-394752472</nova:name>
Aug 03 04:45:32 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:45:32</nova:creationTime>
Aug 03 04:45:32 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:45:32 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:45:32 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:45:32 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:45:32 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:45:32 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:45:32 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:45:32 user nova-compute[72444]:       <nova:owner>
Aug 03 04:45:32 user nova-compute[72444]:         <nova:user uuid="07e8b540c9194e1195cb898ad08acaa0">tempest-ServerRescueNegativeTestJSON-665683708-project-member</nova:user>
Aug 03 04:45:32 user nova-compute[72444]:         <nova:project uuid="063a2a64796f4b87a44383014f0af3dc">tempest-ServerRescueNegativeTestJSON-665683708</nova:project>
Aug 03 04:45:32 user nova-compute[72444]:       </nova:owner>
Aug 03 04:45:32 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:45:32 user nova-compute[72444]:       <nova:ports>
Aug 03 04:45:32 user nova-compute[72444]:         <nova:port uuid="d0cfd0c0-ac67-4335-85d2-6f0b956fae5b">
Aug 03 04:45:32 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 03 04:45:32 user nova-compute[72444]:         </nova:port>
Aug 03 04:45:32 user nova-compute[72444]:       </nova:ports>
Aug 03 04:45:32 user nova-compute[72444]:     </nova:instance>
Aug 03 04:45:32 user nova-compute[72444]:   </metadata>
Aug 03 04:45:32 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:45:32 user nova-compute[72444]:     <system>
Aug 03 04:45:32 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:45:32 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:45:32 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:45:32 user nova-compute[72444]:       <entry name="serial">4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0</entry>
Aug 03 04:45:32 user nova-compute[72444]:       <entry name="uuid">4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0</entry>
Aug 03 04:45:32 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:45:32 user nova-compute[72444]:     </system>
Aug 03 04:45:32 user nova-compute[72444]:   </sysinfo>
Aug 03 04:45:32 user nova-compute[72444]:   <os>
Aug 03 04:45:32 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:45:32 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:45:32 user nova-compute[72444]:   </os>
Aug 03 04:45:32 user nova-compute[72444]:   <features>
Aug 03 04:45:32 user nova-compute[72444]:     <acpi/>
Aug 03 04:45:32 user nova-compute[72444]:     <apic/>
Aug 03 04:45:32 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:45:32 user nova-compute[72444]:   </features>
Aug 03 04:45:32 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:45:32 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:45:32 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:45:32 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:45:32 user nova-compute[72444]:   </clock>
Aug 03 04:45:32 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:45:32 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:45:32 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:45:32 user nova-compute[72444]:   </cpu>
Aug 03 04:45:32 user nova-compute[72444]:   <devices>
Aug 03 04:45:32 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:45:32 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:45:32 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk.rescue"/>
Aug 03 04:45:32 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:45:32 user nova-compute[72444]:     </disk>
Aug 03 04:45:32 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:45:32 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:45:32 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk"/>
Aug 03 04:45:32 user nova-compute[72444]:       <target dev="vdb" bus="virtio"/>
Aug 03 04:45:32 user nova-compute[72444]:     </disk>
Aug 03 04:45:32 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:45:32 user nova-compute[72444]:       <mac address="fa:16:3e:e0:f6:85"/>
Aug 03 04:45:32 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:45:32 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:45:32 user nova-compute[72444]:       <target dev="tapd0cfd0c0-ac"/>
Aug 03 04:45:32 user nova-compute[72444]:     </interface>
Aug 03 04:45:32 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:45:32 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/console.log" append="off"/>
Aug 03 04:45:32 user nova-compute[72444]:     </serial>
Aug 03 04:45:32 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:45:32 user nova-compute[72444]:     <video>
Aug 03 04:45:32 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:45:32 user nova-compute[72444]:     </video>
Aug 03 04:45:32 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:45:32 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:45:32 user nova-compute[72444]:     </rng>
Aug 03 04:45:32 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:45:32 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:45:32 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:45:32 user nova-compute[72444]:     </memballoon>
Aug 03 04:45:32 user nova-compute[72444]:   </devices>
Aug 03 04:45:32 user nova-compute[72444]: </domain>
Aug 03 04:45:32 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:45:32 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Instance destroyed successfully.
Aug 03 04:45:32 user nova-compute[72444]: INFO nova.compute.manager [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Rescuing
Aug 03 04:45:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "refresh_cache-2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquired lock "refresh_cache-2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.network.neutron [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] No VIF found with MAC fa:16:3e:e0:f6:85, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 04:45:32 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Creating image(s)
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Did not create local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Ensure instance console log exists: /opt/stack/data/nova/instances/ba7bd541-c761-4e4a-ac7c-7dd2cb89150d/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Start _get_guest_xml network_info=[{"id": "5e00edc4-284f-4e60-b3f6-75ab3df268dc", "address": "fa:16:3e:49:68:54", "network": {"id": "f0b4a33e-e079-4817-8747-412ca56818fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1198621443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6037670c8c6450bb3663e55b50c6dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e00edc4-28", "ovs_interfaceid": "5e00edc4-284f-4e60-b3f6-75ab3df268dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'voVSHFml', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ba7bd541-c761-4e4a-ac7c-7dd2cb89150d', 'attached_at': '', 'detached_at': '', 'volume_id': 'fbd912dd-0923-470a-8a00-ee611de909cd', 'serial': 'fbd912dd-0923-470a-8a00-ee611de909cd'}, 'disk_bus': 'virtio', 'attachment_id': '993338bf-df86-4b86-8e63-881a554d0161', 'guest_format': None, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:45:32 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 03 04:45:32 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.objects.instance [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lazy-loading 'vcpu_model' on Instance uuid ba7bd541-c761-4e4a-ac7c-7dd2cb89150d {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'voVSHFml', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:45:32 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 03 04:45:32 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:45:32 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 03 04:45:32 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:45:32 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:45:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5916e6e0-59b1-452b-9085-981d51055395]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 04:45:32 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[302aabc0-a33f-417f-935b-4ed91dd2bd6d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd] added
Aug 03 04:45:32 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cb2df4-bcc8-4b70-8b66-de6a715dc8b9]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[db106914-bc07-4010-b2c8-3559a162c68b]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v voVSHFml {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG nova.network.neutron [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Updating instance_info_cache with network_info: [{"id": "c14e16af-c17e-4152-a400-cbb8fb4f41fa", "address": "fa:16:3e:05:10:6a", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14e16af-c1", "ovs_interfaceid": "c14e16af-c17e-4152-a400-cbb8fb4f41fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v voVSHFml" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[453d32c5-5cfe-451d-a7ee-511ef8492d36]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'voVSHFml'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Releasing lock "refresh_cache-2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca7886d-f612-4590-88da-3f8d542b3335]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25d3699-6647-4499-b86b-f2cc7414a45e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:45:32 user nova-compute[72444]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)
Aug 03 04:45:32 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:45:32 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:45:32 user nova-compute[72444]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)
Aug 03 04:45:32 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:45:32 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:45:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:33 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9921577c-6e8e-4dc6-ae35-8a071ab36b11]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:33 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd, portal: 172.16.0.220,3260]
Aug 03 04:45:33 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd, portal: 172.16.0.220,3260] successful.
Aug 03 04:45:33 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:45:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:33 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ef5f24-c9bb-47c3-b399-45dd03617ab3]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:33 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:45:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:33 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91da49b-3a3b-49cf-84a1-8372db7fd913]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:33 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:45:33 user nova-compute[72444]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)
Aug 03 04:45:33 user nova-compute[72444]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:45:33 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:45:33 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:45:33 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:45:33 user nova-compute[72444]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)
Aug 03 04:45:33 user nova-compute[72444]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:45:33 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:45:33 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:45:33 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:45:33 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:45:33 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] HCTL ('35', '-', '-', 0) found on session 14 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:45:33 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:45:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:33 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[08713545-a843-43fa-ad03-40f109b6ec35]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:33 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Searching for a device in session 14 and hctl ['35', '*', '*', 0] yield: None {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:45:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:33 user nova-compute[72444]: DEBUG nova.compute.manager [req-4bdd58c8-6f23-4e9d-8a96-3a7da5e79df6 req-5b1601fd-4e8b-4966-be5a-e2b2c9f107f5 service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Received event network-vif-plugged-d0cfd0c0-ac67-4335-85d2-6f0b956fae5b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:45:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4bdd58c8-6f23-4e9d-8a96-3a7da5e79df6 req-5b1601fd-4e8b-4966-be5a-e2b2c9f107f5 service nova] Acquiring lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4bdd58c8-6f23-4e9d-8a96-3a7da5e79df6 req-5b1601fd-4e8b-4966-be5a-e2b2c9f107f5 service nova] Lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4bdd58c8-6f23-4e9d-8a96-3a7da5e79df6 req-5b1601fd-4e8b-4966-be5a-e2b2c9f107f5 service nova] Lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:33 user nova-compute[72444]: DEBUG nova.compute.manager [req-4bdd58c8-6f23-4e9d-8a96-3a7da5e79df6 req-5b1601fd-4e8b-4966-be5a-e2b2c9f107f5 service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] No waiting events found dispatching network-vif-plugged-d0cfd0c0-ac67-4335-85d2-6f0b956fae5b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:45:33 user nova-compute[72444]: WARNING nova.compute.manager [req-4bdd58c8-6f23-4e9d-8a96-3a7da5e79df6 req-5b1601fd-4e8b-4966-be5a-e2b2c9f107f5 service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Received unexpected event network-vif-plugged-d0cfd0c0-ac67-4335-85d2-6f0b956fae5b for instance with vm_state active and task_state rescuing.
Aug 03 04:45:33 user nova-compute[72444]: DEBUG nova.compute.manager [req-c4d7c21f-8df0-409b-8a0d-c6d0f425e1f7 req-6477c60d-7ce0-4ce3-a6cf-e02e45d2178f service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Received event network-vif-unplugged-c14e16af-c17e-4152-a400-cbb8fb4f41fa {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:45:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-c4d7c21f-8df0-409b-8a0d-c6d0f425e1f7 req-6477c60d-7ce0-4ce3-a6cf-e02e45d2178f service nova] Acquiring lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-c4d7c21f-8df0-409b-8a0d-c6d0f425e1f7 req-6477c60d-7ce0-4ce3-a6cf-e02e45d2178f service nova] Lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-c4d7c21f-8df0-409b-8a0d-c6d0f425e1f7 req-6477c60d-7ce0-4ce3-a6cf-e02e45d2178f service nova] Lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:33 user nova-compute[72444]: DEBUG nova.compute.manager [req-c4d7c21f-8df0-409b-8a0d-c6d0f425e1f7 req-6477c60d-7ce0-4ce3-a6cf-e02e45d2178f service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] No waiting events found dispatching network-vif-unplugged-c14e16af-c17e-4152-a400-cbb8fb4f41fa {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:45:33 user nova-compute[72444]: WARNING nova.compute.manager [req-c4d7c21f-8df0-409b-8a0d-c6d0f425e1f7 req-6477c60d-7ce0-4ce3-a6cf-e02e45d2178f service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Received unexpected event network-vif-unplugged-c14e16af-c17e-4152-a400-cbb8fb4f41fa for instance with vm_state active and task_state rescuing.
Aug 03 04:45:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:34 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Instance destroyed successfully.
Aug 03 04:45:34 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Attempting a stable device rescue
Aug 03 04:45:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72444) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 03 04:45:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Instance directory exists: not creating {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 03 04:45:34 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Creating image(s)
Aug 03 04:45:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "/opt/stack/data/nova/instances/2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "/opt/stack/data/nova/instances/2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "/opt/stack/data/nova/instances/2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:34 user nova-compute[72444]: DEBUG nova.objects.instance [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:45:34 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Searching for a device in session 14 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:45:34 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'voVSHFml', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:45:34 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:45:34 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23533323039303336', 'path': '/dev/sdd'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:45:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533323039303336', 'path': '/dev/sdd'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:45:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "897dc89e7f234b25f627c191ee97deed1b2070f4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "897dc89e7f234b25f627c191ee97deed1b2070f4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-03T04:43:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1766085163',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1380099260',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxWTXqS2gTOwwksDvDA82ZhKXb+8OJ2l8zmonKnC8DV5DMkdpimVA0a9LAiDqgbZc2C7mTSh4D9lL13WOlFB3MFWXZFbpJsJYQhGkVl7O5aTGjbtLXsvFxHqIp9QmPVeg==',key_name='tempest-keypair-15472896',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:43:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f6037670c8c6450bb3663e55b50c6dd5',ramdisk_id='',reservation_id='r-91lxwkqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-780888408',owner_user_name='tempest-ServerActionsV293TestJSON-780888408-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:45:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6837fb4f8f04f38a0e429d8905eae54',uuid=ba7bd541-c761-4e4a-ac7c-7dd2cb89150d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e00edc4-284f-4e60-b3f6-75ab3df268dc", "address": "fa:16:3e:49:68:54", "network": {"id": "f0b4a33e-e079-4817-8747-412ca56818fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1198621443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6037670c8c6450bb3663e55b50c6dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e00edc4-28", "ovs_interfaceid": "5e00edc4-284f-4e60-b3f6-75ab3df268dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:45:34 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Converting VIF {"id": "5e00edc4-284f-4e60-b3f6-75ab3df268dc", "address": "fa:16:3e:49:68:54", "network": {"id": "f0b4a33e-e079-4817-8747-412ca56818fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1198621443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6037670c8c6450bb3663e55b50c6dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e00edc4-28", "ovs_interfaceid": "5e00edc4-284f-4e60-b3f6-75ab3df268dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:45:34 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:68:54,bridge_name='br-int',has_traffic_filtering=True,id=5e00edc4-284f-4e60-b3f6-75ab3df268dc,network=Network(f0b4a33e-e079-4817-8747-412ca56818fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e00edc4-28') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:45:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:45:34 user nova-compute[72444]:   <uuid>ba7bd541-c761-4e4a-ac7c-7dd2cb89150d</uuid>
Aug 03 04:45:34 user nova-compute[72444]:   <name>instance-0000000e</name>
Aug 03 04:45:34 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:45:34 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:45:34 user nova-compute[72444]:   <metadata>
Aug 03 04:45:34 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:45:34 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:45:34 user nova-compute[72444]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1766085163</nova:name>
Aug 03 04:45:34 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:45:32</nova:creationTime>
Aug 03 04:45:34 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:45:34 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:45:34 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:45:34 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:45:34 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:45:34 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:45:34 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:45:34 user nova-compute[72444]:       <nova:owner>
Aug 03 04:45:34 user nova-compute[72444]:         <nova:user uuid="e6837fb4f8f04f38a0e429d8905eae54">tempest-ServerActionsV293TestJSON-780888408-project-member</nova:user>
Aug 03 04:45:34 user nova-compute[72444]:         <nova:project uuid="f6037670c8c6450bb3663e55b50c6dd5">tempest-ServerActionsV293TestJSON-780888408</nova:project>
Aug 03 04:45:34 user nova-compute[72444]:       </nova:owner>
Aug 03 04:45:34 user nova-compute[72444]:       <nova:ports>
Aug 03 04:45:34 user nova-compute[72444]:         <nova:port uuid="5e00edc4-284f-4e60-b3f6-75ab3df268dc">
Aug 03 04:45:34 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 03 04:45:34 user nova-compute[72444]:         </nova:port>
Aug 03 04:45:34 user nova-compute[72444]:       </nova:ports>
Aug 03 04:45:34 user nova-compute[72444]:     </nova:instance>
Aug 03 04:45:34 user nova-compute[72444]:   </metadata>
Aug 03 04:45:34 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:45:34 user nova-compute[72444]:     <system>
Aug 03 04:45:34 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:45:34 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:45:34 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:45:34 user nova-compute[72444]:       <entry name="serial">ba7bd541-c761-4e4a-ac7c-7dd2cb89150d</entry>
Aug 03 04:45:34 user nova-compute[72444]:       <entry name="uuid">ba7bd541-c761-4e4a-ac7c-7dd2cb89150d</entry>
Aug 03 04:45:34 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:45:34 user nova-compute[72444]:     </system>
Aug 03 04:45:34 user nova-compute[72444]:   </sysinfo>
Aug 03 04:45:34 user nova-compute[72444]:   <os>
Aug 03 04:45:34 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:45:34 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:45:34 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:45:34 user nova-compute[72444]:   </os>
Aug 03 04:45:34 user nova-compute[72444]:   <features>
Aug 03 04:45:34 user nova-compute[72444]:     <acpi/>
Aug 03 04:45:34 user nova-compute[72444]:     <apic/>
Aug 03 04:45:34 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:45:34 user nova-compute[72444]:   </features>
Aug 03 04:45:34 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:45:34 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:45:34 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:45:34 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:45:34 user nova-compute[72444]:   </clock>
Aug 03 04:45:34 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:45:34 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:45:34 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:45:34 user nova-compute[72444]:   </cpu>
Aug 03 04:45:34 user nova-compute[72444]:   <devices>
Aug 03 04:45:34 user nova-compute[72444]:     <disk type="block" device="disk">
Aug 03 04:45:34 user nova-compute[72444]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:45:34 user nova-compute[72444]:       <source dev="/dev/sdd"/>
Aug 03 04:45:34 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:45:34 user nova-compute[72444]:       <serial>fbd912dd-0923-470a-8a00-ee611de909cd</serial>
Aug 03 04:45:34 user nova-compute[72444]:     </disk>
Aug 03 04:45:34 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:45:34 user nova-compute[72444]:       <mac address="fa:16:3e:49:68:54"/>
Aug 03 04:45:34 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:45:34 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:45:34 user nova-compute[72444]:       <target dev="tap5e00edc4-28"/>
Aug 03 04:45:34 user nova-compute[72444]:     </interface>
Aug 03 04:45:34 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:45:34 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/ba7bd541-c761-4e4a-ac7c-7dd2cb89150d/console.log" append="off"/>
Aug 03 04:45:34 user nova-compute[72444]:     </serial>
Aug 03 04:45:34 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:45:34 user nova-compute[72444]:     <video>
Aug 03 04:45:34 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:45:34 user nova-compute[72444]:     </video>
Aug 03 04:45:34 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:45:34 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:45:34 user nova-compute[72444]:     </rng>
Aug 03 04:45:34 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:45:34 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:45:34 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:45:34 user nova-compute[72444]:     </memballoon>
Aug 03 04:45:34 user nova-compute[72444]:   </devices>
Aug 03 04:45:34 user nova-compute[72444]: </domain>
Aug 03 04:45:34 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:45:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-03T04:43:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1766085163',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1380099260',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxWTXqS2gTOwwksDvDA82ZhKXb+8OJ2l8zmonKnC8DV5DMkdpimVA0a9LAiDqgbZc2C7mTSh4D9lL13WOlFB3MFWXZFbpJsJYQhGkVl7O5aTGjbtLXsvFxHqIp9QmPVeg==',key_name='tempest-keypair-15472896',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:43:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f6037670c8c6450bb3663e55b50c6dd5',ramdisk_id='',reservation_id='r-91lxwkqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-780888408',owner_user_name='tempest-ServerActionsV293TestJSON-780888408-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:45:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6837fb4f8f04f38a0e429d8905eae54',uuid=ba7bd541-c761-4e4a-ac7c-7dd2cb89150d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e00edc4-284f-4e60-b3f6-75ab3df268dc", "address": "fa:16:3e:49:68:54", "network": {"id": "f0b4a33e-e079-4817-8747-412ca56818fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1198621443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6037670c8c6450bb3663e55b50c6dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e00edc4-28", "ovs_interfaceid": "5e00edc4-284f-4e60-b3f6-75ab3df268dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:45:34 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Converting VIF {"id": "5e00edc4-284f-4e60-b3f6-75ab3df268dc", "address": "fa:16:3e:49:68:54", "network": {"id": "f0b4a33e-e079-4817-8747-412ca56818fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1198621443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6037670c8c6450bb3663e55b50c6dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e00edc4-28", "ovs_interfaceid": "5e00edc4-284f-4e60-b3f6-75ab3df268dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:45:34 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:68:54,bridge_name='br-int',has_traffic_filtering=True,id=5e00edc4-284f-4e60-b3f6-75ab3df268dc,network=Network(f0b4a33e-e079-4817-8747-412ca56818fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e00edc4-28') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:45:34 user nova-compute[72444]: DEBUG os_vif [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:68:54,bridge_name='br-int',has_traffic_filtering=True,id=5e00edc4-284f-4e60-b3f6-75ab3df268dc,network=Network(f0b4a33e-e079-4817-8747-412ca56818fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e00edc4-28') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:45:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:45:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:45:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e00edc4-28, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:45:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5e00edc4-28, col_values=(('external_ids', {'iface-id': '5e00edc4-284f-4e60-b3f6-75ab3df268dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:68:54', 'vm-uuid': 'ba7bd541-c761-4e4a-ac7c-7dd2cb89150d'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:45:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:45:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:34 user nova-compute[72444]: INFO os_vif [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:68:54,bridge_name='br-int',has_traffic_filtering=True,id=5e00edc4-284f-4e60-b3f6-75ab3df268dc,network=Network(f0b4a33e-e079-4817-8747-412ca56818fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e00edc4-28')
Aug 03 04:45:35 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/897dc89e7f234b25f627c191ee97deed1b2070f4.part --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:35 user nova-compute[72444]: DEBUG nova.compute.manager [req-b465ba5a-fb4f-4e61-9b8e-4493259e6cc5 req-f51ef526-9fdc-491f-8826-5d2903a9f052 service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Received event network-vif-plugged-d0cfd0c0-ac67-4335-85d2-6f0b956fae5b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:45:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b465ba5a-fb4f-4e61-9b8e-4493259e6cc5 req-f51ef526-9fdc-491f-8826-5d2903a9f052 service nova] Acquiring lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b465ba5a-fb4f-4e61-9b8e-4493259e6cc5 req-f51ef526-9fdc-491f-8826-5d2903a9f052 service nova] Lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b465ba5a-fb4f-4e61-9b8e-4493259e6cc5 req-f51ef526-9fdc-491f-8826-5d2903a9f052 service nova] Lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:35 user nova-compute[72444]: DEBUG nova.compute.manager [req-b465ba5a-fb4f-4e61-9b8e-4493259e6cc5 req-f51ef526-9fdc-491f-8826-5d2903a9f052 service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] No waiting events found dispatching network-vif-plugged-d0cfd0c0-ac67-4335-85d2-6f0b956fae5b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:45:35 user nova-compute[72444]: WARNING nova.compute.manager [req-b465ba5a-fb4f-4e61-9b8e-4493259e6cc5 req-f51ef526-9fdc-491f-8826-5d2903a9f052 service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Received unexpected event network-vif-plugged-d0cfd0c0-ac67-4335-85d2-6f0b956fae5b for instance with vm_state active and task_state rescuing.
Aug 03 04:45:35 user nova-compute[72444]: DEBUG nova.compute.manager [req-b465ba5a-fb4f-4e61-9b8e-4493259e6cc5 req-f51ef526-9fdc-491f-8826-5d2903a9f052 service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Received event network-vif-plugged-d0cfd0c0-ac67-4335-85d2-6f0b956fae5b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:45:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b465ba5a-fb4f-4e61-9b8e-4493259e6cc5 req-f51ef526-9fdc-491f-8826-5d2903a9f052 service nova] Acquiring lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b465ba5a-fb4f-4e61-9b8e-4493259e6cc5 req-f51ef526-9fdc-491f-8826-5d2903a9f052 service nova] Lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b465ba5a-fb4f-4e61-9b8e-4493259e6cc5 req-f51ef526-9fdc-491f-8826-5d2903a9f052 service nova] Lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:35 user nova-compute[72444]: DEBUG nova.compute.manager [req-b465ba5a-fb4f-4e61-9b8e-4493259e6cc5 req-f51ef526-9fdc-491f-8826-5d2903a9f052 service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] No waiting events found dispatching network-vif-plugged-d0cfd0c0-ac67-4335-85d2-6f0b956fae5b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:45:35 user nova-compute[72444]: WARNING nova.compute.manager [req-b465ba5a-fb4f-4e61-9b8e-4493259e6cc5 req-f51ef526-9fdc-491f-8826-5d2903a9f052 service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Received unexpected event network-vif-plugged-d0cfd0c0-ac67-4335-85d2-6f0b956fae5b for instance with vm_state active and task_state rescuing.
Aug 03 04:45:35 user nova-compute[72444]: DEBUG nova.compute.manager [req-71f41cb6-928d-4cc5-82dd-c94279af1d9e req-a14c5878-1539-4f0c-a358-87f4b6c8b4f2 service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Received event network-vif-plugged-c14e16af-c17e-4152-a400-cbb8fb4f41fa {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:45:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-71f41cb6-928d-4cc5-82dd-c94279af1d9e req-a14c5878-1539-4f0c-a358-87f4b6c8b4f2 service nova] Acquiring lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-71f41cb6-928d-4cc5-82dd-c94279af1d9e req-a14c5878-1539-4f0c-a358-87f4b6c8b4f2 service nova] Lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-71f41cb6-928d-4cc5-82dd-c94279af1d9e req-a14c5878-1539-4f0c-a358-87f4b6c8b4f2 service nova] Lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:35 user nova-compute[72444]: DEBUG nova.compute.manager [req-71f41cb6-928d-4cc5-82dd-c94279af1d9e req-a14c5878-1539-4f0c-a358-87f4b6c8b4f2 service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] No waiting events found dispatching network-vif-plugged-c14e16af-c17e-4152-a400-cbb8fb4f41fa {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:45:35 user nova-compute[72444]: WARNING nova.compute.manager [req-71f41cb6-928d-4cc5-82dd-c94279af1d9e req-a14c5878-1539-4f0c-a358-87f4b6c8b4f2 service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Received unexpected event network-vif-plugged-c14e16af-c17e-4152-a400-cbb8fb4f41fa for instance with vm_state active and task_state rescuing.
Aug 03 04:45:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:45:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] No VIF found with MAC fa:16:3e:49:68:54, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:45:35 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/897dc89e7f234b25f627c191ee97deed1b2070f4.part --force-share --output=json" returned: 0 in 0.176s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:35 user nova-compute[72444]: DEBUG nova.virt.images [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] e03fddb7-daca-464e-b807-b4e762a60ceb was qcow2, converting to raw {{(pid=72444) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 03 04:45:35 user nova-compute[72444]: DEBUG nova.privsep.utils [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72444) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 03 04:45:35 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/897dc89e7f234b25f627c191ee97deed1b2070f4.part /opt/stack/data/nova/instances/_base/897dc89e7f234b25f627c191ee97deed1b2070f4.converted {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/897dc89e7f234b25f627c191ee97deed1b2070f4.part /opt/stack/data/nova/instances/_base/897dc89e7f234b25f627c191ee97deed1b2070f4.converted" returned: 0 in 0.325s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/897dc89e7f234b25f627c191ee97deed1b2070f4.converted --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/897dc89e7f234b25f627c191ee97deed1b2070f4.converted --force-share --output=json" returned: 0 in 0.133s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "897dc89e7f234b25f627c191ee97deed1b2070f4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.273s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "897dc89e7f234b25f627c191ee97deed1b2070f4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "897dc89e7f234b25f627c191ee97deed1b2070f4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/897dc89e7f234b25f627c191ee97deed1b2070f4 --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/897dc89e7f234b25f627c191ee97deed1b2070f4 --force-share --output=json" returned: 0 in 0.145s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/897dc89e7f234b25f627c191ee97deed1b2070f4,backing_fmt=raw /opt/stack/data/nova/instances/2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15/disk.rescue {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/897dc89e7f234b25f627c191ee97deed1b2070f4,backing_fmt=raw /opt/stack/data/nova/instances/2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15/disk.rescue" returned: 0 in 0.050s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "897dc89e7f234b25f627c191ee97deed1b2070f4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG nova.objects.instance [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lazy-loading 'migration_context' on Instance uuid 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Start _get_guest_xml network_info=[{"id": "c14e16af-c17e-4152-a400-cbb8fb4f41fa", "address": "fa:16:3e:05:10:6a", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "vif_mac": "fa:16:3e:05:10:6a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14e16af-c1", "ovs_interfaceid": "c14e16af-c17e-4152-a400-cbb8fb4f41fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e03fddb7-daca-464e-b807-b4e762a60ceb', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RFpBszwX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15', 'attached_at': '', 'detached_at': '', 'volume_id': 'fe332412-b62b-4f63-abe0-b743ff189828', 'serial': 'fe332412-b62b-4f63-abe0-b743ff189828'}, 'disk_bus': 'virtio', 'attachment_id': 'b14fb212-9627-4a48-a0a3-0568fbcfba34', 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG nova.objects.instance [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lazy-loading 'resources' on Instance uuid 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG nova.objects.instance [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lazy-loading 'numa_topology' on Instance uuid 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:45:36 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:45:36 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:45:36 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG nova.objects.instance [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RFpBszwX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:45:36 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:45:36 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:45:36 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:45:36 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:45:36 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:45:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2755a3-ee7e-490d-963b-177b36d9178c]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = RFpBszwX\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 03 04:45:36 user nova-compute[72444]: node.name = iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828
Aug 03 04:45:36 user nova-compute[72444]: node.tpgt = -1
Aug 03 04:45:36 user nova-compute[72444]: node.startup = automatic
Aug 03 04:45:36 user nova-compute[72444]: node.leading_login = No
Aug 03 04:45:36 user nova-compute[72444]: iface.iscsi_ifacename = default
Aug 03 04:45:36 user nova-compute[72444]: iface.net_ifacename = <empty>
Aug 03 04:45:36 user nova-compute[72444]: iface.ipaddress = <empty>
Aug 03 04:45:36 user nova-compute[72444]: iface.prefix_len = 0
Aug 03 04:45:36 user nova-compute[72444]: iface.hwaddress = <empty>
Aug 03 04:45:36 user nova-compute[72444]: iface.transport_name = tcp
Aug 03 04:45:36 user nova-compute[72444]: iface.initiatorname = <empty>
Aug 03 04:45:36 user nova-compute[72444]: iface.state = <empty>
Aug 03 04:45:36 user nova-compute[72444]: iface.vlan_id = 0
Aug 03 04:45:36 user nova-compute[72444]: iface.vlan_priority = 0
Aug 03 04:45:36 user nova-compute[72444]: iface.vlan_state = <empty>
Aug 03 04:45:36 user nova-compute[72444]: iface.iface_num = 0
Aug 03 04:45:36 user nova-compute[72444]: iface.mtu = 0
Aug 03 04:45:36 user nova-compute[72444]: iface.port = 0
Aug 03 04:45:36 user nova-compute[72444]: iface.bootproto = <empty>
Aug 03 04:45:36 user nova-compute[72444]: iface.subnet_mask = <empty>
Aug 03 04:45:36 user nova-compute[72444]: iface.gateway = <empty>
Aug 03 04:45:36 user nova-compute[72444]: iface.dhcp_alt_client_id_state = <empty>
Aug 03 04:45:36 user nova-compute[72444]: iface.dhcp_alt_client_id = <empty>
Aug 03 04:45:36 user nova-compute[72444]: iface.dhcp_dns = <empty>
Aug 03 04:45:36 user nova-compute[72444]: iface.dhcp_learn_iqn = <empty>
Aug 03 04:45:36 user nova-compute[72444]: iface.dhcp_req_vendor_id_state = <empty>
Aug 03 04:45:36 user nova-compute[72444]: iface.dhcp_vendor_id_state = <empty>
Aug 03 04:45:36 user nova-compute[72444]: iface.dhcp_vendor_id = <empty>
Aug 03 04:45:36 user nova-compute[72444]: iface.dhcp_slp_da = <empty>
Aug 03 04:45:36 user nova-compute[72444]: iface.fragmentation = <empty>
Aug 03 04:45:36 user nova-compute[72444]: iface.gratuitous_arp = <empty>
Aug 03 04:45:36 user nova-compute[72444]: iface.incoming_forwarding = <empty>
Aug 03 04:45:36 user nova-compute[72444]: iface.tos_state = <empty>
Aug 03 04:45:36 user nova-compute[72444]: iface.tos = 0
Aug 03 04:45:36 user nova-compute[72444]: iface.ttl = 0
Aug 03 04:45:36 user nova-compute[72444]: iface.delayed_ack = <empty>
Aug 03 04:45:36 user nova-compute[72444]: iface.tcp_nagle = <empty>
Aug 03 04:45:36 user nova-compute[72444]: iface.tcp_wsf_state = <empty>
Aug 03 04:45:36 user nova-compute[72444]: iface.tcp_wsf = 0
Aug 03 04:45:36 user nova-compute[72444]: iface.tcp_timer_scale = 0
Aug 03 04:45:36 user nova-compute[72444]: iface.tcp_timestamp = <empty>
Aug 03 04:45:36 user nova-compute[72444]: iface.redirect = <empty>
Aug 03 04:45:36 user nova-compute[72444]: iface.def_task_mgmt_timeout = 0
Aug 03 04:45:36 user nova-compute[72444]: iface.header_digest = <empty>
Aug 03 04:45:36 user nova-compute[72444]: iface.data_digest = <empty>
Aug 03 04:45:36 user nova-compute[72444]: iface.immediate_data = <empty>
Aug 03 04:45:36 user nova-compute[72444]: iface.initial_r2t = <empty>
Aug 03 04:45:36 user nova-compute[72444]: iface.data_seq_inorder = <empty>
Aug 03 04:45:36 user nova-compute[72444]: iface.data_pdu_inorder = <empty>
Aug 03 04:45:36 user nova-compute[72444]: iface.erl = 0
Aug 03 04:45:36 user nova-compute[72444]: iface.max_receive_data_len = 0
Aug 03 04:45:36 user nova-compute[72444]: iface.first_burst_len = 0
Aug 03 04:45:36 user nova-compute[72444]: iface.max_outstanding_r2t = 0
Aug 03 04:45:36 user nova-compute[72444]: iface.max_burst_len = 0
Aug 03 04:45:36 user nova-compute[72444]: iface.chap_auth = <empty>
Aug 03 04:45:36 user nova-compute[72444]: iface.bidi_chap = <empty>
Aug 03 04:45:36 user nova-compute[72444]: iface.strict_login_compliance = <empty>
Aug 03 04:45:36 user nova-compute[72444]: iface.discovery_auth = <empty>
Aug 03 04:45:36 user nova-compute[72444]: iface.discovery_logout = <empty>
Aug 03 04:45:36 user nova-compute[72444]: node.discovery_address = <empty>
Aug 03 04:45:36 user nova-compute[72444]: node.discovery_port = 0
Aug 03 04:45:36 user nova-compute[72444]: node.discovery_type = static
Aug 03 04:45:36 user nova-compute[72444]: node.session.initial_cmdsn = 0
Aug 03 04:45:36 user nova-compute[72444]: node.session.initial_login_retry_max = 8
Aug 03 04:45:36 user nova-compute[72444]: node.session.xmit_thread_priority = -20
Aug 03 04:45:36 user nova-compute[72444]: node.session.cmds_max = 128
Aug 03 04:45:36 user nova-compute[72444]: node.session.queue_depth = 32
Aug 03 04:45:36 user nova-compute[72444]: node.session.nr_sessions = 1
Aug 03 04:45:36 user nova-compute[72444]: node.session.auth.authmethod = CHAP
Aug 03 04:45:36 user nova-compute[72444]: node.session.auth.username = RFpBszwX
Aug 03 04:45:36 user nova-compute[72444]: node.session.auth.password = ***
Aug 03 04:45:36 user nova-compute[72444]: node.session.auth.username_in = <empty>
Aug 03 04:45:36 user nova-compute[72444]: node.session.auth.password_in = <empty>
Aug 03 04:45:36 user nova-compute[72444]: node.session.auth.chap_algs = MD5
Aug 03 04:45:36 user nova-compute[72444]: node.session.timeo.replacement_timeout = 120
Aug 03 04:45:36 user nova-compute[72444]: node.session.err_timeo.abort_timeout = 15
Aug 03 04:45:36 user nova-compute[72444]: node.session.err_timeo.lu_reset_timeout = 30
Aug 03 04:45:36 user nova-compute[72444]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 03 04:45:36 user nova-compute[72444]: node.session.err_timeo.host_reset_timeout = 60
Aug 03 04:45:36 user nova-compute[72444]: node.session.iscsi.FastAbort = Yes
Aug 03 04:45:36 user nova-compute[72444]: node.session.iscsi.InitialR2T = No
Aug 03 04:45:36 user nova-compute[72444]: node.session.iscsi.ImmediateData = Yes
Aug 03 04:45:36 user nova-compute[72444]: node.session.iscsi.FirstBurstLength = 262144
Aug 03 04:45:36 user nova-compute[72444]: node.session.iscsi.MaxBurstLength = 16776192
Aug 03 04:45:36 user nova-compute[72444]: node.session.iscsi.DefaultTime2Retain = 0
Aug 03 04:45:36 user nova-compute[72444]: node.session.iscsi.DefaultTime2Wait = 2
Aug 03 04:45:36 user nova-compute[72444]: node.session.iscsi.MaxConnections = 1
Aug 03 04:45:36 user nova-compute[72444]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 03 04:45:36 user nova-compute[72444]: node.session.iscsi.ERL = 0
Aug 03 04:45:36 user nova-compute[72444]: node.session.scan = manual
Aug 03 04:45:36 user nova-compute[72444]: node.session.reopen_max = 0
Aug 03 04:45:36 user nova-compute[72444]: node.conn[0].address = 172.16.0.220
Aug 03 04:45:36 user nova-compute[72444]: node.conn[0].port = 3260
Aug 03 04:45:36 user nova-compute[72444]: node.conn[0].startup = manual
Aug 03 04:45:36 user nova-compute[72444]: node.conn[0].tcp.window_size = 524288
Aug 03 04:45:36 user nova-compute[72444]: node.conn[0].tcp.type_of_service = 0
Aug 03 04:45:36 user nova-compute[72444]: node.conn[0].timeo.logout_timeout = 15
Aug 03 04:45:36 user nova-compute[72444]: node.conn[0].timeo.login_timeout = 15
Aug 03 04:45:36 user nova-compute[72444]: node.conn[0].timeo.auth_timeout = 45
Aug 03 04:45:36 user nova-compute[72444]: node.conn[0].timeo.noop_out_interval = 5
Aug 03 04:45:36 user nova-compute[72444]: node.conn[0].timeo.noop_out_timeout = 5
Aug 03 04:45:36 user nova-compute[72444]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 03 04:45:36 user nova-compute[72444]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 03 04:45:36 user nova-compute[72444]: node.conn[0].iscsi.HeaderDigest = None
Aug 03 04:45:36 user nova-compute[72444]: node.conn[0].iscsi.DataDigest = None
Aug 03 04:45:36 user nova-compute[72444]: node.conn[0].iscsi.IFMarker = No
Aug 03 04:45:36 user nova-compute[72444]: node.conn[0].iscsi.OFMarker = No
Aug 03 04:45:36 user nova-compute[72444]: # END RECORD
Aug 03 04:45:36 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c080a5-b302-4038-a1e3-a4ceb3a7f462]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1882c1-43bb-423e-ac8a-2fba2d3d7975]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RFpBszwX {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RFpBszwX" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9932a3b2-5b4a-43df-a99a-747ba05365f3]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RFpBszwX'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce7cec6-aede-499d-b585-39c894a4e917]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2324c22f-4bd2-4484-988f-7939436020f6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:45:36 user nova-compute[72444]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)
Aug 03 04:45:36 user nova-compute[72444]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:45:36 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:45:36 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:45:36 user nova-compute[72444]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)
Aug 03 04:45:36 user nova-compute[72444]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:45:36 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:45:36 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.160s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] HCTL ('37', '0', '0', 0) found on session 9 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b87dc95-bc7b-49ca-9302-93f931922c20]: (4, ('0 0 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Searching for a device in session 9 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RFpBszwX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.187s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] <== connect_volume: return (188ms) {'type': 'block', 'scsi_wwn': '26334323031306438', 'path': '/dev/sdf'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334323031306438', 'path': '/dev/sdf'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:43:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1841165233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1841165233',id=15,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:44:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='929fd4a3127b475282426d4412e58def',ramdisk_id='',reservation_id='r-p417nobm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1082770125',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:44:14Z,user_data=None,user_id='ceede92aa3a74060a7f57d29d0d97aee',uuid=2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c14e16af-c17e-4152-a400-cbb8fb4f41fa", "address": "fa:16:3e:05:10:6a", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "vif_mac": "fa:16:3e:05:10:6a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14e16af-c1", "ovs_interfaceid": "c14e16af-c17e-4152-a400-cbb8fb4f41fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Converting VIF {"id": "c14e16af-c17e-4152-a400-cbb8fb4f41fa", "address": "fa:16:3e:05:10:6a", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "vif_mac": "fa:16:3e:05:10:6a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14e16af-c1", "ovs_interfaceid": "c14e16af-c17e-4152-a400-cbb8fb4f41fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:10:6a,bridge_name='br-int',has_traffic_filtering=True,id=c14e16af-c17e-4152-a400-cbb8fb4f41fa,network=Network(0e8b3ddd-e35a-45eb-a34c-614654c25549),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc14e16af-c1') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:45:36 user nova-compute[72444]: DEBUG nova.objects.instance [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:45:37 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:45:37 user nova-compute[72444]:   <uuid>2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15</uuid>
Aug 03 04:45:37 user nova-compute[72444]:   <name>instance-0000000f</name>
Aug 03 04:45:37 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:45:37 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:45:37 user nova-compute[72444]:   <metadata>
Aug 03 04:45:37 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:45:37 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:45:37 user nova-compute[72444]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1841165233</nova:name>
Aug 03 04:45:37 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:45:36</nova:creationTime>
Aug 03 04:45:37 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:45:37 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:45:37 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:45:37 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:45:37 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:45:37 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:45:37 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:45:37 user nova-compute[72444]:       <nova:owner>
Aug 03 04:45:37 user nova-compute[72444]:         <nova:user uuid="ceede92aa3a74060a7f57d29d0d97aee">tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member</nova:user>
Aug 03 04:45:37 user nova-compute[72444]:         <nova:project uuid="929fd4a3127b475282426d4412e58def">tempest-ServerBootFromVolumeStableRescueTest-1082770125</nova:project>
Aug 03 04:45:37 user nova-compute[72444]:       </nova:owner>
Aug 03 04:45:37 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:45:37 user nova-compute[72444]:       <nova:ports>
Aug 03 04:45:37 user nova-compute[72444]:         <nova:port uuid="c14e16af-c17e-4152-a400-cbb8fb4f41fa">
Aug 03 04:45:37 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 03 04:45:37 user nova-compute[72444]:         </nova:port>
Aug 03 04:45:37 user nova-compute[72444]:       </nova:ports>
Aug 03 04:45:37 user nova-compute[72444]:     </nova:instance>
Aug 03 04:45:37 user nova-compute[72444]:   </metadata>
Aug 03 04:45:37 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:45:37 user nova-compute[72444]:     <system>
Aug 03 04:45:37 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:45:37 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:45:37 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:45:37 user nova-compute[72444]:       <entry name="serial">2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15</entry>
Aug 03 04:45:37 user nova-compute[72444]:       <entry name="uuid">2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15</entry>
Aug 03 04:45:37 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:45:37 user nova-compute[72444]:     </system>
Aug 03 04:45:37 user nova-compute[72444]:   </sysinfo>
Aug 03 04:45:37 user nova-compute[72444]:   <os>
Aug 03 04:45:37 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:45:37 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:45:37 user nova-compute[72444]:   </os>
Aug 03 04:45:37 user nova-compute[72444]:   <features>
Aug 03 04:45:37 user nova-compute[72444]:     <acpi/>
Aug 03 04:45:37 user nova-compute[72444]:     <apic/>
Aug 03 04:45:37 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:45:37 user nova-compute[72444]:   </features>
Aug 03 04:45:37 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:45:37 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:45:37 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:45:37 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:45:37 user nova-compute[72444]:   </clock>
Aug 03 04:45:37 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:45:37 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:45:37 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:45:37 user nova-compute[72444]:   </cpu>
Aug 03 04:45:37 user nova-compute[72444]:   <devices>
Aug 03 04:45:37 user nova-compute[72444]:     <disk type="block" device="disk">
Aug 03 04:45:37 user nova-compute[72444]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:45:37 user nova-compute[72444]:       <source dev="/dev/sdf"/>
Aug 03 04:45:37 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:45:37 user nova-compute[72444]:       <serial>fe332412-b62b-4f63-abe0-b743ff189828</serial>
Aug 03 04:45:37 user nova-compute[72444]:     </disk>
Aug 03 04:45:37 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:45:37 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:45:37 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15/disk.rescue"/>
Aug 03 04:45:37 user nova-compute[72444]:       <target dev="vdb" bus="virtio"/>
Aug 03 04:45:37 user nova-compute[72444]:       <boot order="1"/>
Aug 03 04:45:37 user nova-compute[72444]:     </disk>
Aug 03 04:45:37 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:45:37 user nova-compute[72444]:       <mac address="fa:16:3e:05:10:6a"/>
Aug 03 04:45:37 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:45:37 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:45:37 user nova-compute[72444]:       <target dev="tapc14e16af-c1"/>
Aug 03 04:45:37 user nova-compute[72444]:     </interface>
Aug 03 04:45:37 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:45:37 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15/console.log" append="off"/>
Aug 03 04:45:37 user nova-compute[72444]:     </serial>
Aug 03 04:45:37 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:45:37 user nova-compute[72444]:     <video>
Aug 03 04:45:37 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:45:37 user nova-compute[72444]:     </video>
Aug 03 04:45:37 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:45:37 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:45:37 user nova-compute[72444]:     </rng>
Aug 03 04:45:37 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:45:37 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:45:37 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:45:37 user nova-compute[72444]:     </memballoon>
Aug 03 04:45:37 user nova-compute[72444]:   </devices>
Aug 03 04:45:37 user nova-compute[72444]: </domain>
Aug 03 04:45:37 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:45:37 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Instance destroyed successfully.
Aug 03 04:45:37 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:45:37 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:45:37 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] No VIF found with MAC fa:16:3e:05:10:6a, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:45:37 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Removed pending event for 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 due to event {{(pid=72444) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 03 04:45:37 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037937.1780443, 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:45:37 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] VM Resumed (Lifecycle Event)
Aug 03 04:45:37 user nova-compute[72444]: DEBUG nova.compute.manager [None req-a77ff8bf-d6f8-413b-ab12-6b053866b44a tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:45:37 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:45:37 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:45:37 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 03 04:45:37 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037937.1790347, 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:45:37 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] VM Started (Lifecycle Event)
Aug 03 04:45:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:37 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:45:37 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:45:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:37 user nova-compute[72444]: DEBUG nova.compute.manager [req-afe80a67-27da-4cb7-b8b3-3599b86131e5 req-2d508c39-348a-44a2-b5d1-b2015473cae4 service nova] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Received event network-vif-plugged-5e00edc4-284f-4e60-b3f6-75ab3df268dc {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:45:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-afe80a67-27da-4cb7-b8b3-3599b86131e5 req-2d508c39-348a-44a2-b5d1-b2015473cae4 service nova] Acquiring lock "ba7bd541-c761-4e4a-ac7c-7dd2cb89150d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-afe80a67-27da-4cb7-b8b3-3599b86131e5 req-2d508c39-348a-44a2-b5d1-b2015473cae4 service nova] Lock "ba7bd541-c761-4e4a-ac7c-7dd2cb89150d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-afe80a67-27da-4cb7-b8b3-3599b86131e5 req-2d508c39-348a-44a2-b5d1-b2015473cae4 service nova] Lock "ba7bd541-c761-4e4a-ac7c-7dd2cb89150d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:37 user nova-compute[72444]: DEBUG nova.compute.manager [req-afe80a67-27da-4cb7-b8b3-3599b86131e5 req-2d508c39-348a-44a2-b5d1-b2015473cae4 service nova] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] No waiting events found dispatching network-vif-plugged-5e00edc4-284f-4e60-b3f6-75ab3df268dc {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:45:37 user nova-compute[72444]: WARNING nova.compute.manager [req-afe80a67-27da-4cb7-b8b3-3599b86131e5 req-2d508c39-348a-44a2-b5d1-b2015473cae4 service nova] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Received unexpected event network-vif-plugged-5e00edc4-284f-4e60-b3f6-75ab3df268dc for instance with vm_state active and task_state rebuild_spawning.
Aug 03 04:45:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:37 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:45:38 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:45:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:39 user nova-compute[72444]: DEBUG nova.compute.manager [req-7548790b-0e34-4de4-b9b0-59573cd12db0 req-3878939a-3bc3-432e-aff0-1443b0ce02a1 service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Received event network-vif-plugged-c14e16af-c17e-4152-a400-cbb8fb4f41fa {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:45:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7548790b-0e34-4de4-b9b0-59573cd12db0 req-3878939a-3bc3-432e-aff0-1443b0ce02a1 service nova] Acquiring lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7548790b-0e34-4de4-b9b0-59573cd12db0 req-3878939a-3bc3-432e-aff0-1443b0ce02a1 service nova] Lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7548790b-0e34-4de4-b9b0-59573cd12db0 req-3878939a-3bc3-432e-aff0-1443b0ce02a1 service nova] Lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:39 user nova-compute[72444]: DEBUG nova.compute.manager [req-7548790b-0e34-4de4-b9b0-59573cd12db0 req-3878939a-3bc3-432e-aff0-1443b0ce02a1 service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] No waiting events found dispatching network-vif-plugged-c14e16af-c17e-4152-a400-cbb8fb4f41fa {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:45:39 user nova-compute[72444]: WARNING nova.compute.manager [req-7548790b-0e34-4de4-b9b0-59573cd12db0 req-3878939a-3bc3-432e-aff0-1443b0ce02a1 service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Received unexpected event network-vif-plugged-c14e16af-c17e-4152-a400-cbb8fb4f41fa for instance with vm_state active and task_state rescuing.
Aug 03 04:45:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:39 user nova-compute[72444]: DEBUG nova.compute.manager [req-3727fc1d-ef50-473e-83ae-92645aa91d6b req-79951dcd-409e-4301-ad90-1595b930d4cb service nova] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Received event network-vif-plugged-5e00edc4-284f-4e60-b3f6-75ab3df268dc {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:45:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3727fc1d-ef50-473e-83ae-92645aa91d6b req-79951dcd-409e-4301-ad90-1595b930d4cb service nova] Acquiring lock "ba7bd541-c761-4e4a-ac7c-7dd2cb89150d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3727fc1d-ef50-473e-83ae-92645aa91d6b req-79951dcd-409e-4301-ad90-1595b930d4cb service nova] Lock "ba7bd541-c761-4e4a-ac7c-7dd2cb89150d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3727fc1d-ef50-473e-83ae-92645aa91d6b req-79951dcd-409e-4301-ad90-1595b930d4cb service nova] Lock "ba7bd541-c761-4e4a-ac7c-7dd2cb89150d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:39 user nova-compute[72444]: DEBUG nova.compute.manager [req-3727fc1d-ef50-473e-83ae-92645aa91d6b req-79951dcd-409e-4301-ad90-1595b930d4cb service nova] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] No waiting events found dispatching network-vif-plugged-5e00edc4-284f-4e60-b3f6-75ab3df268dc {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:45:39 user nova-compute[72444]: WARNING nova.compute.manager [req-3727fc1d-ef50-473e-83ae-92645aa91d6b req-79951dcd-409e-4301-ad90-1595b930d4cb service nova] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Received unexpected event network-vif-plugged-5e00edc4-284f-4e60-b3f6-75ab3df268dc for instance with vm_state active and task_state rebuild_spawning.
Aug 03 04:45:40 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:45:41 user nova-compute[72444]: DEBUG nova.compute.manager [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:45:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 04:45:41 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037941.155871, ba7bd541-c761-4e4a-ac7c-7dd2cb89150d => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:45:41 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] VM Resumed (Lifecycle Event)
Aug 03 04:45:41 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Instance spawned successfully.
Aug 03 04:45:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 04:45:41 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:45:41 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:45:41 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 03 04:45:41 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037941.156876, ba7bd541-c761-4e4a-ac7c-7dd2cb89150d => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:45:41 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] VM Started (Lifecycle Event)
Aug 03 04:45:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:45:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:45:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:45:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:45:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:45:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:45:41 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:45:41 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:45:41 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 03 04:45:41 user nova-compute[72444]: DEBUG nova.compute.manager [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:45:41 user nova-compute[72444]: DEBUG nova.compute.manager [req-46f3d144-7d20-41c5-9968-c3fdba4d08b1 req-9024cfb7-0d75-43d7-83e5-f0f4a74cad4b service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Received event network-vif-plugged-c14e16af-c17e-4152-a400-cbb8fb4f41fa {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:45:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-46f3d144-7d20-41c5-9968-c3fdba4d08b1 req-9024cfb7-0d75-43d7-83e5-f0f4a74cad4b service nova] Acquiring lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-46f3d144-7d20-41c5-9968-c3fdba4d08b1 req-9024cfb7-0d75-43d7-83e5-f0f4a74cad4b service nova] Lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-46f3d144-7d20-41c5-9968-c3fdba4d08b1 req-9024cfb7-0d75-43d7-83e5-f0f4a74cad4b service nova] Lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:41 user nova-compute[72444]: DEBUG nova.compute.manager [req-46f3d144-7d20-41c5-9968-c3fdba4d08b1 req-9024cfb7-0d75-43d7-83e5-f0f4a74cad4b service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] No waiting events found dispatching network-vif-plugged-c14e16af-c17e-4152-a400-cbb8fb4f41fa {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:45:41 user nova-compute[72444]: WARNING nova.compute.manager [req-46f3d144-7d20-41c5-9968-c3fdba4d08b1 req-9024cfb7-0d75-43d7-83e5-f0f4a74cad4b service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Received unexpected event network-vif-plugged-c14e16af-c17e-4152-a400-cbb8fb4f41fa for instance with vm_state active and task_state rescuing.
Aug 03 04:45:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:41 user nova-compute[72444]: DEBUG nova.objects.instance [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72444) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 03 04:45:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-551f2a36-cd68-4e5f-a98a-17f3ee440759 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.099s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Removed pending event for 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15 due to event {{(pid=72444) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 03 04:45:41 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037941.864273, 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:45:41 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] VM Resumed (Lifecycle Event)
Aug 03 04:45:41 user nova-compute[72444]: DEBUG nova.compute.manager [None req-91c313f8-5dfe-4b0e-8eeb-d343adddbfed tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:45:41 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:45:41 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:45:41 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:45:41 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:45:41 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 04:45:41 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:45:41 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 03 04:45:41 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691037941.8752558, 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:45:41 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] VM Started (Lifecycle Event)
Aug 03 04:45:41 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:45:41 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:45:42 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:45:42 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:45:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:42 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 04:45:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:45:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk.rescue --force-share --output=json" returned: 0 in 0.165s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:44 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:44 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:44 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:45:44 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:45:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26922d3f-0a2d-48d1-b758-9c87e0621fef/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26922d3f-0a2d-48d1-b758-9c87e0621fef/disk --force-share --output=json" returned: 0 in 0.336s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26922d3f-0a2d-48d1-b758-9c87e0621fef/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26922d3f-0a2d-48d1-b758-9c87e0621fef/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07450ea8-cb80-4318-9fc9-4268944d2cae/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07450ea8-cb80-4318-9fc9-4268944d2cae/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07450ea8-cb80-4318-9fc9-4268944d2cae/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07450ea8-cb80-4318-9fc9-4268944d2cae/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:45:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f1a45af-977b-43e2-a7dd-7a9c402840d1/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f1a45af-977b-43e2-a7dd-7a9c402840d1/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f1a45af-977b-43e2-a7dd-7a9c402840d1/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f1a45af-977b-43e2-a7dd-7a9c402840d1/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbaa8179-1294-41ec-88cd-e23a568c5468/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbaa8179-1294-41ec-88cd-e23a568c5468/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbaa8179-1294-41ec-88cd-e23a568c5468/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:45:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbaa8179-1294-41ec-88cd-e23a568c5468/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:45:48 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:45:48 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:45:48 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=7236MB free_disk=25.641220092773438GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 04:45:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:45:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:45:48 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:45:48 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 81725845-6158-4e34-bedb-6e41219bc227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:45:48 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance b6ed9c42-fa6e-4a0d-8312-588471e157f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:45:48 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance e3089887-56df-42de-bc62-88e6db28daf0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:45:48 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance e2859322-6f99-442d-bee1-65fe49ce6360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:45:48 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 07450ea8-cb80-4318-9fc9-4268944d2cae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:45:48 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:45:48 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance ba7bd541-c761-4e4a-ac7c-7dd2cb89150d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:45:48 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:45:48 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 6f1a45af-977b-43e2-a7dd-7a9c402840d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:45:48 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 26922d3f-0a2d-48d1-b758-9c87e0621fef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:45:48 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance fbaa8179-1294-41ec-88cd-e23a568c5468 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:45:48 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 04:45:48 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 04:45:48 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:45:48 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:45:48 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 04:45:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.598s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:45:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:52 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:45:52 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 04:45:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-e2859322-6f99-442d-bee1-65fe49ce6360" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:45:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-e2859322-6f99-442d-bee1-65fe49ce6360" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:45:53 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 04:45:53 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Updating instance_info_cache with network_info: [{"id": "269c2e0d-94ee-4084-985a-58c5afed4411", "address": "fa:16:3e:bd:11:20", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap269c2e0d-94", "ovs_interfaceid": "269c2e0d-94ee-4084-985a-58c5afed4411", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:45:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-e2859322-6f99-442d-bee1-65fe49ce6360" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:45:53 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 04:45:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:45:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:11 user nova-compute[72444]: DEBUG nova.compute.manager [req-ceba29ff-08f8-4930-8b71-d2dd7bb5bae1 req-2d85db57-5e16-4b52-9589-f13b06a7fb21 service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Received event network-changed-5119da23-2d00-4603-ba9f-a9d0c35bf261 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:46:11 user nova-compute[72444]: DEBUG nova.compute.manager [req-ceba29ff-08f8-4930-8b71-d2dd7bb5bae1 req-2d85db57-5e16-4b52-9589-f13b06a7fb21 service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Refreshing instance network info cache due to event network-changed-5119da23-2d00-4603-ba9f-a9d0c35bf261. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:46:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ceba29ff-08f8-4930-8b71-d2dd7bb5bae1 req-2d85db57-5e16-4b52-9589-f13b06a7fb21 service nova] Acquiring lock "refresh_cache-6f1a45af-977b-43e2-a7dd-7a9c402840d1" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:46:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ceba29ff-08f8-4930-8b71-d2dd7bb5bae1 req-2d85db57-5e16-4b52-9589-f13b06a7fb21 service nova] Acquired lock "refresh_cache-6f1a45af-977b-43e2-a7dd-7a9c402840d1" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:46:11 user nova-compute[72444]: DEBUG nova.network.neutron [req-ceba29ff-08f8-4930-8b71-d2dd7bb5bae1 req-2d85db57-5e16-4b52-9589-f13b06a7fb21 service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Refreshing network info cache for port 5119da23-2d00-4603-ba9f-a9d0c35bf261 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:46:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-27a46ba0-5780-4423-8dd4-f89f1e1b8ef8 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Acquiring lock "interface-6f1a45af-977b-43e2-a7dd-7a9c402840d1-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:46:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-27a46ba0-5780-4423-8dd4-f89f1e1b8ef8 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lock "interface-6f1a45af-977b-43e2-a7dd-7a9c402840d1-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:46:11 user nova-compute[72444]: DEBUG nova.objects.instance [None req-27a46ba0-5780-4423-8dd4-f89f1e1b8ef8 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lazy-loading 'flavor' on Instance uuid 6f1a45af-977b-43e2-a7dd-7a9c402840d1 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:46:11 user nova-compute[72444]: DEBUG nova.objects.instance [None req-27a46ba0-5780-4423-8dd4-f89f1e1b8ef8 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lazy-loading 'pci_requests' on Instance uuid 6f1a45af-977b-43e2-a7dd-7a9c402840d1 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:46:11 user nova-compute[72444]: DEBUG nova.network.neutron [None req-27a46ba0-5780-4423-8dd4-f89f1e1b8ef8 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 04:46:11 user nova-compute[72444]: DEBUG nova.policy [None req-27a46ba0-5780-4423-8dd4-f89f1e1b8ef8 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0bdf7a13912407ea16fd1999be5ede0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dee6e42044847209f1357b13d6d126a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 04:46:12 user nova-compute[72444]: DEBUG nova.network.neutron [req-ceba29ff-08f8-4930-8b71-d2dd7bb5bae1 req-2d85db57-5e16-4b52-9589-f13b06a7fb21 service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Updated VIF entry in instance network info cache for port 5119da23-2d00-4603-ba9f-a9d0c35bf261. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:46:12 user nova-compute[72444]: DEBUG nova.network.neutron [req-ceba29ff-08f8-4930-8b71-d2dd7bb5bae1 req-2d85db57-5e16-4b52-9589-f13b06a7fb21 service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Updating instance_info_cache with network_info: [{"id": "5119da23-2d00-4603-ba9f-a9d0c35bf261", "address": "fa:16:3e:b0:20:5c", "network": {"id": "609944ea-0d2a-43ad-9d2b-f06d1c67d9de", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1126534592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1dee6e42044847209f1357b13d6d126a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5119da23-2d", "ovs_interfaceid": "5119da23-2d00-4603-ba9f-a9d0c35bf261", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:46:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ceba29ff-08f8-4930-8b71-d2dd7bb5bae1 req-2d85db57-5e16-4b52-9589-f13b06a7fb21 service nova] Releasing lock "refresh_cache-6f1a45af-977b-43e2-a7dd-7a9c402840d1" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:46:12 user nova-compute[72444]: DEBUG nova.network.neutron [None req-27a46ba0-5780-4423-8dd4-f89f1e1b8ef8 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Successfully created port: d80e3248-9a8c-480d-b27a-a9f3abc7ce17 {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:46:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:13 user nova-compute[72444]: DEBUG nova.network.neutron [None req-27a46ba0-5780-4423-8dd4-f89f1e1b8ef8 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Successfully updated port: d80e3248-9a8c-480d-b27a-a9f3abc7ce17 {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:46:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-27a46ba0-5780-4423-8dd4-f89f1e1b8ef8 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Acquiring lock "refresh_cache-6f1a45af-977b-43e2-a7dd-7a9c402840d1" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:46:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-27a46ba0-5780-4423-8dd4-f89f1e1b8ef8 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Acquired lock "refresh_cache-6f1a45af-977b-43e2-a7dd-7a9c402840d1" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:46:13 user nova-compute[72444]: DEBUG nova.network.neutron [None req-27a46ba0-5780-4423-8dd4-f89f1e1b8ef8 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:46:13 user nova-compute[72444]: DEBUG nova.compute.manager [req-67beebe2-291f-4040-b801-e68d888de743 req-c318df90-7519-407d-90ee-6b9ae0ef3fc7 service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Received event network-changed-d80e3248-9a8c-480d-b27a-a9f3abc7ce17 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:46:13 user nova-compute[72444]: DEBUG nova.compute.manager [req-67beebe2-291f-4040-b801-e68d888de743 req-c318df90-7519-407d-90ee-6b9ae0ef3fc7 service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Refreshing instance network info cache due to event network-changed-d80e3248-9a8c-480d-b27a-a9f3abc7ce17. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:46:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-67beebe2-291f-4040-b801-e68d888de743 req-c318df90-7519-407d-90ee-6b9ae0ef3fc7 service nova] Acquiring lock "refresh_cache-6f1a45af-977b-43e2-a7dd-7a9c402840d1" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:46:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:14 user nova-compute[72444]: DEBUG nova.network.neutron [None req-27a46ba0-5780-4423-8dd4-f89f1e1b8ef8 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Updating instance_info_cache with network_info: [{"id": "5119da23-2d00-4603-ba9f-a9d0c35bf261", "address": "fa:16:3e:b0:20:5c", "network": {"id": "609944ea-0d2a-43ad-9d2b-f06d1c67d9de", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1126534592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1dee6e42044847209f1357b13d6d126a", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5119da23-2d", "ovs_interfaceid": "5119da23-2d00-4603-ba9f-a9d0c35bf261", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d80e3248-9a8c-480d-b27a-a9f3abc7ce17", "address": "fa:16:3e:e7:1a:24", "network": {"id": "260cc6dc-9521-4d49-bf50-a409bb7f2ce4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-256124424", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1dee6e42044847209f1357b13d6d126a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd80e3248-9a", "ovs_interfaceid": "d80e3248-9a8c-480d-b27a-a9f3abc7ce17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:46:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-27a46ba0-5780-4423-8dd4-f89f1e1b8ef8 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Releasing lock "refresh_cache-6f1a45af-977b-43e2-a7dd-7a9c402840d1" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:46:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-67beebe2-291f-4040-b801-e68d888de743 req-c318df90-7519-407d-90ee-6b9ae0ef3fc7 service nova] Acquired lock "refresh_cache-6f1a45af-977b-43e2-a7dd-7a9c402840d1" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:46:14 user nova-compute[72444]: DEBUG nova.network.neutron [req-67beebe2-291f-4040-b801-e68d888de743 req-c318df90-7519-407d-90ee-6b9ae0ef3fc7 service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Refreshing network info cache for port d80e3248-9a8c-480d-b27a-a9f3abc7ce17 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:46:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-27a46ba0-5780-4423-8dd4-f89f1e1b8ef8 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:44:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1468224080',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1468224080',id=16,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaZFwRNEZpiQfGHLwHZY0lzzbAVIRwXRC0MqbLmO16AzRtkc1PNUMZriWOCxZ3hf+0jC1htGoMbWFCsoXZ1AlanFdwAoHBAD6We6zi7g38fpOwMHB+xi90mEeGWehYqlA==',key_name='tempest-keypair-1754610092',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:44:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1dee6e42044847209f1357b13d6d126a',ramdisk_id='',reservation_id='r-qunvoqox',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1101837971',owner_user_name='tempest-TaggedAttachmentsTest-1101837971-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:44:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0bdf7a13912407ea16fd1999be5ede0',uuid=6f1a45af-977b-43e2-a7dd-7a9c402840d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d80e3248-9a8c-480d-b27a-a9f3abc7ce17", "address": "fa:16:3e:e7:1a:24", "network": {"id": "260cc6dc-9521-4d49-bf50-a409bb7f2ce4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-256124424", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1dee6e42044847209f1357b13d6d126a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd80e3248-9a", "ovs_interfaceid": "d80e3248-9a8c-480d-b27a-a9f3abc7ce17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:46:14 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-27a46ba0-5780-4423-8dd4-f89f1e1b8ef8 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Converting VIF {"id": "d80e3248-9a8c-480d-b27a-a9f3abc7ce17", "address": "fa:16:3e:e7:1a:24", "network": {"id": "260cc6dc-9521-4d49-bf50-a409bb7f2ce4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-256124424", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1dee6e42044847209f1357b13d6d126a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd80e3248-9a", "ovs_interfaceid": "d80e3248-9a8c-480d-b27a-a9f3abc7ce17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:46:14 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-27a46ba0-5780-4423-8dd4-f89f1e1b8ef8 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:1a:24,bridge_name='br-int',has_traffic_filtering=True,id=d80e3248-9a8c-480d-b27a-a9f3abc7ce17,network=Network(260cc6dc-9521-4d49-bf50-a409bb7f2ce4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd80e3248-9a') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:46:14 user nova-compute[72444]: DEBUG os_vif [None req-27a46ba0-5780-4423-8dd4-f89f1e1b8ef8 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:1a:24,bridge_name='br-int',has_traffic_filtering=True,id=d80e3248-9a8c-480d-b27a-a9f3abc7ce17,network=Network(260cc6dc-9521-4d49-bf50-a409bb7f2ce4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd80e3248-9a') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:46:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:46:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:46:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd80e3248-9a, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:46:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd80e3248-9a, col_values=(('external_ids', {'iface-id': 'd80e3248-9a8c-480d-b27a-a9f3abc7ce17', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:1a:24', 'vm-uuid': '6f1a45af-977b-43e2-a7dd-7a9c402840d1'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:46:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:46:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:14 user nova-compute[72444]: INFO os_vif [None req-27a46ba0-5780-4423-8dd4-f89f1e1b8ef8 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:1a:24,bridge_name='br-int',has_traffic_filtering=True,id=d80e3248-9a8c-480d-b27a-a9f3abc7ce17,network=Network(260cc6dc-9521-4d49-bf50-a409bb7f2ce4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd80e3248-9a')
Aug 03 04:46:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-27a46ba0-5780-4423-8dd4-f89f1e1b8ef8 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:44:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1468224080',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1468224080',id=16,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaZFwRNEZpiQfGHLwHZY0lzzbAVIRwXRC0MqbLmO16AzRtkc1PNUMZriWOCxZ3hf+0jC1htGoMbWFCsoXZ1AlanFdwAoHBAD6We6zi7g38fpOwMHB+xi90mEeGWehYqlA==',key_name='tempest-keypair-1754610092',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:44:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1dee6e42044847209f1357b13d6d126a',ramdisk_id='',reservation_id='r-qunvoqox',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1101837971',owner_user_name='tempest-TaggedAttachmentsTest-1101837971-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:44:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0bdf7a13912407ea16fd1999be5ede0',uuid=6f1a45af-977b-43e2-a7dd-7a9c402840d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d80e3248-9a8c-480d-b27a-a9f3abc7ce17", "address": "fa:16:3e:e7:1a:24", "network": {"id": "260cc6dc-9521-4d49-bf50-a409bb7f2ce4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-256124424", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1dee6e42044847209f1357b13d6d126a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd80e3248-9a", "ovs_interfaceid": "d80e3248-9a8c-480d-b27a-a9f3abc7ce17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:46:14 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-27a46ba0-5780-4423-8dd4-f89f1e1b8ef8 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Converting VIF {"id": "d80e3248-9a8c-480d-b27a-a9f3abc7ce17", "address": "fa:16:3e:e7:1a:24", "network": {"id": "260cc6dc-9521-4d49-bf50-a409bb7f2ce4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-256124424", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1dee6e42044847209f1357b13d6d126a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd80e3248-9a", "ovs_interfaceid": "d80e3248-9a8c-480d-b27a-a9f3abc7ce17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:46:14 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-27a46ba0-5780-4423-8dd4-f89f1e1b8ef8 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:1a:24,bridge_name='br-int',has_traffic_filtering=True,id=d80e3248-9a8c-480d-b27a-a9f3abc7ce17,network=Network(260cc6dc-9521-4d49-bf50-a409bb7f2ce4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd80e3248-9a') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:46:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-27a46ba0-5780-4423-8dd4-f89f1e1b8ef8 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] attach device xml: <interface type="ethernet">
Aug 03 04:46:14 user nova-compute[72444]:   <mac address="fa:16:3e:e7:1a:24"/>
Aug 03 04:46:14 user nova-compute[72444]:   <model type="virtio"/>
Aug 03 04:46:14 user nova-compute[72444]:   <mtu size="1442"/>
Aug 03 04:46:14 user nova-compute[72444]:   <target dev="tapd80e3248-9a"/>
Aug 03 04:46:14 user nova-compute[72444]: </interface>
Aug 03 04:46:14 user nova-compute[72444]:  {{(pid=72444) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 04:46:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-27a46ba0-5780-4423-8dd4-f89f1e1b8ef8 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:46:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-27a46ba0-5780-4423-8dd4-f89f1e1b8ef8 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] No BDM found with device name hda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:46:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-27a46ba0-5780-4423-8dd4-f89f1e1b8ef8 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] No VIF found with MAC fa:16:3e:b0:20:5c, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:46:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-27a46ba0-5780-4423-8dd4-f89f1e1b8ef8 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:46:14 user nova-compute[72444]:   <nova:package version="0.0.0"/>
Aug 03 04:46:14 user nova-compute[72444]:   <nova:name>tempest-device-tagging-server-1468224080</nova:name>
Aug 03 04:46:14 user nova-compute[72444]:   <nova:creationTime>2023-08-03 04:46:14</nova:creationTime>
Aug 03 04:46:14 user nova-compute[72444]:   <nova:flavor name="m1.tiny">
Aug 03 04:46:14 user nova-compute[72444]:     <nova:memory>512</nova:memory>
Aug 03 04:46:14 user nova-compute[72444]:     <nova:disk>1</nova:disk>
Aug 03 04:46:14 user nova-compute[72444]:     <nova:swap>0</nova:swap>
Aug 03 04:46:14 user nova-compute[72444]:     <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:46:14 user nova-compute[72444]:     <nova:vcpus>1</nova:vcpus>
Aug 03 04:46:14 user nova-compute[72444]:   </nova:flavor>
Aug 03 04:46:14 user nova-compute[72444]:   <nova:owner>
Aug 03 04:46:14 user nova-compute[72444]:     <nova:user uuid="c0bdf7a13912407ea16fd1999be5ede0">tempest-TaggedAttachmentsTest-1101837971-project-member</nova:user>
Aug 03 04:46:14 user nova-compute[72444]:     <nova:project uuid="1dee6e42044847209f1357b13d6d126a">tempest-TaggedAttachmentsTest-1101837971</nova:project>
Aug 03 04:46:14 user nova-compute[72444]:   </nova:owner>
Aug 03 04:46:14 user nova-compute[72444]:   <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:46:14 user nova-compute[72444]:   <nova:ports>
Aug 03 04:46:14 user nova-compute[72444]:     <nova:port uuid="5119da23-2d00-4603-ba9f-a9d0c35bf261">
Aug 03 04:46:14 user nova-compute[72444]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 03 04:46:14 user nova-compute[72444]:     </nova:port>
Aug 03 04:46:14 user nova-compute[72444]:     <nova:port uuid="d80e3248-9a8c-480d-b27a-a9f3abc7ce17">
Aug 03 04:46:14 user nova-compute[72444]:       <nova:ip type="fixed" address="10.10.10.56" ipVersion="4"/>
Aug 03 04:46:14 user nova-compute[72444]:     </nova:port>
Aug 03 04:46:14 user nova-compute[72444]:   </nova:ports>
Aug 03 04:46:14 user nova-compute[72444]: </nova:instance>
Aug 03 04:46:14 user nova-compute[72444]:  {{(pid=72444) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 03 04:46:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-27a46ba0-5780-4423-8dd4-f89f1e1b8ef8 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lock "interface-6f1a45af-977b-43e2-a7dd-7a9c402840d1-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.249s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:46:14 user nova-compute[72444]: DEBUG nova.network.neutron [req-67beebe2-291f-4040-b801-e68d888de743 req-c318df90-7519-407d-90ee-6b9ae0ef3fc7 service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Updated VIF entry in instance network info cache for port d80e3248-9a8c-480d-b27a-a9f3abc7ce17. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:46:14 user nova-compute[72444]: DEBUG nova.network.neutron [req-67beebe2-291f-4040-b801-e68d888de743 req-c318df90-7519-407d-90ee-6b9ae0ef3fc7 service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Updating instance_info_cache with network_info: [{"id": "5119da23-2d00-4603-ba9f-a9d0c35bf261", "address": "fa:16:3e:b0:20:5c", "network": {"id": "609944ea-0d2a-43ad-9d2b-f06d1c67d9de", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1126534592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1dee6e42044847209f1357b13d6d126a", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5119da23-2d", "ovs_interfaceid": "5119da23-2d00-4603-ba9f-a9d0c35bf261", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d80e3248-9a8c-480d-b27a-a9f3abc7ce17", "address": "fa:16:3e:e7:1a:24", "network": {"id": "260cc6dc-9521-4d49-bf50-a409bb7f2ce4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-256124424", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1dee6e42044847209f1357b13d6d126a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd80e3248-9a", "ovs_interfaceid": "d80e3248-9a8c-480d-b27a-a9f3abc7ce17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:46:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-67beebe2-291f-4040-b801-e68d888de743 req-c318df90-7519-407d-90ee-6b9ae0ef3fc7 service nova] Releasing lock "refresh_cache-6f1a45af-977b-43e2-a7dd-7a9c402840d1" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:46:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Acquiring lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:46:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:46:15 user nova-compute[72444]: DEBUG nova.objects.instance [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lazy-loading 'flavor' on Instance uuid 6f1a45af-977b-43e2-a7dd-7a9c402840d1 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:46:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:46:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Acquiring lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:46:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:46:15 user nova-compute[72444]: INFO nova.compute.manager [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Attaching volume 2eb15df7-2ce6-4ff6-b59e-1e3560942c27 to /dev/vdb
Aug 03 04:46:15 user nova-compute[72444]: DEBUG os_brick.utils [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:46:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:15 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b5d956-8a92-47df-84d3-1db9bb189a66]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:15 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac08a56-3de3-4ed5-b9de-08fd97dcec94]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:15 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c52b23c-9476-41e2-a62e-904bf243c3b0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:15 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[759d88f0-2b31-4d93-bde9-30e2e5dd5e77]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:46:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 04:46:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:46:15 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 04:46:15 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6215eeca-412a-4514-92b8-70ef76875d06]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 04:46:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 04:46:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 04:46:15 user nova-compute[72444]: DEBUG os_brick.utils [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:46:15 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Updating existing volume attachment record: 4c04a855-013d-4e28-ab20-e327989ceeb5 {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 04:46:15 user nova-compute[72444]: DEBUG nova.compute.manager [req-787d00eb-204b-4adb-8708-c89786b961df req-2c1ce545-8582-4129-9be0-c5ea41ccec5d service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Received event network-vif-plugged-d80e3248-9a8c-480d-b27a-a9f3abc7ce17 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:46:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-787d00eb-204b-4adb-8708-c89786b961df req-2c1ce545-8582-4129-9be0-c5ea41ccec5d service nova] Acquiring lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:46:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-787d00eb-204b-4adb-8708-c89786b961df req-2c1ce545-8582-4129-9be0-c5ea41ccec5d service nova] Lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:46:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-787d00eb-204b-4adb-8708-c89786b961df req-2c1ce545-8582-4129-9be0-c5ea41ccec5d service nova] Lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:46:15 user nova-compute[72444]: DEBUG nova.compute.manager [req-787d00eb-204b-4adb-8708-c89786b961df req-2c1ce545-8582-4129-9be0-c5ea41ccec5d service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] No waiting events found dispatching network-vif-plugged-d80e3248-9a8c-480d-b27a-a9f3abc7ce17 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:46:15 user nova-compute[72444]: WARNING nova.compute.manager [req-787d00eb-204b-4adb-8708-c89786b961df req-2c1ce545-8582-4129-9be0-c5ea41ccec5d service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Received unexpected event network-vif-plugged-d80e3248-9a8c-480d-b27a-a9f3abc7ce17 for instance with vm_state active and task_state None.
Aug 03 04:46:15 user nova-compute[72444]: DEBUG nova.compute.manager [req-787d00eb-204b-4adb-8708-c89786b961df req-2c1ce545-8582-4129-9be0-c5ea41ccec5d service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Received event network-vif-plugged-d80e3248-9a8c-480d-b27a-a9f3abc7ce17 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:46:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-787d00eb-204b-4adb-8708-c89786b961df req-2c1ce545-8582-4129-9be0-c5ea41ccec5d service nova] Acquiring lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:46:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-787d00eb-204b-4adb-8708-c89786b961df req-2c1ce545-8582-4129-9be0-c5ea41ccec5d service nova] Lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:46:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-787d00eb-204b-4adb-8708-c89786b961df req-2c1ce545-8582-4129-9be0-c5ea41ccec5d service nova] Lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:46:15 user nova-compute[72444]: DEBUG nova.compute.manager [req-787d00eb-204b-4adb-8708-c89786b961df req-2c1ce545-8582-4129-9be0-c5ea41ccec5d service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] No waiting events found dispatching network-vif-plugged-d80e3248-9a8c-480d-b27a-a9f3abc7ce17 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:46:15 user nova-compute[72444]: WARNING nova.compute.manager [req-787d00eb-204b-4adb-8708-c89786b961df req-2c1ce545-8582-4129-9be0-c5ea41ccec5d service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Received unexpected event network-vif-plugged-d80e3248-9a8c-480d-b27a-a9f3abc7ce17 for instance with vm_state active and task_state None.
Aug 03 04:46:17 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:19 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:19 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VZilSvJy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:46:25 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:46:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:46:25 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:46:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:46:25 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:46:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b915389b-952e-47dc-9044-01814a392ebe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 04:46:25 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27 -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5275071-83a0-47bb-96b0-fef959d5ab8e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27] added
Aug 03 04:46:25 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c674f5f2-3de2-4db0-8c4a-b93337671e7a]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0b5913-d81c-453d-ad10-b0b5ea7ccf74]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VZilSvJy {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VZilSvJy" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e42dea5-58bd-4399-a838-83af617f78b7]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VZilSvJy'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[497ef917-2d6e-4e4c-8690-363778f95787]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc47d3c-1267-4b5d-a65f-8d3ed93639e5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:46:25 user nova-compute[72444]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)
Aug 03 04:46:25 user nova-compute[72444]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:46:25 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:46:25 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:46:25 user nova-compute[72444]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)
Aug 03 04:46:25 user nova-compute[72444]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:46:25 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:46:25 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27 -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[910e3259-c6b5-44f8-9747-49b3f86ce51b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27, portal: 172.16.0.220,3260]
Aug 03 04:46:25 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27, portal: 172.16.0.220,3260] successful.
Aug 03 04:46:25 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6758fb92-c2cc-4580-97d9-2a7fe5b754a0]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc409c0-4c60-49a9-840e-eb2f335d6cd2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:46:25 user nova-compute[72444]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)
Aug 03 04:46:25 user nova-compute[72444]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:46:25 user nova-compute[72444]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27 (non-flash)
Aug 03 04:46:25 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:46:25 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:46:25 user nova-compute[72444]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)
Aug 03 04:46:25 user nova-compute[72444]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:46:25 user nova-compute[72444]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27 (non-flash)
Aug 03 04:46:25 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:46:25 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] HCTL ('36', '-', '-', 0) found on session 15 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[333baca4-12ac-4c37-ad37-e6efb2918e8a]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Searching for a device in session 15 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:46:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VZilSvJy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:46:26 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:46:26 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23237343164303535', 'path': '/dev/sde'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:46:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237343164303535', 'path': '/dev/sde'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:46:26 user nova-compute[72444]: DEBUG nova.objects.instance [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lazy-loading 'flavor' on Instance uuid 6f1a45af-977b-43e2-a7dd-7a9c402840d1 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:46:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 04:46:26 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:46:26 user nova-compute[72444]:   <source dev="/dev/sde"/>
Aug 03 04:46:26 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:46:26 user nova-compute[72444]:   <serial>2eb15df7-2ce6-4ff6-b59e-1e3560942c27</serial>
Aug 03 04:46:26 user nova-compute[72444]: </disk>
Aug 03 04:46:26 user nova-compute[72444]:  {{(pid=72444) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 04:46:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:46:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] No BDM found with device name hda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:46:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] No VIF found with MAC fa:16:3e:b0:20:5c, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:46:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-fee69f47-9add-4959-99c9-8611105fbce5 tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.109s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:46:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-01ede7aa-9c32-465a-8f23-f1dede6f741e tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Acquiring lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:46:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-01ede7aa-9c32-465a-8f23-f1dede6f741e tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:46:28 user nova-compute[72444]: INFO nova.compute.manager [None req-01ede7aa-9c32-465a-8f23-f1dede6f741e tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Detaching volume 2eb15df7-2ce6-4ff6-b59e-1e3560942c27
Aug 03 04:46:29 user nova-compute[72444]: INFO nova.virt.block_device [None req-01ede7aa-9c32-465a-8f23-f1dede6f741e tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Attempting to driver detach volume 2eb15df7-2ce6-4ff6-b59e-1e3560942c27 from mountpoint /dev/vdb
Aug 03 04:46:29 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-01ede7aa-9c32-465a-8f23-f1dede6f741e tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Attempting to detach device vdb from instance 6f1a45af-977b-43e2-a7dd-7a9c402840d1 from the persistent domain config. {{(pid=72444) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-01ede7aa-9c32-465a-8f23-f1dede6f741e tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 04:46:29 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:46:29 user nova-compute[72444]:   <source dev="/dev/sde"/>
Aug 03 04:46:29 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:46:29 user nova-compute[72444]:   <serial>2eb15df7-2ce6-4ff6-b59e-1e3560942c27</serial>
Aug 03 04:46:29 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 03 04:46:29 user nova-compute[72444]: </disk>
Aug 03 04:46:29 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:46:29 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-01ede7aa-9c32-465a-8f23-f1dede6f741e tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Successfully detached device vdb from instance 6f1a45af-977b-43e2-a7dd-7a9c402840d1 from the persistent domain config.
Aug 03 04:46:29 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-01ede7aa-9c32-465a-8f23-f1dede6f741e tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6f1a45af-977b-43e2-a7dd-7a9c402840d1 from the live domain config. {{(pid=72444) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-01ede7aa-9c32-465a-8f23-f1dede6f741e tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 04:46:29 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:46:29 user nova-compute[72444]:   <source dev="/dev/sde"/>
Aug 03 04:46:29 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:46:29 user nova-compute[72444]:   <serial>2eb15df7-2ce6-4ff6-b59e-1e3560942c27</serial>
Aug 03 04:46:29 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 03 04:46:29 user nova-compute[72444]: </disk>
Aug 03 04:46:29 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Received event <DeviceRemovedEvent: 1691037989.5164204, 6f1a45af-977b-43e2-a7dd-7a9c402840d1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72444) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-01ede7aa-9c32-465a-8f23-f1dede6f741e tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6f1a45af-977b-43e2-a7dd-7a9c402840d1 {{(pid=72444) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 04:46:29 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-01ede7aa-9c32-465a-8f23-f1dede6f741e tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Successfully detached device vdb from instance 6f1a45af-977b-43e2-a7dd-7a9c402840d1 from the live domain config.
Aug 03 04:46:29 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01ede7aa-9c32-465a-8f23-f1dede6f741e tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ede7aa-9c32-465a-8f23-f1dede6f741e tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VZilSvJy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:46:29 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-01ede7aa-9c32-465a-8f23-f1dede6f741e tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:46:29 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-01ede7aa-9c32-465a-8f23-f1dede6f741e tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-01ede7aa-9c32-465a-8f23-f1dede6f741e tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ede7aa-9c32-465a-8f23-f1dede6f741e tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[499249e4-dc84-4448-bf93-5b3f4bc70d7f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e17b1f6-e718-486a-a9be-dd2448f98b96]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ede7aa-9c32-465a-8f23-f1dede6f741e tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:46:29 user nova-compute[72444]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)
Aug 03 04:46:29 user nova-compute[72444]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:46:29 user nova-compute[72444]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27 (non-flash)
Aug 03 04:46:29 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:46:29 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ede7aa-9c32-465a-8f23-f1dede6f741e tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:46:29 user nova-compute[72444]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)
Aug 03 04:46:29 user nova-compute[72444]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:46:29 user nova-compute[72444]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27 (non-flash)
Aug 03 04:46:29 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:46:29 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ede7aa-9c32-465a-8f23-f1dede6f741e tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308c415b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27'): ({'sde'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-01ede7aa-9c32-465a-8f23-f1dede6f741e tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Removing single pathed devices sde {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc418e2c-fc2d-40ea-a2bc-36d7bc6d7b26]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8482b9-5161-44d5-bf23-9d3a8aaab292]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-01ede7aa-9c32-465a-8f23-f1dede6f741e tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Flushing IO for device /dev/sde {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1725fe10-2047-41c5-ac43-ffe2586c3b1b]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-01ede7aa-9c32-465a-8f23-f1dede6f741e tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[022f029a-c830-4785-9ea7-5c05e34592f6]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-01ede7aa-9c32-465a-8f23-f1dede6f741e tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-01ede7aa-9c32-465a-8f23-f1dede6f741e tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] SCSI volumes sde have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ede7aa-9c32-465a-8f23-f1dede6f741e tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f215ced-3aa1-46f2-8c4b-92edf7863c90]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ede7aa-9c32-465a-8f23-f1dede6f741e tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27 -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[307e1374-9d3d-4ca0-b3a8-aec7c2cde6b7]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ede7aa-9c32-465a-8f23-f1dede6f741e tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27, portal: 172.16.0.220,3260]
Aug 03 04:46:29 user nova-compute[72444]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27, portal: 172.16.0.220,3260] successful.
Aug 03 04:46:29 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27 -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb15df7-2ce6-4ff6-b59e-1e3560942c27 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3472d88c-7321-45ee-9364-af160f9c5786]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ede7aa-9c32-465a-8f23-f1dede6f741e tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-01ede7aa-9c32-465a-8f23-f1dede6f741e tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ede7aa-9c32-465a-8f23-f1dede6f741e tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] <== disconnect_volume: return (270ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:46:29 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01ede7aa-9c32-465a-8f23-f1dede6f741e tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:46:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:34 user nova-compute[72444]: DEBUG nova.objects.instance [None req-01ede7aa-9c32-465a-8f23-f1dede6f741e tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lazy-loading 'flavor' on Instance uuid 6f1a45af-977b-43e2-a7dd-7a9c402840d1 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:46:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-01ede7aa-9c32-465a-8f23-f1dede6f741e tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.243s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:46:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2cf54654-52a3-408d-af8f-e46a5d5ca94b tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Acquiring lock "interface-6f1a45af-977b-43e2-a7dd-7a9c402840d1-d80e3248-9a8c-480d-b27a-a9f3abc7ce17" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:46:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2cf54654-52a3-408d-af8f-e46a5d5ca94b tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lock "interface-6f1a45af-977b-43e2-a7dd-7a9c402840d1-d80e3248-9a8c-480d-b27a-a9f3abc7ce17" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:46:34 user nova-compute[72444]: DEBUG nova.objects.instance [None req-2cf54654-52a3-408d-af8f-e46a5d5ca94b tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lazy-loading 'flavor' on Instance uuid 6f1a45af-977b-43e2-a7dd-7a9c402840d1 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:46:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-2cf54654-52a3-408d-af8f-e46a5d5ca94b tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:44:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1468224080',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1468224080',id=16,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaZFwRNEZpiQfGHLwHZY0lzzbAVIRwXRC0MqbLmO16AzRtkc1PNUMZriWOCxZ3hf+0jC1htGoMbWFCsoXZ1AlanFdwAoHBAD6We6zi7g38fpOwMHB+xi90mEeGWehYqlA==',key_name='tempest-keypair-1754610092',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:44:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1dee6e42044847209f1357b13d6d126a',ramdisk_id='',reservation_id='r-qunvoqox',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1101837971',owner_user_name='tempest-TaggedAttachmentsTest-1101837971-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:44:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0bdf7a13912407ea16fd1999be5ede0',uuid=6f1a45af-977b-43e2-a7dd-7a9c402840d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d80e3248-9a8c-480d-b27a-a9f3abc7ce17", "address": "fa:16:3e:e7:1a:24", "network": {"id": "260cc6dc-9521-4d49-bf50-a409bb7f2ce4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-256124424", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1dee6e42044847209f1357b13d6d126a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd80e3248-9a", "ovs_interfaceid": "d80e3248-9a8c-480d-b27a-a9f3abc7ce17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:46:34 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-2cf54654-52a3-408d-af8f-e46a5d5ca94b tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Converting VIF {"id": "d80e3248-9a8c-480d-b27a-a9f3abc7ce17", "address": "fa:16:3e:e7:1a:24", "network": {"id": "260cc6dc-9521-4d49-bf50-a409bb7f2ce4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-256124424", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1dee6e42044847209f1357b13d6d126a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd80e3248-9a", "ovs_interfaceid": "d80e3248-9a8c-480d-b27a-a9f3abc7ce17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:46:34 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-2cf54654-52a3-408d-af8f-e46a5d5ca94b tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:1a:24,bridge_name='br-int',has_traffic_filtering=True,id=d80e3248-9a8c-480d-b27a-a9f3abc7ce17,network=Network(260cc6dc-9521-4d49-bf50-a409bb7f2ce4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd80e3248-9a') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:46:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-2cf54654-52a3-408d-af8f-e46a5d5ca94b tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e7:1a:24"/><model type="virtio"/><mtu size="1442"/><target dev="tapd80e3248-9a"/></interface> {{(pid=72444) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 03 04:46:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-2cf54654-52a3-408d-af8f-e46a5d5ca94b tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e7:1a:24"/><model type="virtio"/><mtu size="1442"/><target dev="tapd80e3248-9a"/></interface> {{(pid=72444) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 03 04:46:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2cf54654-52a3-408d-af8f-e46a5d5ca94b tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Attempting to detach device tapd80e3248-9a from instance 6f1a45af-977b-43e2-a7dd-7a9c402840d1 from the persistent domain config. {{(pid=72444) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 04:46:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-2cf54654-52a3-408d-af8f-e46a5d5ca94b tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] detach device xml: <interface type="ethernet">
Aug 03 04:46:34 user nova-compute[72444]:   <mac address="fa:16:3e:e7:1a:24"/>
Aug 03 04:46:34 user nova-compute[72444]:   <model type="virtio"/>
Aug 03 04:46:34 user nova-compute[72444]:   <mtu size="1442"/>
Aug 03 04:46:34 user nova-compute[72444]:   <target dev="tapd80e3248-9a"/>
Aug 03 04:46:34 user nova-compute[72444]: </interface>
Aug 03 04:46:34 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:46:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-2cf54654-52a3-408d-af8f-e46a5d5ca94b tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e7:1a:24"/><model type="virtio"/><mtu size="1442"/><target dev="tapd80e3248-9a"/></interface> {{(pid=72444) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 03 04:46:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-2cf54654-52a3-408d-af8f-e46a5d5ca94b tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e7:1a:24"/><model type="virtio"/><mtu size="1442"/><target dev="tapd80e3248-9a"/></interface>not found in domain: <domain type='kvm' id='17'>
Aug 03 04:46:34 user nova-compute[72444]:   <name>instance-00000010</name>
Aug 03 04:46:34 user nova-compute[72444]:   <uuid>6f1a45af-977b-43e2-a7dd-7a9c402840d1</uuid>
Aug 03 04:46:34 user nova-compute[72444]:   <metadata>
Aug 03 04:46:34 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:46:34 user nova-compute[72444]:   <nova:package version="0.0.0"/>
Aug 03 04:46:34 user nova-compute[72444]:   <nova:name>tempest-device-tagging-server-1468224080</nova:name>
Aug 03 04:46:34 user nova-compute[72444]:   <nova:creationTime>2023-08-03 04:46:14</nova:creationTime>
Aug 03 04:46:34 user nova-compute[72444]:   <nova:flavor name="m1.tiny">
Aug 03 04:46:34 user nova-compute[72444]:     <nova:memory>512</nova:memory>
Aug 03 04:46:34 user nova-compute[72444]:     <nova:disk>1</nova:disk>
Aug 03 04:46:34 user nova-compute[72444]:     <nova:swap>0</nova:swap>
Aug 03 04:46:34 user nova-compute[72444]:     <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:46:34 user nova-compute[72444]:     <nova:vcpus>1</nova:vcpus>
Aug 03 04:46:34 user nova-compute[72444]:   </nova:flavor>
Aug 03 04:46:34 user nova-compute[72444]:   <nova:owner>
Aug 03 04:46:34 user nova-compute[72444]:     <nova:user uuid="c0bdf7a13912407ea16fd1999be5ede0">tempest-TaggedAttachmentsTest-1101837971-project-member</nova:user>
Aug 03 04:46:34 user nova-compute[72444]:     <nova:project uuid="1dee6e42044847209f1357b13d6d126a">tempest-TaggedAttachmentsTest-1101837971</nova:project>
Aug 03 04:46:34 user nova-compute[72444]:   </nova:owner>
Aug 03 04:46:34 user nova-compute[72444]:   <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:46:34 user nova-compute[72444]:   <nova:ports>
Aug 03 04:46:34 user nova-compute[72444]:     <nova:port uuid="5119da23-2d00-4603-ba9f-a9d0c35bf261">
Aug 03 04:46:34 user nova-compute[72444]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 03 04:46:34 user nova-compute[72444]:     </nova:port>
Aug 03 04:46:34 user nova-compute[72444]:     <nova:port uuid="d80e3248-9a8c-480d-b27a-a9f3abc7ce17">
Aug 03 04:46:34 user nova-compute[72444]:       <nova:ip type="fixed" address="10.10.10.56" ipVersion="4"/>
Aug 03 04:46:34 user nova-compute[72444]:     </nova:port>
Aug 03 04:46:34 user nova-compute[72444]:   </nova:ports>
Aug 03 04:46:34 user nova-compute[72444]: </nova:instance>
Aug 03 04:46:34 user nova-compute[72444]:   </metadata>
Aug 03 04:46:34 user nova-compute[72444]:   <memory unit='KiB'>524288</memory>
Aug 03 04:46:34 user nova-compute[72444]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 03 04:46:34 user nova-compute[72444]:   <vcpu placement='static'>1</vcpu>
Aug 03 04:46:34 user nova-compute[72444]:   <resource>
Aug 03 04:46:34 user nova-compute[72444]:     <partition>/machine</partition>
Aug 03 04:46:34 user nova-compute[72444]:   </resource>
Aug 03 04:46:34 user nova-compute[72444]:   <sysinfo type='smbios'>
Aug 03 04:46:34 user nova-compute[72444]:     <system>
Aug 03 04:46:34 user nova-compute[72444]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 03 04:46:34 user nova-compute[72444]:       <entry name='product'>OpenStack Nova</entry>
Aug 03 04:46:34 user nova-compute[72444]:       <entry name='version'>0.0.0</entry>
Aug 03 04:46:34 user nova-compute[72444]:       <entry name='serial'>6f1a45af-977b-43e2-a7dd-7a9c402840d1</entry>
Aug 03 04:46:34 user nova-compute[72444]:       <entry name='uuid'>6f1a45af-977b-43e2-a7dd-7a9c402840d1</entry>
Aug 03 04:46:34 user nova-compute[72444]:       <entry name='family'>Virtual Machine</entry>
Aug 03 04:46:34 user nova-compute[72444]:     </system>
Aug 03 04:46:34 user nova-compute[72444]:   </sysinfo>
Aug 03 04:46:34 user nova-compute[72444]:   <os>
Aug 03 04:46:34 user nova-compute[72444]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 03 04:46:34 user nova-compute[72444]:     <boot dev='hd'/>
Aug 03 04:46:34 user nova-compute[72444]:     <smbios mode='sysinfo'/>
Aug 03 04:46:34 user nova-compute[72444]:   </os>
Aug 03 04:46:34 user nova-compute[72444]:   <features>
Aug 03 04:46:34 user nova-compute[72444]:     <acpi/>
Aug 03 04:46:34 user nova-compute[72444]:     <apic/>
Aug 03 04:46:34 user nova-compute[72444]:     <vmcoreinfo state='on'/>
Aug 03 04:46:34 user nova-compute[72444]:   </features>
Aug 03 04:46:34 user nova-compute[72444]:   <cpu mode='custom' match='exact' check='full'>
Aug 03 04:46:34 user nova-compute[72444]:     <model fallback='forbid'>Nehalem</model>
Aug 03 04:46:34 user nova-compute[72444]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 03 04:46:34 user nova-compute[72444]:     <feature policy='require' name='vme'/>
Aug 03 04:46:34 user nova-compute[72444]:     <feature policy='require' name='x2apic'/>
Aug 03 04:46:34 user nova-compute[72444]:     <feature policy='require' name='hypervisor'/>
Aug 03 04:46:34 user nova-compute[72444]:   </cpu>
Aug 03 04:46:34 user nova-compute[72444]:   <clock offset='utc'>
Aug 03 04:46:34 user nova-compute[72444]:     <timer name='pit' tickpolicy='delay'/>
Aug 03 04:46:34 user nova-compute[72444]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 03 04:46:34 user nova-compute[72444]:     <timer name='hpet' present='no'/>
Aug 03 04:46:34 user nova-compute[72444]:   </clock>
Aug 03 04:46:34 user nova-compute[72444]:   <on_poweroff>destroy</on_poweroff>
Aug 03 04:46:34 user nova-compute[72444]:   <on_reboot>restart</on_reboot>
Aug 03 04:46:34 user nova-compute[72444]:   <on_crash>destroy</on_crash>
Aug 03 04:46:34 user nova-compute[72444]:   <devices>
Aug 03 04:46:34 user nova-compute[72444]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 03 04:46:34 user nova-compute[72444]:     <disk type='file' device='disk'>
Aug 03 04:46:34 user nova-compute[72444]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 03 04:46:34 user nova-compute[72444]:       <source file='/opt/stack/data/nova/instances/6f1a45af-977b-43e2-a7dd-7a9c402840d1/disk' index='2'/>
Aug 03 04:46:34 user nova-compute[72444]:       <backingStore type='file' index='3'>
Aug 03 04:46:34 user nova-compute[72444]:         <format type='raw'/>
Aug 03 04:46:34 user nova-compute[72444]:         <source file='/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e'/>
Aug 03 04:46:34 user nova-compute[72444]:         <backingStore/>
Aug 03 04:46:34 user nova-compute[72444]:       </backingStore>
Aug 03 04:46:34 user nova-compute[72444]:       <target dev='vda' bus='virtio'/>
Aug 03 04:46:34 user nova-compute[72444]:       <alias name='virtio-disk0'/>
Aug 03 04:46:34 user nova-compute[72444]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 03 04:46:34 user nova-compute[72444]:     </disk>
Aug 03 04:46:34 user nova-compute[72444]:     <disk type='file' device='cdrom'>
Aug 03 04:46:34 user nova-compute[72444]:       <driver name='qemu' type='raw' cache='none'/>
Aug 03 04:46:34 user nova-compute[72444]:       <source file='/opt/stack/data/nova/instances/6f1a45af-977b-43e2-a7dd-7a9c402840d1/disk.config' index='1'/>
Aug 03 04:46:34 user nova-compute[72444]:       <backingStore/>
Aug 03 04:46:34 user nova-compute[72444]:       <target dev='hda' bus='ide'/>
Aug 03 04:46:34 user nova-compute[72444]:       <readonly/>
Aug 03 04:46:34 user nova-compute[72444]:       <alias name='ide0-0-0'/>
Aug 03 04:46:34 user nova-compute[72444]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 03 04:46:34 user nova-compute[72444]:     </disk>
Aug 03 04:46:34 user nova-compute[72444]:     <controller type='usb' index='0' model='none'>
Aug 03 04:46:34 user nova-compute[72444]:       <alias name='usb'/>
Aug 03 04:46:34 user nova-compute[72444]:     </controller>
Aug 03 04:46:34 user nova-compute[72444]:     <controller type='pci' index='0' model='pci-root'>
Aug 03 04:46:34 user nova-compute[72444]:       <alias name='pci.0'/>
Aug 03 04:46:34 user nova-compute[72444]:     </controller>
Aug 03 04:46:34 user nova-compute[72444]:     <controller type='ide' index='0'>
Aug 03 04:46:34 user nova-compute[72444]:       <alias name='ide'/>
Aug 03 04:46:34 user nova-compute[72444]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 03 04:46:34 user nova-compute[72444]:     </controller>
Aug 03 04:46:34 user nova-compute[72444]:     <interface type='ethernet'>
Aug 03 04:46:34 user nova-compute[72444]:       <mac address='fa:16:3e:b0:20:5c'/>
Aug 03 04:46:34 user nova-compute[72444]:       <target dev='tap5119da23-2d'/>
Aug 03 04:46:34 user nova-compute[72444]:       <model type='virtio'/>
Aug 03 04:46:34 user nova-compute[72444]:       <mtu size='1442'/>
Aug 03 04:46:34 user nova-compute[72444]:       <alias name='net0'/>
Aug 03 04:46:34 user nova-compute[72444]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 03 04:46:34 user nova-compute[72444]:     </interface>
Aug 03 04:46:34 user nova-compute[72444]:     <interface type='ethernet'>
Aug 03 04:46:34 user nova-compute[72444]:       <mac address='fa:16:3e:e7:1a:24'/>
Aug 03 04:46:34 user nova-compute[72444]:       <target dev='tapd80e3248-9a'/>
Aug 03 04:46:34 user nova-compute[72444]:       <model type='virtio'/>
Aug 03 04:46:34 user nova-compute[72444]:       <mtu size='1442'/>
Aug 03 04:46:34 user nova-compute[72444]:       <alias name='net1'/>
Aug 03 04:46:34 user nova-compute[72444]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 03 04:46:34 user nova-compute[72444]:     </interface>
Aug 03 04:46:34 user nova-compute[72444]:     <serial type='pty'>
Aug 03 04:46:34 user nova-compute[72444]:       <source path='/dev/pts/8'/>
Aug 03 04:46:34 user nova-compute[72444]:       <log file='/opt/stack/data/nova/instances/6f1a45af-977b-43e2-a7dd-7a9c402840d1/console.log' append='off'/>
Aug 03 04:46:34 user nova-compute[72444]:       <target type='isa-serial' port='0'>
Aug 03 04:46:34 user nova-compute[72444]:         <model name='isa-serial'/>
Aug 03 04:46:34 user nova-compute[72444]:       </target>
Aug 03 04:46:34 user nova-compute[72444]:       <alias name='serial0'/>
Aug 03 04:46:34 user nova-compute[72444]:     </serial>
Aug 03 04:46:34 user nova-compute[72444]:     <console type='pty' tty='/dev/pts/8'>
Aug 03 04:46:34 user nova-compute[72444]:       <source path='/dev/pts/8'/>
Aug 03 04:46:34 user nova-compute[72444]:       <log file='/opt/stack/data/nova/instances/6f1a45af-977b-43e2-a7dd-7a9c402840d1/console.log' append='off'/>
Aug 03 04:46:34 user nova-compute[72444]:       <target type='serial' port='0'/>
Aug 03 04:46:34 user nova-compute[72444]:       <alias name='serial0'/>
Aug 03 04:46:34 user nova-compute[72444]:     </console>
Aug 03 04:46:34 user nova-compute[72444]:     <input type='mouse' bus='ps2'>
Aug 03 04:46:34 user nova-compute[72444]:       <alias name='input0'/>
Aug 03 04:46:34 user nova-compute[72444]:     </input>
Aug 03 04:46:34 user nova-compute[72444]:     <input type='keyboard' bus='ps2'>
Aug 03 04:46:34 user nova-compute[72444]:       <alias name='input1'/>
Aug 03 04:46:34 user nova-compute[72444]:     </input>
Aug 03 04:46:34 user nova-compute[72444]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Aug 03 04:46:34 user nova-compute[72444]:       <listen type='address' address='0.0.0.0'/>
Aug 03 04:46:34 user nova-compute[72444]:     </graphics>
Aug 03 04:46:34 user nova-compute[72444]:     <audio id='1' type='none'/>
Aug 03 04:46:34 user nova-compute[72444]:     <video>
Aug 03 04:46:34 user nova-compute[72444]:       <model type='virtio' heads='1' primary='yes'/>
Aug 03 04:46:34 user nova-compute[72444]:       <alias name='video0'/>
Aug 03 04:46:34 user nova-compute[72444]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 03 04:46:34 user nova-compute[72444]:     </video>
Aug 03 04:46:34 user nova-compute[72444]:     <memballoon model='virtio'>
Aug 03 04:46:34 user nova-compute[72444]:       <stats period='10'/>
Aug 03 04:46:34 user nova-compute[72444]:       <alias name='balloon0'/>
Aug 03 04:46:34 user nova-compute[72444]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 03 04:46:34 user nova-compute[72444]:     </memballoon>
Aug 03 04:46:34 user nova-compute[72444]:     <rng model='virtio'>
Aug 03 04:46:34 user nova-compute[72444]:       <backend model='random'>/dev/urandom</backend>
Aug 03 04:46:34 user nova-compute[72444]:       <alias name='rng0'/>
Aug 03 04:46:34 user nova-compute[72444]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 03 04:46:34 user nova-compute[72444]:     </rng>
Aug 03 04:46:34 user nova-compute[72444]:   </devices>
Aug 03 04:46:34 user nova-compute[72444]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 03 04:46:34 user nova-compute[72444]:     <label>libvirt-6f1a45af-977b-43e2-a7dd-7a9c402840d1</label>
Aug 03 04:46:34 user nova-compute[72444]:     <imagelabel>libvirt-6f1a45af-977b-43e2-a7dd-7a9c402840d1</imagelabel>
Aug 03 04:46:34 user nova-compute[72444]:   </seclabel>
Aug 03 04:46:34 user nova-compute[72444]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 03 04:46:34 user nova-compute[72444]:     <label>+64055:+108</label>
Aug 03 04:46:34 user nova-compute[72444]:     <imagelabel>+64055:+108</imagelabel>
Aug 03 04:46:34 user nova-compute[72444]:   </seclabel>
Aug 03 04:46:34 user nova-compute[72444]: </domain>
Aug 03 04:46:34 user nova-compute[72444]:  {{(pid=72444) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 03 04:46:34 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-2cf54654-52a3-408d-af8f-e46a5d5ca94b tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Successfully detached device tapd80e3248-9a from instance 6f1a45af-977b-43e2-a7dd-7a9c402840d1 from the persistent domain config.
Aug 03 04:46:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2cf54654-52a3-408d-af8f-e46a5d5ca94b tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] (1/8): Attempting to detach device tapd80e3248-9a with device alias net1 from instance 6f1a45af-977b-43e2-a7dd-7a9c402840d1 from the live domain config. {{(pid=72444) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 04:46:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-2cf54654-52a3-408d-af8f-e46a5d5ca94b tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] detach device xml: <interface type="ethernet">
Aug 03 04:46:34 user nova-compute[72444]:   <mac address="fa:16:3e:e7:1a:24"/>
Aug 03 04:46:34 user nova-compute[72444]:   <model type="virtio"/>
Aug 03 04:46:34 user nova-compute[72444]:   <mtu size="1442"/>
Aug 03 04:46:34 user nova-compute[72444]:   <target dev="tapd80e3248-9a"/>
Aug 03 04:46:34 user nova-compute[72444]: </interface>
Aug 03 04:46:34 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:46:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Received event <DeviceRemovedEvent: 1691037994.9405482, 6f1a45af-977b-43e2-a7dd-7a9c402840d1 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72444) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 04:46:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2cf54654-52a3-408d-af8f-e46a5d5ca94b tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Start waiting for the detach event from libvirt for device tapd80e3248-9a with device alias net1 for instance 6f1a45af-977b-43e2-a7dd-7a9c402840d1 {{(pid=72444) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 04:46:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-2cf54654-52a3-408d-af8f-e46a5d5ca94b tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e7:1a:24"/><model type="virtio"/><mtu size="1442"/><target dev="tapd80e3248-9a"/></interface> {{(pid=72444) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 03 04:46:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-2cf54654-52a3-408d-af8f-e46a5d5ca94b tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e7:1a:24"/><model type="virtio"/><mtu size="1442"/><target dev="tapd80e3248-9a"/></interface>not found in domain: <domain type='kvm' id='17'>
Aug 03 04:46:34 user nova-compute[72444]:   <name>instance-00000010</name>
Aug 03 04:46:34 user nova-compute[72444]:   <uuid>6f1a45af-977b-43e2-a7dd-7a9c402840d1</uuid>
Aug 03 04:46:34 user nova-compute[72444]:   <metadata>
Aug 03 04:46:34 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:46:34 user nova-compute[72444]:   <nova:package version="0.0.0"/>
Aug 03 04:46:34 user nova-compute[72444]:   <nova:name>tempest-device-tagging-server-1468224080</nova:name>
Aug 03 04:46:34 user nova-compute[72444]:   <nova:creationTime>2023-08-03 04:46:14</nova:creationTime>
Aug 03 04:46:34 user nova-compute[72444]:   <nova:flavor name="m1.tiny">
Aug 03 04:46:34 user nova-compute[72444]:     <nova:memory>512</nova:memory>
Aug 03 04:46:34 user nova-compute[72444]:     <nova:disk>1</nova:disk>
Aug 03 04:46:34 user nova-compute[72444]:     <nova:swap>0</nova:swap>
Aug 03 04:46:34 user nova-compute[72444]:     <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:46:34 user nova-compute[72444]:     <nova:vcpus>1</nova:vcpus>
Aug 03 04:46:34 user nova-compute[72444]:   </nova:flavor>
Aug 03 04:46:34 user nova-compute[72444]:   <nova:owner>
Aug 03 04:46:34 user nova-compute[72444]:     <nova:user uuid="c0bdf7a13912407ea16fd1999be5ede0">tempest-TaggedAttachmentsTest-1101837971-project-member</nova:user>
Aug 03 04:46:34 user nova-compute[72444]:     <nova:project uuid="1dee6e42044847209f1357b13d6d126a">tempest-TaggedAttachmentsTest-1101837971</nova:project>
Aug 03 04:46:34 user nova-compute[72444]:   </nova:owner>
Aug 03 04:46:34 user nova-compute[72444]:   <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:46:34 user nova-compute[72444]:   <nova:ports>
Aug 03 04:46:34 user nova-compute[72444]:     <nova:port uuid="5119da23-2d00-4603-ba9f-a9d0c35bf261">
Aug 03 04:46:34 user nova-compute[72444]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 03 04:46:34 user nova-compute[72444]:     </nova:port>
Aug 03 04:46:34 user nova-compute[72444]:     <nova:port uuid="d80e3248-9a8c-480d-b27a-a9f3abc7ce17">
Aug 03 04:46:34 user nova-compute[72444]:       <nova:ip type="fixed" address="10.10.10.56" ipVersion="4"/>
Aug 03 04:46:34 user nova-compute[72444]:     </nova:port>
Aug 03 04:46:34 user nova-compute[72444]:   </nova:ports>
Aug 03 04:46:34 user nova-compute[72444]: </nova:instance>
Aug 03 04:46:34 user nova-compute[72444]:   </metadata>
Aug 03 04:46:34 user nova-compute[72444]:   <memory unit='KiB'>524288</memory>
Aug 03 04:46:34 user nova-compute[72444]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 03 04:46:34 user nova-compute[72444]:   <vcpu placement='static'>1</vcpu>
Aug 03 04:46:34 user nova-compute[72444]:   <resource>
Aug 03 04:46:34 user nova-compute[72444]:     <partition>/machine</partition>
Aug 03 04:46:34 user nova-compute[72444]:   </resource>
Aug 03 04:46:34 user nova-compute[72444]:   <sysinfo type='smbios'>
Aug 03 04:46:34 user nova-compute[72444]:     <system>
Aug 03 04:46:34 user nova-compute[72444]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 03 04:46:34 user nova-compute[72444]:       <entry name='product'>OpenStack Nova</entry>
Aug 03 04:46:34 user nova-compute[72444]:       <entry name='version'>0.0.0</entry>
Aug 03 04:46:34 user nova-compute[72444]:       <entry name='serial'>6f1a45af-977b-43e2-a7dd-7a9c402840d1</entry>
Aug 03 04:46:34 user nova-compute[72444]:       <entry name='uuid'>6f1a45af-977b-43e2-a7dd-7a9c402840d1</entry>
Aug 03 04:46:34 user nova-compute[72444]:       <entry name='family'>Virtual Machine</entry>
Aug 03 04:46:34 user nova-compute[72444]:     </system>
Aug 03 04:46:34 user nova-compute[72444]:   </sysinfo>
Aug 03 04:46:34 user nova-compute[72444]:   <os>
Aug 03 04:46:34 user nova-compute[72444]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 03 04:46:34 user nova-compute[72444]:     <boot dev='hd'/>
Aug 03 04:46:34 user nova-compute[72444]:     <smbios mode='sysinfo'/>
Aug 03 04:46:34 user nova-compute[72444]:   </os>
Aug 03 04:46:34 user nova-compute[72444]:   <features>
Aug 03 04:46:34 user nova-compute[72444]:     <acpi/>
Aug 03 04:46:34 user nova-compute[72444]:     <apic/>
Aug 03 04:46:34 user nova-compute[72444]:     <vmcoreinfo state='on'/>
Aug 03 04:46:34 user nova-compute[72444]:   </features>
Aug 03 04:46:34 user nova-compute[72444]:   <cpu mode='custom' match='exact' check='full'>
Aug 03 04:46:34 user nova-compute[72444]:     <model fallback='forbid'>Nehalem</model>
Aug 03 04:46:34 user nova-compute[72444]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 03 04:46:34 user nova-compute[72444]:     <feature policy='require' name='vme'/>
Aug 03 04:46:34 user nova-compute[72444]:     <feature policy='require' name='x2apic'/>
Aug 03 04:46:34 user nova-compute[72444]:     <feature policy='require' name='hypervisor'/>
Aug 03 04:46:34 user nova-compute[72444]:   </cpu>
Aug 03 04:46:34 user nova-compute[72444]:   <clock offset='utc'>
Aug 03 04:46:34 user nova-compute[72444]:     <timer name='pit' tickpolicy='delay'/>
Aug 03 04:46:34 user nova-compute[72444]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 03 04:46:34 user nova-compute[72444]:     <timer name='hpet' present='no'/>
Aug 03 04:46:34 user nova-compute[72444]:   </clock>
Aug 03 04:46:34 user nova-compute[72444]:   <on_poweroff>destroy</on_poweroff>
Aug 03 04:46:34 user nova-compute[72444]:   <on_reboot>restart</on_reboot>
Aug 03 04:46:34 user nova-compute[72444]:   <on_crash>destroy</on_crash>
Aug 03 04:46:34 user nova-compute[72444]:   <devices>
Aug 03 04:46:34 user nova-compute[72444]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 03 04:46:34 user nova-compute[72444]:     <disk type='file' device='disk'>
Aug 03 04:46:34 user nova-compute[72444]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 03 04:46:34 user nova-compute[72444]:       <source file='/opt/stack/data/nova/instances/6f1a45af-977b-43e2-a7dd-7a9c402840d1/disk' index='2'/>
Aug 03 04:46:34 user nova-compute[72444]:       <backingStore type='file' index='3'>
Aug 03 04:46:34 user nova-compute[72444]:         <format type='raw'/>
Aug 03 04:46:34 user nova-compute[72444]:         <source file='/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e'/>
Aug 03 04:46:34 user nova-compute[72444]:         <backingStore/>
Aug 03 04:46:34 user nova-compute[72444]:       </backingStore>
Aug 03 04:46:34 user nova-compute[72444]:       <target dev='vda' bus='virtio'/>
Aug 03 04:46:34 user nova-compute[72444]:       <alias name='virtio-disk0'/>
Aug 03 04:46:34 user nova-compute[72444]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 03 04:46:34 user nova-compute[72444]:     </disk>
Aug 03 04:46:34 user nova-compute[72444]:     <disk type='file' device='cdrom'>
Aug 03 04:46:34 user nova-compute[72444]:       <driver name='qemu' type='raw' cache='none'/>
Aug 03 04:46:34 user nova-compute[72444]:       <source file='/opt/stack/data/nova/instances/6f1a45af-977b-43e2-a7dd-7a9c402840d1/disk.config' index='1'/>
Aug 03 04:46:34 user nova-compute[72444]:       <backingStore/>
Aug 03 04:46:34 user nova-compute[72444]:       <target dev='hda' bus='ide'/>
Aug 03 04:46:34 user nova-compute[72444]:       <readonly/>
Aug 03 04:46:34 user nova-compute[72444]:       <alias name='ide0-0-0'/>
Aug 03 04:46:34 user nova-compute[72444]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 03 04:46:34 user nova-compute[72444]:     </disk>
Aug 03 04:46:34 user nova-compute[72444]:     <controller type='usb' index='0' model='none'>
Aug 03 04:46:34 user nova-compute[72444]:       <alias name='usb'/>
Aug 03 04:46:34 user nova-compute[72444]:     </controller>
Aug 03 04:46:34 user nova-compute[72444]:     <controller type='pci' index='0' model='pci-root'>
Aug 03 04:46:34 user nova-compute[72444]:       <alias name='pci.0'/>
Aug 03 04:46:34 user nova-compute[72444]:     </controller>
Aug 03 04:46:34 user nova-compute[72444]:     <controller type='ide' index='0'>
Aug 03 04:46:34 user nova-compute[72444]:       <alias name='ide'/>
Aug 03 04:46:34 user nova-compute[72444]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 03 04:46:34 user nova-compute[72444]:     </controller>
Aug 03 04:46:34 user nova-compute[72444]:     <interface type='ethernet'>
Aug 03 04:46:34 user nova-compute[72444]:       <mac address='fa:16:3e:b0:20:5c'/>
Aug 03 04:46:34 user nova-compute[72444]:       <target dev='tap5119da23-2d'/>
Aug 03 04:46:34 user nova-compute[72444]:       <model type='virtio'/>
Aug 03 04:46:34 user nova-compute[72444]:       <mtu size='1442'/>
Aug 03 04:46:34 user nova-compute[72444]:       <alias name='net0'/>
Aug 03 04:46:34 user nova-compute[72444]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 03 04:46:34 user nova-compute[72444]:     </interface>
Aug 03 04:46:34 user nova-compute[72444]:     <serial type='pty'>
Aug 03 04:46:34 user nova-compute[72444]:       <source path='/dev/pts/8'/>
Aug 03 04:46:34 user nova-compute[72444]:       <log file='/opt/stack/data/nova/instances/6f1a45af-977b-43e2-a7dd-7a9c402840d1/console.log' append='off'/>
Aug 03 04:46:34 user nova-compute[72444]:       <target type='isa-serial' port='0'>
Aug 03 04:46:34 user nova-compute[72444]:         <model name='isa-serial'/>
Aug 03 04:46:34 user nova-compute[72444]:       </target>
Aug 03 04:46:34 user nova-compute[72444]:       <alias name='serial0'/>
Aug 03 04:46:34 user nova-compute[72444]:     </serial>
Aug 03 04:46:34 user nova-compute[72444]:     <console type='pty' tty='/dev/pts/8'>
Aug 03 04:46:34 user nova-compute[72444]:       <source path='/dev/pts/8'/>
Aug 03 04:46:34 user nova-compute[72444]:       <log file='/opt/stack/data/nova/instances/6f1a45af-977b-43e2-a7dd-7a9c402840d1/console.log' append='off'/>
Aug 03 04:46:34 user nova-compute[72444]:       <target type='serial' port='0'/>
Aug 03 04:46:34 user nova-compute[72444]:       <alias name='serial0'/>
Aug 03 04:46:34 user nova-compute[72444]:     </console>
Aug 03 04:46:34 user nova-compute[72444]:     <input type='mouse' bus='ps2'>
Aug 03 04:46:34 user nova-compute[72444]:       <alias name='input0'/>
Aug 03 04:46:34 user nova-compute[72444]:     </input>
Aug 03 04:46:34 user nova-compute[72444]:     <input type='keyboard' bus='ps2'>
Aug 03 04:46:34 user nova-compute[72444]:       <alias name='input1'/>
Aug 03 04:46:34 user nova-compute[72444]:     </input>
Aug 03 04:46:34 user nova-compute[72444]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Aug 03 04:46:34 user nova-compute[72444]:       <listen type='address' address='0.0.0.0'/>
Aug 03 04:46:34 user nova-compute[72444]:     </graphics>
Aug 03 04:46:34 user nova-compute[72444]:     <audio id='1' type='none'/>
Aug 03 04:46:34 user nova-compute[72444]:     <video>
Aug 03 04:46:34 user nova-compute[72444]:       <model type='virtio' heads='1' primary='yes'/>
Aug 03 04:46:34 user nova-compute[72444]:       <alias name='video0'/>
Aug 03 04:46:34 user nova-compute[72444]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 03 04:46:34 user nova-compute[72444]:     </video>
Aug 03 04:46:34 user nova-compute[72444]:     <memballoon model='virtio'>
Aug 03 04:46:34 user nova-compute[72444]:       <stats period='10'/>
Aug 03 04:46:34 user nova-compute[72444]:       <alias name='balloon0'/>
Aug 03 04:46:34 user nova-compute[72444]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 03 04:46:34 user nova-compute[72444]:     </memballoon>
Aug 03 04:46:34 user nova-compute[72444]:     <rng model='virtio'>
Aug 03 04:46:34 user nova-compute[72444]:       <backend model='random'>/dev/urandom</backend>
Aug 03 04:46:34 user nova-compute[72444]:       <alias name='rng0'/>
Aug 03 04:46:34 user nova-compute[72444]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 03 04:46:34 user nova-compute[72444]:     </rng>
Aug 03 04:46:34 user nova-compute[72444]:   </devices>
Aug 03 04:46:34 user nova-compute[72444]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 03 04:46:34 user nova-compute[72444]:     <label>libvirt-6f1a45af-977b-43e2-a7dd-7a9c402840d1</label>
Aug 03 04:46:34 user nova-compute[72444]:     <imagelabel>libvirt-6f1a45af-977b-43e2-a7dd-7a9c402840d1</imagelabel>
Aug 03 04:46:34 user nova-compute[72444]:   </seclabel>
Aug 03 04:46:34 user nova-compute[72444]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 03 04:46:34 user nova-compute[72444]:     <label>+64055:+108</label>
Aug 03 04:46:34 user nova-compute[72444]:     <imagelabel>+64055:+108</imagelabel>
Aug 03 04:46:34 user nova-compute[72444]:   </seclabel>
Aug 03 04:46:34 user nova-compute[72444]: </domain>
Aug 03 04:46:34 user nova-compute[72444]:  {{(pid=72444) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 03 04:46:34 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-2cf54654-52a3-408d-af8f-e46a5d5ca94b tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Successfully detached device tapd80e3248-9a from instance 6f1a45af-977b-43e2-a7dd-7a9c402840d1 from the live domain config.
Aug 03 04:46:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-2cf54654-52a3-408d-af8f-e46a5d5ca94b tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:44:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1468224080',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1468224080',id=16,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaZFwRNEZpiQfGHLwHZY0lzzbAVIRwXRC0MqbLmO16AzRtkc1PNUMZriWOCxZ3hf+0jC1htGoMbWFCsoXZ1AlanFdwAoHBAD6We6zi7g38fpOwMHB+xi90mEeGWehYqlA==',key_name='tempest-keypair-1754610092',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:44:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1dee6e42044847209f1357b13d6d126a',ramdisk_id='',reservation_id='r-qunvoqox',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1101837971',owner_user_name='tempest-TaggedAttachmentsTest-1101837971-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:44:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0bdf7a13912407ea16fd1999be5ede0',uuid=6f1a45af-977b-43e2-a7dd-7a9c402840d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d80e3248-9a8c-480d-b27a-a9f3abc7ce17", "address": "fa:16:3e:e7:1a:24", "network": {"id": "260cc6dc-9521-4d49-bf50-a409bb7f2ce4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-256124424", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1dee6e42044847209f1357b13d6d126a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd80e3248-9a", "ovs_interfaceid": "d80e3248-9a8c-480d-b27a-a9f3abc7ce17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:46:34 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-2cf54654-52a3-408d-af8f-e46a5d5ca94b tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Converting VIF {"id": "d80e3248-9a8c-480d-b27a-a9f3abc7ce17", "address": "fa:16:3e:e7:1a:24", "network": {"id": "260cc6dc-9521-4d49-bf50-a409bb7f2ce4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-256124424", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1dee6e42044847209f1357b13d6d126a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd80e3248-9a", "ovs_interfaceid": "d80e3248-9a8c-480d-b27a-a9f3abc7ce17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:46:34 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-2cf54654-52a3-408d-af8f-e46a5d5ca94b tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:1a:24,bridge_name='br-int',has_traffic_filtering=True,id=d80e3248-9a8c-480d-b27a-a9f3abc7ce17,network=Network(260cc6dc-9521-4d49-bf50-a409bb7f2ce4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd80e3248-9a') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:46:34 user nova-compute[72444]: DEBUG os_vif [None req-2cf54654-52a3-408d-af8f-e46a5d5ca94b tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:1a:24,bridge_name='br-int',has_traffic_filtering=True,id=d80e3248-9a8c-480d-b27a-a9f3abc7ce17,network=Network(260cc6dc-9521-4d49-bf50-a409bb7f2ce4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd80e3248-9a') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:46:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd80e3248-9a, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:46:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:46:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:35 user nova-compute[72444]: INFO os_vif [None req-2cf54654-52a3-408d-af8f-e46a5d5ca94b tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:1a:24,bridge_name='br-int',has_traffic_filtering=True,id=d80e3248-9a8c-480d-b27a-a9f3abc7ce17,network=Network(260cc6dc-9521-4d49-bf50-a409bb7f2ce4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd80e3248-9a')
Aug 03 04:46:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-2cf54654-52a3-408d-af8f-e46a5d5ca94b tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:46:35 user nova-compute[72444]:   <nova:package version="0.0.0"/>
Aug 03 04:46:35 user nova-compute[72444]:   <nova:name>tempest-device-tagging-server-1468224080</nova:name>
Aug 03 04:46:35 user nova-compute[72444]:   <nova:creationTime>2023-08-03 04:46:35</nova:creationTime>
Aug 03 04:46:35 user nova-compute[72444]:   <nova:flavor name="m1.tiny">
Aug 03 04:46:35 user nova-compute[72444]:     <nova:memory>512</nova:memory>
Aug 03 04:46:35 user nova-compute[72444]:     <nova:disk>1</nova:disk>
Aug 03 04:46:35 user nova-compute[72444]:     <nova:swap>0</nova:swap>
Aug 03 04:46:35 user nova-compute[72444]:     <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:46:35 user nova-compute[72444]:     <nova:vcpus>1</nova:vcpus>
Aug 03 04:46:35 user nova-compute[72444]:   </nova:flavor>
Aug 03 04:46:35 user nova-compute[72444]:   <nova:owner>
Aug 03 04:46:35 user nova-compute[72444]:     <nova:user uuid="c0bdf7a13912407ea16fd1999be5ede0">tempest-TaggedAttachmentsTest-1101837971-project-member</nova:user>
Aug 03 04:46:35 user nova-compute[72444]:     <nova:project uuid="1dee6e42044847209f1357b13d6d126a">tempest-TaggedAttachmentsTest-1101837971</nova:project>
Aug 03 04:46:35 user nova-compute[72444]:   </nova:owner>
Aug 03 04:46:35 user nova-compute[72444]:   <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:46:35 user nova-compute[72444]:   <nova:ports>
Aug 03 04:46:35 user nova-compute[72444]:     <nova:port uuid="5119da23-2d00-4603-ba9f-a9d0c35bf261">
Aug 03 04:46:35 user nova-compute[72444]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 03 04:46:35 user nova-compute[72444]:     </nova:port>
Aug 03 04:46:35 user nova-compute[72444]:   </nova:ports>
Aug 03 04:46:35 user nova-compute[72444]: </nova:instance>
Aug 03 04:46:35 user nova-compute[72444]:  {{(pid=72444) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 03 04:46:35 user nova-compute[72444]: DEBUG nova.compute.manager [req-28e34bad-9ae2-414f-8302-e782029db96c req-050d3c5d-c6c6-4345-b22f-09a3db6de81a service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Received event network-vif-unplugged-d80e3248-9a8c-480d-b27a-a9f3abc7ce17 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:46:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-28e34bad-9ae2-414f-8302-e782029db96c req-050d3c5d-c6c6-4345-b22f-09a3db6de81a service nova] Acquiring lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:46:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-28e34bad-9ae2-414f-8302-e782029db96c req-050d3c5d-c6c6-4345-b22f-09a3db6de81a service nova] Lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:46:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-28e34bad-9ae2-414f-8302-e782029db96c req-050d3c5d-c6c6-4345-b22f-09a3db6de81a service nova] Lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:46:35 user nova-compute[72444]: DEBUG nova.compute.manager [req-28e34bad-9ae2-414f-8302-e782029db96c req-050d3c5d-c6c6-4345-b22f-09a3db6de81a service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] No waiting events found dispatching network-vif-unplugged-d80e3248-9a8c-480d-b27a-a9f3abc7ce17 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:46:35 user nova-compute[72444]: WARNING nova.compute.manager [req-28e34bad-9ae2-414f-8302-e782029db96c req-050d3c5d-c6c6-4345-b22f-09a3db6de81a service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Received unexpected event network-vif-unplugged-d80e3248-9a8c-480d-b27a-a9f3abc7ce17 for instance with vm_state active and task_state None.
Aug 03 04:46:35 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:46:35 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Cleaning up deleted instances {{(pid=72444) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 03 04:46:35 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] There are 0 instances to clean {{(pid=72444) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 03 04:46:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2cf54654-52a3-408d-af8f-e46a5d5ca94b tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Acquiring lock "refresh_cache-6f1a45af-977b-43e2-a7dd-7a9c402840d1" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:46:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2cf54654-52a3-408d-af8f-e46a5d5ca94b tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Acquired lock "refresh_cache-6f1a45af-977b-43e2-a7dd-7a9c402840d1" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:46:35 user nova-compute[72444]: DEBUG nova.network.neutron [None req-2cf54654-52a3-408d-af8f-e46a5d5ca94b tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:46:36 user nova-compute[72444]: INFO nova.network.neutron [None req-2cf54654-52a3-408d-af8f-e46a5d5ca94b tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Port d80e3248-9a8c-480d-b27a-a9f3abc7ce17 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Aug 03 04:46:36 user nova-compute[72444]: DEBUG nova.network.neutron [None req-2cf54654-52a3-408d-af8f-e46a5d5ca94b tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Updating instance_info_cache with network_info: [{"id": "5119da23-2d00-4603-ba9f-a9d0c35bf261", "address": "fa:16:3e:b0:20:5c", "network": {"id": "609944ea-0d2a-43ad-9d2b-f06d1c67d9de", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1126534592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1dee6e42044847209f1357b13d6d126a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5119da23-2d", "ovs_interfaceid": "5119da23-2d00-4603-ba9f-a9d0c35bf261", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:46:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2cf54654-52a3-408d-af8f-e46a5d5ca94b tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Releasing lock "refresh_cache-6f1a45af-977b-43e2-a7dd-7a9c402840d1" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:46:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2cf54654-52a3-408d-af8f-e46a5d5ca94b tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lock "interface-6f1a45af-977b-43e2-a7dd-7a9c402840d1-d80e3248-9a8c-480d-b27a-a9f3abc7ce17" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.927s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:46:37 user nova-compute[72444]: DEBUG nova.compute.manager [req-df80b5c4-02c9-43ed-8305-afa7a367fc6d req-168e9206-66de-4267-b493-5b0ae8510c58 service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Received event network-vif-plugged-d80e3248-9a8c-480d-b27a-a9f3abc7ce17 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:46:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-df80b5c4-02c9-43ed-8305-afa7a367fc6d req-168e9206-66de-4267-b493-5b0ae8510c58 service nova] Acquiring lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:46:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-df80b5c4-02c9-43ed-8305-afa7a367fc6d req-168e9206-66de-4267-b493-5b0ae8510c58 service nova] Lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:46:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-df80b5c4-02c9-43ed-8305-afa7a367fc6d req-168e9206-66de-4267-b493-5b0ae8510c58 service nova] Lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:46:37 user nova-compute[72444]: DEBUG nova.compute.manager [req-df80b5c4-02c9-43ed-8305-afa7a367fc6d req-168e9206-66de-4267-b493-5b0ae8510c58 service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] No waiting events found dispatching network-vif-plugged-d80e3248-9a8c-480d-b27a-a9f3abc7ce17 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:46:37 user nova-compute[72444]: WARNING nova.compute.manager [req-df80b5c4-02c9-43ed-8305-afa7a367fc6d req-168e9206-66de-4267-b493-5b0ae8510c58 service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Received unexpected event network-vif-plugged-d80e3248-9a8c-480d-b27a-a9f3abc7ce17 for instance with vm_state active and task_state None.
Aug 03 04:46:37 user nova-compute[72444]: DEBUG nova.compute.manager [req-df80b5c4-02c9-43ed-8305-afa7a367fc6d req-168e9206-66de-4267-b493-5b0ae8510c58 service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Received event network-vif-deleted-d80e3248-9a8c-480d-b27a-a9f3abc7ce17 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:46:37 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:46:39 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:46:39 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72444) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 03 04:46:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:40 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:46:41 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:46:41 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:46:41 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 04:46:42 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:46:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:46:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:46:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:46:42 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 04:46:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:46:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk.rescue --force-share --output=json" returned: 0 in 0.129s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:44 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:44 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:46:44 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:46:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26922d3f-0a2d-48d1-b758-9c87e0621fef/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26922d3f-0a2d-48d1-b758-9c87e0621fef/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26922d3f-0a2d-48d1-b758-9c87e0621fef/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26922d3f-0a2d-48d1-b758-9c87e0621fef/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:44 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:45 user nova-compute[72444]: DEBUG nova.compute.manager [req-d2b209df-344b-4ec4-a7e5-927a0ecf34ef req-ab6fc592-3528-41ad-9460-1cd722c2c274 service nova] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Received event network-changed-9e663e87-4907-4b83-9c78-22674d4fe471 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:46:45 user nova-compute[72444]: DEBUG nova.compute.manager [req-d2b209df-344b-4ec4-a7e5-927a0ecf34ef req-ab6fc592-3528-41ad-9460-1cd722c2c274 service nova] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Refreshing instance network info cache due to event network-changed-9e663e87-4907-4b83-9c78-22674d4fe471. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:46:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d2b209df-344b-4ec4-a7e5-927a0ecf34ef req-ab6fc592-3528-41ad-9460-1cd722c2c274 service nova] Acquiring lock "refresh_cache-26922d3f-0a2d-48d1-b758-9c87e0621fef" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:46:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d2b209df-344b-4ec4-a7e5-927a0ecf34ef req-ab6fc592-3528-41ad-9460-1cd722c2c274 service nova] Acquired lock "refresh_cache-26922d3f-0a2d-48d1-b758-9c87e0621fef" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:46:45 user nova-compute[72444]: DEBUG nova.network.neutron [req-d2b209df-344b-4ec4-a7e5-927a0ecf34ef req-ab6fc592-3528-41ad-9460-1cd722c2c274 service nova] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Refreshing network info cache for port 9e663e87-4907-4b83-9c78-22674d4fe471 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:46:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07450ea8-cb80-4318-9fc9-4268944d2cae/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07450ea8-cb80-4318-9fc9-4268944d2cae/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07450ea8-cb80-4318-9fc9-4268944d2cae/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07450ea8-cb80-4318-9fc9-4268944d2cae/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:45 user nova-compute[72444]: DEBUG nova.network.neutron [req-d2b209df-344b-4ec4-a7e5-927a0ecf34ef req-ab6fc592-3528-41ad-9460-1cd722c2c274 service nova] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Updated VIF entry in instance network info cache for port 9e663e87-4907-4b83-9c78-22674d4fe471. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:46:45 user nova-compute[72444]: DEBUG nova.network.neutron [req-d2b209df-344b-4ec4-a7e5-927a0ecf34ef req-ab6fc592-3528-41ad-9460-1cd722c2c274 service nova] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Updating instance_info_cache with network_info: [{"id": "9e663e87-4907-4b83-9c78-22674d4fe471", "address": "fa:16:3e:c9:2c:bd", "network": {"id": "dc891e23-2b3b-44ae-8110-60fe01fe5e24", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1956899419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ccbd62645f54327a2b8999dcd9736ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e663e87-49", "ovs_interfaceid": "9e663e87-4907-4b83-9c78-22674d4fe471", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:46:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d2b209df-344b-4ec4-a7e5-927a0ecf34ef req-ab6fc592-3528-41ad-9460-1cd722c2c274 service nova] Releasing lock "refresh_cache-26922d3f-0a2d-48d1-b758-9c87e0621fef" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:46:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:46:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f1a45af-977b-43e2-a7dd-7a9c402840d1/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f1a45af-977b-43e2-a7dd-7a9c402840d1/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f1a45af-977b-43e2-a7dd-7a9c402840d1/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f1a45af-977b-43e2-a7dd-7a9c402840d1/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbaa8179-1294-41ec-88cd-e23a568c5468/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbaa8179-1294-41ec-88cd-e23a568c5468/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbaa8179-1294-41ec-88cd-e23a568c5468/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbaa8179-1294-41ec-88cd-e23a568c5468/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:47 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:46:47 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:46:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=6911MB free_disk=25.599822998046875GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 04:46:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:46:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:46:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:46:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 81725845-6158-4e34-bedb-6e41219bc227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:46:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance b6ed9c42-fa6e-4a0d-8312-588471e157f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:46:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance e3089887-56df-42de-bc62-88e6db28daf0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:46:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance e2859322-6f99-442d-bee1-65fe49ce6360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:46:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 07450ea8-cb80-4318-9fc9-4268944d2cae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:46:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:46:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance ba7bd541-c761-4e4a-ac7c-7dd2cb89150d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:46:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:46:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 6f1a45af-977b-43e2-a7dd-7a9c402840d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:46:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 26922d3f-0a2d-48d1-b758-9c87e0621fef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:46:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance fbaa8179-1294-41ec-88cd-e23a568c5468 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:46:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 04:46:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 04:46:47 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Refreshing inventories for resource provider b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 03 04:46:47 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Updating ProviderTree inventory for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 03 04:46:47 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Updating inventory in ProviderTree for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 03 04:46:47 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Refreshing aggregate associations for resource provider b624a913-bb6b-4a17-8cd7-7b0950cff161, aggregates: None {{(pid=72444) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 03 04:46:47 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Refreshing trait associations for resource provider b624a913-bb6b-4a17-8cd7-7b0950cff161, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=72444) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 03 04:46:48 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:48 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:46:48 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:46:48 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 04:46:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.819s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:46:48 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:46:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Acquiring lock "26922d3f-0a2d-48d1-b758-9c87e0621fef" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:46:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "26922d3f-0a2d-48d1-b758-9c87e0621fef" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:46:48 user nova-compute[72444]: DEBUG nova.objects.instance [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lazy-loading 'flavor' on Instance uuid 26922d3f-0a2d-48d1-b758-9c87e0621fef {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:46:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "26922d3f-0a2d-48d1-b758-9c87e0621fef" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Acquiring lock "26922d3f-0a2d-48d1-b758-9c87e0621fef" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "26922d3f-0a2d-48d1-b758-9c87e0621fef" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:46:49 user nova-compute[72444]: INFO nova.compute.manager [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Attaching volume c7fba03c-28c4-46ff-81b4-709a5834fe06 to /dev/vdb
Aug 03 04:46:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG os_brick.utils [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[889e162e-ce1a-4728-a1f5-69f60c6d4af1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0142610-414a-49fd-a297-5aaf9748e8eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef69a62-07fb-460f-8d50-7f70a322c7fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f21c951-cce9-4991-ba0a-226584ecc4e4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:46:49 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 04:46:49 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[303ba7c6-fd3a-42fa-95ed-c8d564c035c6]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG os_brick.utils [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Updating existing volume attachment record: 504143fb-87d3-4ea3-bce6-7bef5b993666 {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Acquiring lock "ba7bd541-c761-4e4a-ac7c-7dd2cb89150d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "ba7bd541-c761-4e4a-ac7c-7dd2cb89150d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Acquiring lock "ba7bd541-c761-4e4a-ac7c-7dd2cb89150d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "ba7bd541-c761-4e4a-ac7c-7dd2cb89150d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "ba7bd541-c761-4e4a-ac7c-7dd2cb89150d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:46:49 user nova-compute[72444]: INFO nova.compute.manager [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Terminating instance
Aug 03 04:46:49 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG nova.compute.manager [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-07450ea8-cb80-4318-9fc9-4268944d2cae" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-07450ea8-cb80-4318-9fc9-4268944d2cae" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG nova.compute.manager [req-8b53b779-4276-4fd5-975f-1759a7009fc6 req-2ef9d293-4ad5-4f5d-a1e5-198be176f631 service nova] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Received event network-vif-unplugged-5e00edc4-284f-4e60-b3f6-75ab3df268dc {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8b53b779-4276-4fd5-975f-1759a7009fc6 req-2ef9d293-4ad5-4f5d-a1e5-198be176f631 service nova] Acquiring lock "ba7bd541-c761-4e4a-ac7c-7dd2cb89150d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8b53b779-4276-4fd5-975f-1759a7009fc6 req-2ef9d293-4ad5-4f5d-a1e5-198be176f631 service nova] Lock "ba7bd541-c761-4e4a-ac7c-7dd2cb89150d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8b53b779-4276-4fd5-975f-1759a7009fc6 req-2ef9d293-4ad5-4f5d-a1e5-198be176f631 service nova] Lock "ba7bd541-c761-4e4a-ac7c-7dd2cb89150d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG nova.compute.manager [req-8b53b779-4276-4fd5-975f-1759a7009fc6 req-2ef9d293-4ad5-4f5d-a1e5-198be176f631 service nova] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] No waiting events found dispatching network-vif-unplugged-5e00edc4-284f-4e60-b3f6-75ab3df268dc {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG nova.compute.manager [req-8b53b779-4276-4fd5-975f-1759a7009fc6 req-2ef9d293-4ad5-4f5d-a1e5-198be176f631 service nova] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Received event network-vif-unplugged-5e00edc4-284f-4e60-b3f6-75ab3df268dc for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:46:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:50 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Instance destroyed successfully.
Aug 03 04:46:50 user nova-compute[72444]: DEBUG nova.objects.instance [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lazy-loading 'resources' on Instance uuid ba7bd541-c761-4e4a-ac7c-7dd2cb89150d {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-03T04:43:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1766085163',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1380099260',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxWTXqS2gTOwwksDvDA82ZhKXb+8OJ2l8zmonKnC8DV5DMkdpimVA0a9LAiDqgbZc2C7mTSh4D9lL13WOlFB3MFWXZFbpJsJYQhGkVl7O5aTGjbtLXsvFxHqIp9QmPVeg==',key_name='tempest-keypair-15472896',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:45:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6037670c8c6450bb3663e55b50c6dd5',ramdisk_id='',reservation_id='r-91lxwkqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-780888408',owner_user_name='tempest-ServerActionsV293TestJSON-780888408-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:45:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6837fb4f8f04f38a0e429d8905eae54',uuid=ba7bd541-c761-4e4a-ac7c-7dd2cb89150d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e00edc4-284f-4e60-b3f6-75ab3df268dc", "address": "fa:16:3e:49:68:54", "network": {"id": "f0b4a33e-e079-4817-8747-412ca56818fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1198621443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6037670c8c6450bb3663e55b50c6dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e00edc4-28", "ovs_interfaceid": "5e00edc4-284f-4e60-b3f6-75ab3df268dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Converting VIF {"id": "5e00edc4-284f-4e60-b3f6-75ab3df268dc", "address": "fa:16:3e:49:68:54", "network": {"id": "f0b4a33e-e079-4817-8747-412ca56818fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1198621443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6037670c8c6450bb3663e55b50c6dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e00edc4-28", "ovs_interfaceid": "5e00edc4-284f-4e60-b3f6-75ab3df268dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:68:54,bridge_name='br-int',has_traffic_filtering=True,id=5e00edc4-284f-4e60-b3f6-75ab3df268dc,network=Network(f0b4a33e-e079-4817-8747-412ca56818fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e00edc4-28') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG os_vif [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:68:54,bridge_name='br-int',has_traffic_filtering=True,id=5e00edc4-284f-4e60-b3f6-75ab3df268dc,network=Network(f0b4a33e-e079-4817-8747-412ca56818fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e00edc4-28') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e00edc4-28, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:46:50 user nova-compute[72444]: INFO os_vif [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:68:54,bridge_name='br-int',has_traffic_filtering=True,id=5e00edc4-284f-4e60-b3f6-75ab3df268dc,network=Network(f0b4a33e-e079-4817-8747-412ca56818fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e00edc4-28')
Aug 03 04:46:50 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'voVSHFml', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:46:50 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:46:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3796ed23-d977-45e1-ab53-431b9ca43b7a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[afda9bc5-2772-4715-ab02-fdacdceb34bc]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:46:50 user nova-compute[72444]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)
Aug 03 04:46:50 user nova-compute[72444]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:46:50 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:46:50 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:46:50 user nova-compute[72444]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)
Aug 03 04:46:50 user nova-compute[72444]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd (non-flash)
Aug 03 04:46:50 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:46:50 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308c5e6f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd'): ({'sdd'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Removing single pathed devices sdd {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31aae25-e431-48a5-a12f-807c746dae95]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[02dfc8c4-ee86-4230-8a27-d06cd745a40d]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Flushing IO for device /dev/sdd {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8117d937-5cc4-4b24-94f5-ebd980b3efc6]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8f615f-62f4-4dc5-a82b-296851a29e14]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] SCSI volumes sdd have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe0635142-53209036f66251e2', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e0635142', '/dev/disk/by-id/scsi-23533323039303336') {{(pid=84280) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e236aebb-3b6e-48c4-a721-9cea4b343e63]: (4, None) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b52d15-5d58-46c5-bb10-80d055a1c2ab]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dae2cb-2928-4664-8820-4915c0ec323b]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd, portal: 172.16.0.220,3260]
Aug 03 04:46:50 user nova-compute[72444]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd, portal: 172.16.0.220,3260] successful.
Aug 03 04:46:50 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd912dd-0923-470a-8a00-ee611de909cd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f0f551-072e-436d-856f-0430e4741c80]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] <== disconnect_volume: return (332ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:46:50 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Deleting instance files /opt/stack/data/nova/instances/ba7bd541-c761-4e4a-ac7c-7dd2cb89150d_del
Aug 03 04:46:50 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Deletion of /opt/stack/data/nova/instances/ba7bd541-c761-4e4a-ac7c-7dd2cb89150d_del complete
Aug 03 04:46:50 user nova-compute[72444]: INFO nova.compute.manager [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Took 1.30 seconds to destroy the instance on the hypervisor.
Aug 03 04:46:50 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Updating instance_info_cache with network_info: [{"id": "fcb29ef9-b342-48cf-9fab-165ea205728f", "address": "fa:16:3e:26:71:73", "network": {"id": "f0b4a33e-e079-4817-8747-412ca56818fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1198621443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6037670c8c6450bb3663e55b50c6dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb29ef9-b3", "ovs_interfaceid": "fcb29ef9-b342-48cf-9fab-165ea205728f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-07450ea8-cb80-4318-9fc9-4268944d2cae" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:46:50 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:46:51 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:46:51 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Took 0.90 seconds to deallocate network for instance.
Aug 03 04:46:51 user nova-compute[72444]: DEBUG nova.compute.manager [req-3dbbc66e-3b17-4d3d-ba1c-e15f0e3a6b7f req-f3933b9d-1589-4f5e-8075-80ff8a8006d7 service nova] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Received event network-vif-plugged-5e00edc4-284f-4e60-b3f6-75ab3df268dc {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:46:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3dbbc66e-3b17-4d3d-ba1c-e15f0e3a6b7f req-f3933b9d-1589-4f5e-8075-80ff8a8006d7 service nova] Acquiring lock "ba7bd541-c761-4e4a-ac7c-7dd2cb89150d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:46:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3dbbc66e-3b17-4d3d-ba1c-e15f0e3a6b7f req-f3933b9d-1589-4f5e-8075-80ff8a8006d7 service nova] Lock "ba7bd541-c761-4e4a-ac7c-7dd2cb89150d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:46:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3dbbc66e-3b17-4d3d-ba1c-e15f0e3a6b7f req-f3933b9d-1589-4f5e-8075-80ff8a8006d7 service nova] Lock "ba7bd541-c761-4e4a-ac7c-7dd2cb89150d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:46:51 user nova-compute[72444]: DEBUG nova.compute.manager [req-3dbbc66e-3b17-4d3d-ba1c-e15f0e3a6b7f req-f3933b9d-1589-4f5e-8075-80ff8a8006d7 service nova] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] No waiting events found dispatching network-vif-plugged-5e00edc4-284f-4e60-b3f6-75ab3df268dc {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:46:51 user nova-compute[72444]: WARNING nova.compute.manager [req-3dbbc66e-3b17-4d3d-ba1c-e15f0e3a6b7f req-f3933b9d-1589-4f5e-8075-80ff8a8006d7 service nova] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Received unexpected event network-vif-plugged-5e00edc4-284f-4e60-b3f6-75ab3df268dc for instance with vm_state active and task_state deleting.
Aug 03 04:46:51 user nova-compute[72444]: DEBUG nova.compute.manager [req-3dbbc66e-3b17-4d3d-ba1c-e15f0e3a6b7f req-f3933b9d-1589-4f5e-8075-80ff8a8006d7 service nova] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Received event network-vif-deleted-5e00edc4-284f-4e60-b3f6-75ab3df268dc {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:46:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9712accc-ee34-4080-bc44-f7dc3d141f10 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:46:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9712accc-ee34-4080-bc44-f7dc3d141f10 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:46:53 user nova-compute[72444]: INFO nova.compute.manager [None req-9712accc-ee34-4080-bc44-f7dc3d141f10 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Detaching volume cd7ca08c-42db-4007-a06b-e327179ac574
Aug 03 04:46:53 user nova-compute[72444]: INFO nova.virt.block_device [None req-9712accc-ee34-4080-bc44-f7dc3d141f10 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Attempting to driver detach volume cd7ca08c-42db-4007-a06b-e327179ac574 from mountpoint /dev/vdb
Aug 03 04:46:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9712accc-ee34-4080-bc44-f7dc3d141f10 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Attempting to detach device vdb from instance 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 from the persistent domain config. {{(pid=72444) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 04:46:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-9712accc-ee34-4080-bc44-f7dc3d141f10 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 04:46:53 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:46:53 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 04:46:53 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:46:53 user nova-compute[72444]:   <serial>cd7ca08c-42db-4007-a06b-e327179ac574</serial>
Aug 03 04:46:53 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 03 04:46:53 user nova-compute[72444]: </disk>
Aug 03 04:46:53 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:46:53 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-9712accc-ee34-4080-bc44-f7dc3d141f10 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Successfully detached device vdb from instance 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 from the persistent domain config.
Aug 03 04:46:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9712accc-ee34-4080-bc44-f7dc3d141f10 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 from the live domain config. {{(pid=72444) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 04:46:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-9712accc-ee34-4080-bc44-f7dc3d141f10 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 04:46:53 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:46:53 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 04:46:53 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:46:53 user nova-compute[72444]:   <serial>cd7ca08c-42db-4007-a06b-e327179ac574</serial>
Aug 03 04:46:53 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 03 04:46:53 user nova-compute[72444]: </disk>
Aug 03 04:46:53 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:46:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Received event <DeviceRemovedEvent: 1691038013.932462, 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72444) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 04:46:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9712accc-ee34-4080-bc44-f7dc3d141f10 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 {{(pid=72444) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 04:46:53 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-9712accc-ee34-4080-bc44-f7dc3d141f10 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Successfully detached device vdb from instance 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 from the live domain config.
Aug 03 04:46:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9712accc-ee34-4080-bc44-f7dc3d141f10 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:46:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9712accc-ee34-4080-bc44-f7dc3d141f10 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiwnchLG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:46:53 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-9712accc-ee34-4080-bc44-f7dc3d141f10 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:46:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-9712accc-ee34-4080-bc44-f7dc3d141f10 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:46:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-9712accc-ee34-4080-bc44-f7dc3d141f10 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:46:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9712accc-ee34-4080-bc44-f7dc3d141f10 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:46:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50e09c0-10ab-4648-87aa-1a26575eabb4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:54 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[230e1b40-562d-4687-b07c-947201d13115]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9712accc-ee34-4080-bc44-f7dc3d141f10 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:46:54 user nova-compute[72444]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)
Aug 03 04:46:54 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:46:54 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:46:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9712accc-ee34-4080-bc44-f7dc3d141f10 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 (non-flash)
Aug 03 04:46:54 user nova-compute[72444]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)
Aug 03 04:46:54 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:46:54 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:46:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9712accc-ee34-4080-bc44-f7dc3d141f10 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308c47bd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574'): ({'sdb'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:46:54 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-9712accc-ee34-4080-bc44-f7dc3d141f10 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Removing single pathed devices sdb {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 04:46:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:54 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3bf8cd-9f41-4e8f-baa7-5098e209337a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:54 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee165a06-6897-401b-8fe1-359725b5ceb7]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:54 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-9712accc-ee34-4080-bc44-f7dc3d141f10 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Flushing IO for device /dev/sdb {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 04:46:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:54 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb471527-96bb-432e-93e0-16adce1bc033]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:54 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-9712accc-ee34-4080-bc44-f7dc3d141f10 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 04:46:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:54 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c009bf83-459f-44e9-9314-144ccb131631]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:54 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-9712accc-ee34-4080-bc44-f7dc3d141f10 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 04:46:54 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-9712accc-ee34-4080-bc44-f7dc3d141f10 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 04:46:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9712accc-ee34-4080-bc44-f7dc3d141f10 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:46:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:54 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37b63e5-8c61-4409-b78a-32533e4d1aee]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9712accc-ee34-4080-bc44-f7dc3d141f10 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:46:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:54 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[92192465-a1d0-4d94-8a3a-d333f1b0d00a]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9712accc-ee34-4080-bc44-f7dc3d141f10 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574, portal: 172.16.0.220,3260]
Aug 03 04:46:54 user nova-compute[72444]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574, portal: 172.16.0.220,3260] successful.
Aug 03 04:46:54 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:46:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7ca08c-42db-4007-a06b-e327179ac574 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:54 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca372152-1e53-44f8-9471-db9984ac767d]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9712accc-ee34-4080-bc44-f7dc3d141f10 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:46:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-9712accc-ee34-4080-bc44-f7dc3d141f10 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:46:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9712accc-ee34-4080-bc44-f7dc3d141f10 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] <== disconnect_volume: return (285ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:46:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9712accc-ee34-4080-bc44-f7dc3d141f10 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:46:54 user nova-compute[72444]: INFO nova.compute.manager [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Took 3.21 seconds to detach 1 volumes for instance.
Aug 03 04:46:54 user nova-compute[72444]: DEBUG nova.compute.manager [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Deleting volume: fbd912dd-0923-470a-8a00-ee611de909cd {{(pid=72444) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 03 04:46:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:46:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:46:55 user nova-compute[72444]: DEBUG nova.objects.instance [None req-9712accc-ee34-4080-bc44-f7dc3d141f10 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lazy-loading 'flavor' on Instance uuid 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:46:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9712accc-ee34-4080-bc44-f7dc3d141f10 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.837s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:46:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:55 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:46:55 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:46:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.513s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:46:55 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Deleted allocations for instance ba7bd541-c761-4e4a-ac7c-7dd2cb89150d
Aug 03 04:46:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-69b6b8fc-c6bc-4e48-9825-6dc3ad8b6992 tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "ba7bd541-c761-4e4a-ac7c-7dd2cb89150d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.336s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:46:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-034ea498-81e6-43fd-b589-3954a7db13b8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:46:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-034ea498-81e6-43fd-b589-3954a7db13b8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:46:56 user nova-compute[72444]: DEBUG nova.compute.manager [None req-034ea498-81e6-43fd-b589-3954a7db13b8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:46:56 user nova-compute[72444]: DEBUG nova.compute.manager [None req-034ea498-81e6-43fd-b589-3954a7db13b8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72444) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 03 04:46:56 user nova-compute[72444]: DEBUG nova.objects.instance [None req-034ea498-81e6-43fd-b589-3954a7db13b8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lazy-loading 'flavor' on Instance uuid 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:46:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:56 user nova-compute[72444]: DEBUG nova.compute.manager [req-82f711c7-7029-4b60-aea9-f7b00304ae71 req-a73479d5-d3db-4a6c-9bcf-9e8d6110b17c service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Received event network-vif-unplugged-841a11a2-ffb3-44cf-9e15-c8099578d405 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:46:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-82f711c7-7029-4b60-aea9-f7b00304ae71 req-a73479d5-d3db-4a6c-9bcf-9e8d6110b17c service nova] Acquiring lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:46:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-82f711c7-7029-4b60-aea9-f7b00304ae71 req-a73479d5-d3db-4a6c-9bcf-9e8d6110b17c service nova] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:46:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-82f711c7-7029-4b60-aea9-f7b00304ae71 req-a73479d5-d3db-4a6c-9bcf-9e8d6110b17c service nova] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:46:56 user nova-compute[72444]: DEBUG nova.compute.manager [req-82f711c7-7029-4b60-aea9-f7b00304ae71 req-a73479d5-d3db-4a6c-9bcf-9e8d6110b17c service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] No waiting events found dispatching network-vif-unplugged-841a11a2-ffb3-44cf-9e15-c8099578d405 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:46:56 user nova-compute[72444]: WARNING nova.compute.manager [req-82f711c7-7029-4b60-aea9-f7b00304ae71 req-a73479d5-d3db-4a6c-9bcf-9e8d6110b17c service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Received unexpected event network-vif-unplugged-841a11a2-ffb3-44cf-9e15-c8099578d405 for instance with vm_state active and task_state powering-off.
Aug 03 04:46:56 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Instance destroyed successfully.
Aug 03 04:46:56 user nova-compute[72444]: DEBUG nova.compute.manager [None req-034ea498-81e6-43fd-b589-3954a7db13b8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:46:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-034ea498-81e6-43fd-b589-3954a7db13b8 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.883s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:46:57 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kuPjwvpy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:46:58 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:46:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:46:58 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:46:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:46:58 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:46:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4c89a0-70a2-4297-9ce3-dc34a31c8481]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 04:46:58 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06 -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f62a1e-93bc-43b6-984a-1b587cd4a95a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06] added
Aug 03 04:46:58 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[344935bd-efe7-4ff6-9b9e-d8d7b1c38ce1]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[07761f80-bc9b-4166-a197-92532436fc11]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kuPjwvpy {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kuPjwvpy" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d4e888-4c68-47f9-b777-f46041f93c12]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kuPjwvpy'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6779cf56-4a71-4e80-9d16-272654e3c442]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[feeab29a-1fa0-406b-886a-0149ce859582]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)
Aug 03 04:46:58 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:46:58 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)
Aug 03 04:46:58 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:46:58 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06 -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[383513bb-c502-414f-b455-f65fb327a602]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06, portal: 172.16.0.220,3260]
Aug 03 04:46:58 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06, portal: 172.16.0.220,3260] successful.
Aug 03 04:46:58 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fa4f79-5f8c-4438-b470-1dc1b2e87147]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a6271c-cfff-4d7f-9fe2-6616cd7571a3]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)
Aug 03 04:46:58 user nova-compute[72444]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06 (non-flash)
Aug 03 04:46:58 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:46:58 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)
Aug 03 04:46:58 user nova-compute[72444]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06 (non-flash)
Aug 03 04:46:58 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:46:58 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.046s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c672d1ef-2314-44e5-bf0a-81dabf84728d]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kuPjwvpy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG nova.compute.manager [req-2cb5e030-6d2c-4f0b-a413-d69bfc21578a req-af6c0133-a4d9-4b17-b765-ed9381f8e96a service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Received event network-vif-plugged-841a11a2-ffb3-44cf-9e15-c8099578d405 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2cb5e030-6d2c-4f0b-a413-d69bfc21578a req-af6c0133-a4d9-4b17-b765-ed9381f8e96a service nova] Acquiring lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2cb5e030-6d2c-4f0b-a413-d69bfc21578a req-af6c0133-a4d9-4b17-b765-ed9381f8e96a service nova] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2cb5e030-6d2c-4f0b-a413-d69bfc21578a req-af6c0133-a4d9-4b17-b765-ed9381f8e96a service nova] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:46:58 user nova-compute[72444]: DEBUG nova.compute.manager [req-2cb5e030-6d2c-4f0b-a413-d69bfc21578a req-af6c0133-a4d9-4b17-b765-ed9381f8e96a service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] No waiting events found dispatching network-vif-plugged-841a11a2-ffb3-44cf-9e15-c8099578d405 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:46:58 user nova-compute[72444]: WARNING nova.compute.manager [req-2cb5e030-6d2c-4f0b-a413-d69bfc21578a req-af6c0133-a4d9-4b17-b765-ed9381f8e96a service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Received unexpected event network-vif-plugged-841a11a2-ffb3-44cf-9e15-c8099578d405 for instance with vm_state stopped and task_state None.
Aug 03 04:46:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:46:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:46:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '26133663537393538', 'path': '/dev/sdb'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:46:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133663537393538', 'path': '/dev/sdb'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:46:59 user nova-compute[72444]: DEBUG nova.objects.instance [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lazy-loading 'flavor' on Instance uuid 26922d3f-0a2d-48d1-b758-9c87e0621fef {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:46:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 04:46:59 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:46:59 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 04:46:59 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:46:59 user nova-compute[72444]:   <serial>c7fba03c-28c4-46ff-81b4-709a5834fe06</serial>
Aug 03 04:46:59 user nova-compute[72444]: </disk>
Aug 03 04:46:59 user nova-compute[72444]:  {{(pid=72444) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 04:46:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:46:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:46:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] No VIF found with MAC fa:16:3e:c9:2c:bd, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:47:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-61ef300c-59da-45d8-9e4d-8084a20a628e tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "26922d3f-0a2d-48d1-b758-9c87e0621fef" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.973s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e6471542-bab8-4fe4-af3a-1b175c5dacbd tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Acquiring lock "26922d3f-0a2d-48d1-b758-9c87e0621fef" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e6471542-bab8-4fe4-af3a-1b175c5dacbd tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "26922d3f-0a2d-48d1-b758-9c87e0621fef" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:01 user nova-compute[72444]: INFO nova.compute.manager [None req-e6471542-bab8-4fe4-af3a-1b175c5dacbd tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Detaching volume c7fba03c-28c4-46ff-81b4-709a5834fe06
Aug 03 04:47:01 user nova-compute[72444]: INFO nova.virt.block_device [None req-e6471542-bab8-4fe4-af3a-1b175c5dacbd tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Attempting to driver detach volume c7fba03c-28c4-46ff-81b4-709a5834fe06 from mountpoint /dev/vdb
Aug 03 04:47:01 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e6471542-bab8-4fe4-af3a-1b175c5dacbd tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Attempting to detach device vdb from instance 26922d3f-0a2d-48d1-b758-9c87e0621fef from the persistent domain config. {{(pid=72444) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-e6471542-bab8-4fe4-af3a-1b175c5dacbd tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 04:47:01 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:47:01 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 04:47:01 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:47:01 user nova-compute[72444]:   <serial>c7fba03c-28c4-46ff-81b4-709a5834fe06</serial>
Aug 03 04:47:01 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 04:47:01 user nova-compute[72444]: </disk>
Aug 03 04:47:01 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:47:01 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-e6471542-bab8-4fe4-af3a-1b175c5dacbd tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Successfully detached device vdb from instance 26922d3f-0a2d-48d1-b758-9c87e0621fef from the persistent domain config.
Aug 03 04:47:01 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e6471542-bab8-4fe4-af3a-1b175c5dacbd tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 26922d3f-0a2d-48d1-b758-9c87e0621fef from the live domain config. {{(pid=72444) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-e6471542-bab8-4fe4-af3a-1b175c5dacbd tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 04:47:01 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:47:01 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 04:47:01 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:47:01 user nova-compute[72444]:   <serial>c7fba03c-28c4-46ff-81b4-709a5834fe06</serial>
Aug 03 04:47:01 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 04:47:01 user nova-compute[72444]: </disk>
Aug 03 04:47:01 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Acquiring lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG nova.compute.manager [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 04:47:01 user nova-compute[72444]: INFO nova.compute.claims [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Claim successful on node user
Aug 03 04:47:01 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Received event <DeviceRemovedEvent: 1691038021.681283, 26922d3f-0a2d-48d1-b758-9c87e0621fef => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72444) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e6471542-bab8-4fe4-af3a-1b175c5dacbd tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 26922d3f-0a2d-48d1-b758-9c87e0621fef {{(pid=72444) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 04:47:01 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-e6471542-bab8-4fe4-af3a-1b175c5dacbd tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Successfully detached device vdb from instance 26922d3f-0a2d-48d1-b758-9c87e0621fef from the live domain config.
Aug 03 04:47:01 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6471542-bab8-4fe4-af3a-1b175c5dacbd tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6471542-bab8-4fe4-af3a-1b175c5dacbd tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kuPjwvpy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:47:01 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-e6471542-bab8-4fe4-af3a-1b175c5dacbd tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:47:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e6471542-bab8-4fe4-af3a-1b175c5dacbd tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e6471542-bab8-4fe4-af3a-1b175c5dacbd tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6471542-bab8-4fe4-af3a-1b175c5dacbd tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc13e574-fc08-41c6-9091-a46c0adad638]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdfb763-8f61-48d1-9061-b1fe36d1872a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6471542-bab8-4fe4-af3a-1b175c5dacbd tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)
Aug 03 04:47:01 user nova-compute[72444]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06 (non-flash)
Aug 03 04:47:01 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:47:01 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6471542-bab8-4fe4-af3a-1b175c5dacbd tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)
Aug 03 04:47:01 user nova-compute[72444]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06 (non-flash)
Aug 03 04:47:01 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:47:01 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6471542-bab8-4fe4-af3a-1b175c5dacbd tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308c47b2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06'): ({'sdb'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-e6471542-bab8-4fe4-af3a-1b175c5dacbd tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Removing single pathed devices sdb {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df73185-60db-48b8-8c01-4a742633277c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c976ada-9f51-4a7b-8012-820560d70528]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-e6471542-bab8-4fe4-af3a-1b175c5dacbd tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Flushing IO for device /dev/sdb {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42f2633-499f-4fa7-8c9d-e2fe52db1bb6]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-e6471542-bab8-4fe4-af3a-1b175c5dacbd tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6852a6-ba72-4459-abf4-e9ec9021e1b7]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-e6471542-bab8-4fe4-af3a-1b175c5dacbd tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-e6471542-bab8-4fe4-af3a-1b175c5dacbd tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6471542-bab8-4fe4-af3a-1b175c5dacbd tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f413c1-6cc7-4290-9099-af5afe2ea708]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6471542-bab8-4fe4-af3a-1b175c5dacbd tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06 -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbf22d6-e65c-4fea-bdb0-f72c3e6b2694]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6471542-bab8-4fe4-af3a-1b175c5dacbd tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06, portal: 172.16.0.220,3260]
Aug 03 04:47:01 user nova-compute[72444]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06, portal: 172.16.0.220,3260] successful.
Aug 03 04:47:01 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06 -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7fba03c-28c4-46ff-81b4-709a5834fe06 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36c1359-f8a7-41f4-a660-4865c60d3b59]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6471542-bab8-4fe4-af3a-1b175c5dacbd tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e6471542-bab8-4fe4-af3a-1b175c5dacbd tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6471542-bab8-4fe4-af3a-1b175c5dacbd tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] <== disconnect_volume: return (306ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:47:01 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6471542-bab8-4fe4-af3a-1b175c5dacbd tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:47:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.490s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:02 user nova-compute[72444]: DEBUG nova.compute.manager [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 04:47:02 user nova-compute[72444]: DEBUG nova.compute.manager [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 04:47:02 user nova-compute[72444]: DEBUG nova.network.neutron [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 04:47:02 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 04:47:02 user nova-compute[72444]: DEBUG nova.compute.manager [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 04:47:02 user nova-compute[72444]: DEBUG nova.policy [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '32bdd12ab0a24dc8a73dfa25cd5ff897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256e3a45110d4bc683f3a9b6c250e522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 04:47:02 user nova-compute[72444]: DEBUG nova.compute.manager [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 04:47:02 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 04:47:02 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Creating image(s)
Aug 03 04:47:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Acquiring lock "/opt/stack/data/nova/instances/1baadfd2-6f00-436b-b3a0-c850cd8cb50e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "/opt/stack/data/nova/instances/1baadfd2-6f00-436b-b3a0-c850cd8cb50e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "/opt/stack/data/nova/instances/1baadfd2-6f00-436b-b3a0-c850cd8cb50e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.148s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.135s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/1baadfd2-6f00-436b-b3a0-c850cd8cb50e/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/1baadfd2-6f00-436b-b3a0-c850cd8cb50e/disk 1073741824" returned: 0 in 0.051s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.148s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:02 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1baadfd2-6f00-436b-b3a0-c850cd8cb50e/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 04:47:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1baadfd2-6f00-436b-b3a0-c850cd8cb50e/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:02 user nova-compute[72444]: DEBUG nova.objects.instance [None req-e6471542-bab8-4fe4-af3a-1b175c5dacbd tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lazy-loading 'flavor' on Instance uuid 26922d3f-0a2d-48d1-b758-9c87e0621fef {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:47:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e6471542-bab8-4fe4-af3a-1b175c5dacbd tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "26922d3f-0a2d-48d1-b758-9c87e0621fef" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.712s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1baadfd2-6f00-436b-b3a0-c850cd8cb50e/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:02 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Cannot resize image /opt/stack/data/nova/instances/1baadfd2-6f00-436b-b3a0-c850cd8cb50e/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 04:47:02 user nova-compute[72444]: DEBUG nova.objects.instance [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lazy-loading 'migration_context' on Instance uuid 1baadfd2-6f00-436b-b3a0-c850cd8cb50e {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:47:02 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 04:47:02 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Ensure instance console log exists: /opt/stack/data/nova/instances/1baadfd2-6f00-436b-b3a0-c850cd8cb50e/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 04:47:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:03 user nova-compute[72444]: DEBUG nova.network.neutron [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Successfully created port: 2f55f137-3b34-49a7-a77c-e03f9c263c43 {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:47:03 user nova-compute[72444]: DEBUG nova.network.neutron [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Successfully updated port: 2f55f137-3b34-49a7-a77c-e03f9c263c43 {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:47:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Acquiring lock "refresh_cache-1baadfd2-6f00-436b-b3a0-c850cd8cb50e" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:47:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Acquired lock "refresh_cache-1baadfd2-6f00-436b-b3a0-c850cd8cb50e" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:47:03 user nova-compute[72444]: DEBUG nova.network.neutron [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:47:03 user nova-compute[72444]: DEBUG nova.compute.manager [req-793dd5a4-3bf7-49c9-8ef3-bf2380bae3e0 req-ba1078a2-5260-4753-9de8-bad9eacb4a4b service nova] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Received event network-changed-2f55f137-3b34-49a7-a77c-e03f9c263c43 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:47:03 user nova-compute[72444]: DEBUG nova.compute.manager [req-793dd5a4-3bf7-49c9-8ef3-bf2380bae3e0 req-ba1078a2-5260-4753-9de8-bad9eacb4a4b service nova] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Refreshing instance network info cache due to event network-changed-2f55f137-3b34-49a7-a77c-e03f9c263c43. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:47:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-793dd5a4-3bf7-49c9-8ef3-bf2380bae3e0 req-ba1078a2-5260-4753-9de8-bad9eacb4a4b service nova] Acquiring lock "refresh_cache-1baadfd2-6f00-436b-b3a0-c850cd8cb50e" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:47:03 user nova-compute[72444]: DEBUG nova.network.neutron [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG nova.network.neutron [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Updating instance_info_cache with network_info: [{"id": "2f55f137-3b34-49a7-a77c-e03f9c263c43", "address": "fa:16:3e:cc:5c:79", "network": {"id": "66fcf59b-a2bc-4a34-a881-bf1534ba9e3f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1260837866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256e3a45110d4bc683f3a9b6c250e522", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f55f137-3b", "ovs_interfaceid": "2f55f137-3b34-49a7-a77c-e03f9c263c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Releasing lock "refresh_cache-1baadfd2-6f00-436b-b3a0-c850cd8cb50e" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG nova.compute.manager [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Instance network_info: |[{"id": "2f55f137-3b34-49a7-a77c-e03f9c263c43", "address": "fa:16:3e:cc:5c:79", "network": {"id": "66fcf59b-a2bc-4a34-a881-bf1534ba9e3f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1260837866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256e3a45110d4bc683f3a9b6c250e522", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f55f137-3b", "ovs_interfaceid": "2f55f137-3b34-49a7-a77c-e03f9c263c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-793dd5a4-3bf7-49c9-8ef3-bf2380bae3e0 req-ba1078a2-5260-4753-9de8-bad9eacb4a4b service nova] Acquired lock "refresh_cache-1baadfd2-6f00-436b-b3a0-c850cd8cb50e" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG nova.network.neutron [req-793dd5a4-3bf7-49c9-8ef3-bf2380bae3e0 req-ba1078a2-5260-4753-9de8-bad9eacb4a4b service nova] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Refreshing network info cache for port 2f55f137-3b34-49a7-a77c-e03f9c263c43 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Start _get_guest_xml network_info=[{"id": "2f55f137-3b34-49a7-a77c-e03f9c263c43", "address": "fa:16:3e:cc:5c:79", "network": {"id": "66fcf59b-a2bc-4a34-a881-bf1534ba9e3f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1260837866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256e3a45110d4bc683f3a9b6c250e522", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f55f137-3b", "ovs_interfaceid": "2f55f137-3b34-49a7-a77c-e03f9c263c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:47:04 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:47:04 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:47:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1795304975',display_name='tempest-TestServerVolumeAttachmentScenario-server-1795304975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1795304975',id=19,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcIeWQ23qVXo8uHBHWnIULq/798lNFk4fXZB1/+eSMAsA9mwaVg2e6zTvNvK4YJBidbB08SWCZsgGxqJ3sFMO2d02iw85yUmRreVMcUeZ2B+crihthXQdW4rtFyXsAMFA==',key_name='tempest-keypair-1894885333',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='256e3a45110d4bc683f3a9b6c250e522',ramdisk_id='',reservation_id='r-ysranctw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-511083576',owner_user_name='tempest-TestServerVolumeAttachmentScenario-511083576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:47:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32bdd12ab0a24dc8a73dfa25cd5ff897',uuid=1baadfd2-6f00-436b-b3a0-c850cd8cb50e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f55f137-3b34-49a7-a77c-e03f9c263c43", "address": "fa:16:3e:cc:5c:79", "network": {"id": "66fcf59b-a2bc-4a34-a881-bf1534ba9e3f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1260837866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256e3a45110d4bc683f3a9b6c250e522", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f55f137-3b", "ovs_interfaceid": "2f55f137-3b34-49a7-a77c-e03f9c263c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Converting VIF {"id": "2f55f137-3b34-49a7-a77c-e03f9c263c43", "address": "fa:16:3e:cc:5c:79", "network": {"id": "66fcf59b-a2bc-4a34-a881-bf1534ba9e3f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1260837866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256e3a45110d4bc683f3a9b6c250e522", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f55f137-3b", "ovs_interfaceid": "2f55f137-3b34-49a7-a77c-e03f9c263c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:5c:79,bridge_name='br-int',has_traffic_filtering=True,id=2f55f137-3b34-49a7-a77c-e03f9c263c43,network=Network(66fcf59b-a2bc-4a34-a881-bf1534ba9e3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f55f137-3b') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG nova.objects.instance [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lazy-loading 'pci_devices' on Instance uuid 1baadfd2-6f00-436b-b3a0-c850cd8cb50e {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:47:04 user nova-compute[72444]:   <uuid>1baadfd2-6f00-436b-b3a0-c850cd8cb50e</uuid>
Aug 03 04:47:04 user nova-compute[72444]:   <name>instance-00000013</name>
Aug 03 04:47:04 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:47:04 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:47:04 user nova-compute[72444]:   <metadata>
Aug 03 04:47:04 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:47:04 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:47:04 user nova-compute[72444]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1795304975</nova:name>
Aug 03 04:47:04 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:47:04</nova:creationTime>
Aug 03 04:47:04 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:47:04 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:47:04 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:47:04 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:47:04 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:47:04 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:47:04 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:47:04 user nova-compute[72444]:       <nova:owner>
Aug 03 04:47:04 user nova-compute[72444]:         <nova:user uuid="32bdd12ab0a24dc8a73dfa25cd5ff897">tempest-TestServerVolumeAttachmentScenario-511083576-project-member</nova:user>
Aug 03 04:47:04 user nova-compute[72444]:         <nova:project uuid="256e3a45110d4bc683f3a9b6c250e522">tempest-TestServerVolumeAttachmentScenario-511083576</nova:project>
Aug 03 04:47:04 user nova-compute[72444]:       </nova:owner>
Aug 03 04:47:04 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:47:04 user nova-compute[72444]:       <nova:ports>
Aug 03 04:47:04 user nova-compute[72444]:         <nova:port uuid="2f55f137-3b34-49a7-a77c-e03f9c263c43">
Aug 03 04:47:04 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 03 04:47:04 user nova-compute[72444]:         </nova:port>
Aug 03 04:47:04 user nova-compute[72444]:       </nova:ports>
Aug 03 04:47:04 user nova-compute[72444]:     </nova:instance>
Aug 03 04:47:04 user nova-compute[72444]:   </metadata>
Aug 03 04:47:04 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:47:04 user nova-compute[72444]:     <system>
Aug 03 04:47:04 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:47:04 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:47:04 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:47:04 user nova-compute[72444]:       <entry name="serial">1baadfd2-6f00-436b-b3a0-c850cd8cb50e</entry>
Aug 03 04:47:04 user nova-compute[72444]:       <entry name="uuid">1baadfd2-6f00-436b-b3a0-c850cd8cb50e</entry>
Aug 03 04:47:04 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:47:04 user nova-compute[72444]:     </system>
Aug 03 04:47:04 user nova-compute[72444]:   </sysinfo>
Aug 03 04:47:04 user nova-compute[72444]:   <os>
Aug 03 04:47:04 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:47:04 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:47:04 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:47:04 user nova-compute[72444]:   </os>
Aug 03 04:47:04 user nova-compute[72444]:   <features>
Aug 03 04:47:04 user nova-compute[72444]:     <acpi/>
Aug 03 04:47:04 user nova-compute[72444]:     <apic/>
Aug 03 04:47:04 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:47:04 user nova-compute[72444]:   </features>
Aug 03 04:47:04 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:47:04 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:47:04 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:47:04 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:47:04 user nova-compute[72444]:   </clock>
Aug 03 04:47:04 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:47:04 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:47:04 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:47:04 user nova-compute[72444]:   </cpu>
Aug 03 04:47:04 user nova-compute[72444]:   <devices>
Aug 03 04:47:04 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:47:04 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:47:04 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/1baadfd2-6f00-436b-b3a0-c850cd8cb50e/disk"/>
Aug 03 04:47:04 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:47:04 user nova-compute[72444]:     </disk>
Aug 03 04:47:04 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:47:04 user nova-compute[72444]:       <mac address="fa:16:3e:cc:5c:79"/>
Aug 03 04:47:04 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:47:04 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:47:04 user nova-compute[72444]:       <target dev="tap2f55f137-3b"/>
Aug 03 04:47:04 user nova-compute[72444]:     </interface>
Aug 03 04:47:04 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:47:04 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/1baadfd2-6f00-436b-b3a0-c850cd8cb50e/console.log" append="off"/>
Aug 03 04:47:04 user nova-compute[72444]:     </serial>
Aug 03 04:47:04 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:47:04 user nova-compute[72444]:     <video>
Aug 03 04:47:04 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:47:04 user nova-compute[72444]:     </video>
Aug 03 04:47:04 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:47:04 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:47:04 user nova-compute[72444]:     </rng>
Aug 03 04:47:04 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:47:04 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:47:04 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:47:04 user nova-compute[72444]:     </memballoon>
Aug 03 04:47:04 user nova-compute[72444]:   </devices>
Aug 03 04:47:04 user nova-compute[72444]: </domain>
Aug 03 04:47:04 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1795304975',display_name='tempest-TestServerVolumeAttachmentScenario-server-1795304975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1795304975',id=19,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcIeWQ23qVXo8uHBHWnIULq/798lNFk4fXZB1/+eSMAsA9mwaVg2e6zTvNvK4YJBidbB08SWCZsgGxqJ3sFMO2d02iw85yUmRreVMcUeZ2B+crihthXQdW4rtFyXsAMFA==',key_name='tempest-keypair-1894885333',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='256e3a45110d4bc683f3a9b6c250e522',ramdisk_id='',reservation_id='r-ysranctw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-511083576',owner_user_name='tempest-TestServerVolumeAttachmentScenario-511083576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:47:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32bdd12ab0a24dc8a73dfa25cd5ff897',uuid=1baadfd2-6f00-436b-b3a0-c850cd8cb50e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f55f137-3b34-49a7-a77c-e03f9c263c43", "address": "fa:16:3e:cc:5c:79", "network": {"id": "66fcf59b-a2bc-4a34-a881-bf1534ba9e3f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1260837866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256e3a45110d4bc683f3a9b6c250e522", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f55f137-3b", "ovs_interfaceid": "2f55f137-3b34-49a7-a77c-e03f9c263c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Converting VIF {"id": "2f55f137-3b34-49a7-a77c-e03f9c263c43", "address": "fa:16:3e:cc:5c:79", "network": {"id": "66fcf59b-a2bc-4a34-a881-bf1534ba9e3f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1260837866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256e3a45110d4bc683f3a9b6c250e522", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f55f137-3b", "ovs_interfaceid": "2f55f137-3b34-49a7-a77c-e03f9c263c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:5c:79,bridge_name='br-int',has_traffic_filtering=True,id=2f55f137-3b34-49a7-a77c-e03f9c263c43,network=Network(66fcf59b-a2bc-4a34-a881-bf1534ba9e3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f55f137-3b') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG os_vif [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:5c:79,bridge_name='br-int',has_traffic_filtering=True,id=2f55f137-3b34-49a7-a77c-e03f9c263c43,network=Network(66fcf59b-a2bc-4a34-a881-bf1534ba9e3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f55f137-3b') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f55f137-3b, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2f55f137-3b, col_values=(('external_ids', {'iface-id': '2f55f137-3b34-49a7-a77c-e03f9c263c43', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:5c:79', 'vm-uuid': '1baadfd2-6f00-436b-b3a0-c850cd8cb50e'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:04 user nova-compute[72444]: INFO os_vif [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:5c:79,bridge_name='br-int',has_traffic_filtering=True,id=2f55f137-3b34-49a7-a77c-e03f9c263c43,network=Network(66fcf59b-a2bc-4a34-a881-bf1534ba9e3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f55f137-3b')
Aug 03 04:47:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] No VIF found with MAC fa:16:3e:cc:5c:79, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG nova.network.neutron [req-793dd5a4-3bf7-49c9-8ef3-bf2380bae3e0 req-ba1078a2-5260-4753-9de8-bad9eacb4a4b service nova] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Updated VIF entry in instance network info cache for port 2f55f137-3b34-49a7-a77c-e03f9c263c43. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG nova.network.neutron [req-793dd5a4-3bf7-49c9-8ef3-bf2380bae3e0 req-ba1078a2-5260-4753-9de8-bad9eacb4a4b service nova] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Updating instance_info_cache with network_info: [{"id": "2f55f137-3b34-49a7-a77c-e03f9c263c43", "address": "fa:16:3e:cc:5c:79", "network": {"id": "66fcf59b-a2bc-4a34-a881-bf1534ba9e3f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1260837866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256e3a45110d4bc683f3a9b6c250e522", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f55f137-3b", "ovs_interfaceid": "2f55f137-3b34-49a7-a77c-e03f9c263c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:47:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-793dd5a4-3bf7-49c9-8ef3-bf2380bae3e0 req-ba1078a2-5260-4753-9de8-bad9eacb4a4b service nova] Releasing lock "refresh_cache-1baadfd2-6f00-436b-b3a0-c850cd8cb50e" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:47:05 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691038010.2062776, ba7bd541-c761-4e4a-ac7c-7dd2cb89150d => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:47:05 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] VM Stopped (Lifecycle Event)
Aug 03 04:47:05 user nova-compute[72444]: DEBUG nova.compute.manager [None req-27b4b4b3-b1b2-4156-bcb8-aac5963775fa None None] [instance: ba7bd541-c761-4e4a-ac7c-7dd2cb89150d] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:47:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:06 user nova-compute[72444]: DEBUG nova.compute.manager [req-3695fd84-5bbc-4f17-a45c-14cc7e4e3c59 req-beffc51d-60d4-4707-9d3b-1c66f6cf9890 service nova] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Received event network-vif-plugged-2f55f137-3b34-49a7-a77c-e03f9c263c43 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:47:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3695fd84-5bbc-4f17-a45c-14cc7e4e3c59 req-beffc51d-60d4-4707-9d3b-1c66f6cf9890 service nova] Acquiring lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3695fd84-5bbc-4f17-a45c-14cc7e4e3c59 req-beffc51d-60d4-4707-9d3b-1c66f6cf9890 service nova] Lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3695fd84-5bbc-4f17-a45c-14cc7e4e3c59 req-beffc51d-60d4-4707-9d3b-1c66f6cf9890 service nova] Lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:06 user nova-compute[72444]: DEBUG nova.compute.manager [req-3695fd84-5bbc-4f17-a45c-14cc7e4e3c59 req-beffc51d-60d4-4707-9d3b-1c66f6cf9890 service nova] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] No waiting events found dispatching network-vif-plugged-2f55f137-3b34-49a7-a77c-e03f9c263c43 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:47:06 user nova-compute[72444]: WARNING nova.compute.manager [req-3695fd84-5bbc-4f17-a45c-14cc7e4e3c59 req-beffc51d-60d4-4707-9d3b-1c66f6cf9890 service nova] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Received unexpected event network-vif-plugged-2f55f137-3b34-49a7-a77c-e03f9c263c43 for instance with vm_state building and task_state spawning.
Aug 03 04:47:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:07 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038027.940618, 1baadfd2-6f00-436b-b3a0-c850cd8cb50e => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:47:07 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] VM Resumed (Lifecycle Event)
Aug 03 04:47:07 user nova-compute[72444]: DEBUG nova.compute.manager [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:47:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 04:47:07 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Instance spawned successfully.
Aug 03 04:47:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 04:47:07 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:47:07 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:47:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:47:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:47:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:47:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:47:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:47:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:47:07 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:47:07 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038027.9436522, 1baadfd2-6f00-436b-b3a0-c850cd8cb50e => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:47:07 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] VM Started (Lifecycle Event)
Aug 03 04:47:08 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:47:08 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:47:08 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:47:08 user nova-compute[72444]: INFO nova.compute.manager [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Took 5.92 seconds to spawn the instance on the hypervisor.
Aug 03 04:47:08 user nova-compute[72444]: DEBUG nova.compute.manager [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:47:08 user nova-compute[72444]: DEBUG nova.compute.manager [req-23a2c3f8-6e3f-417c-9ef7-af12f5ee55cd req-375e4f77-4ec2-42ab-a439-388ec269b4e7 service nova] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Received event network-vif-plugged-2f55f137-3b34-49a7-a77c-e03f9c263c43 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:47:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-23a2c3f8-6e3f-417c-9ef7-af12f5ee55cd req-375e4f77-4ec2-42ab-a439-388ec269b4e7 service nova] Acquiring lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-23a2c3f8-6e3f-417c-9ef7-af12f5ee55cd req-375e4f77-4ec2-42ab-a439-388ec269b4e7 service nova] Lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-23a2c3f8-6e3f-417c-9ef7-af12f5ee55cd req-375e4f77-4ec2-42ab-a439-388ec269b4e7 service nova] Lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:08 user nova-compute[72444]: DEBUG nova.compute.manager [req-23a2c3f8-6e3f-417c-9ef7-af12f5ee55cd req-375e4f77-4ec2-42ab-a439-388ec269b4e7 service nova] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] No waiting events found dispatching network-vif-plugged-2f55f137-3b34-49a7-a77c-e03f9c263c43 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:47:08 user nova-compute[72444]: WARNING nova.compute.manager [req-23a2c3f8-6e3f-417c-9ef7-af12f5ee55cd req-375e4f77-4ec2-42ab-a439-388ec269b4e7 service nova] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Received unexpected event network-vif-plugged-2f55f137-3b34-49a7-a77c-e03f9c263c43 for instance with vm_state building and task_state spawning.
Aug 03 04:47:08 user nova-compute[72444]: INFO nova.compute.manager [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Took 6.78 seconds to build instance.
Aug 03 04:47:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9e6118f0-5fe6-48e8-8bdd-ad2462afd383 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.905s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:11 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691038016.8854637, 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:47:11 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] VM Stopped (Lifecycle Event)
Aug 03 04:47:12 user nova-compute[72444]: DEBUG nova.compute.manager [None req-80017900-10c6-4e56-b4ff-2bef7a5d16ef None None] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:47:12 user nova-compute[72444]: DEBUG nova.compute.manager [None req-80017900-10c6-4e56-b4ff-2bef7a5d16ef None None] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:47:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-097c8594-2c35-42a9-9a8a-6b32e6ff7bbc tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Acquiring lock "fbaa8179-1294-41ec-88cd-e23a568c5468" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-097c8594-2c35-42a9-9a8a-6b32e6ff7bbc tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Lock "fbaa8179-1294-41ec-88cd-e23a568c5468" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-097c8594-2c35-42a9-9a8a-6b32e6ff7bbc tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Acquiring lock "fbaa8179-1294-41ec-88cd-e23a568c5468-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-097c8594-2c35-42a9-9a8a-6b32e6ff7bbc tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Lock "fbaa8179-1294-41ec-88cd-e23a568c5468-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-097c8594-2c35-42a9-9a8a-6b32e6ff7bbc tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Lock "fbaa8179-1294-41ec-88cd-e23a568c5468-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:14 user nova-compute[72444]: INFO nova.compute.manager [None req-097c8594-2c35-42a9-9a8a-6b32e6ff7bbc tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Terminating instance
Aug 03 04:47:14 user nova-compute[72444]: DEBUG nova.compute.manager [None req-097c8594-2c35-42a9-9a8a-6b32e6ff7bbc tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 04:47:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:14 user nova-compute[72444]: DEBUG nova.compute.manager [req-05269933-3fba-4dfa-ac63-398322c3d883 req-81bf5cee-519b-4c91-a8ea-e79a25bc1dc2 service nova] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Received event network-vif-unplugged-5534b301-8c40-45db-8ead-84de2782535b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:47:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-05269933-3fba-4dfa-ac63-398322c3d883 req-81bf5cee-519b-4c91-a8ea-e79a25bc1dc2 service nova] Acquiring lock "fbaa8179-1294-41ec-88cd-e23a568c5468-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-05269933-3fba-4dfa-ac63-398322c3d883 req-81bf5cee-519b-4c91-a8ea-e79a25bc1dc2 service nova] Lock "fbaa8179-1294-41ec-88cd-e23a568c5468-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-05269933-3fba-4dfa-ac63-398322c3d883 req-81bf5cee-519b-4c91-a8ea-e79a25bc1dc2 service nova] Lock "fbaa8179-1294-41ec-88cd-e23a568c5468-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:14 user nova-compute[72444]: DEBUG nova.compute.manager [req-05269933-3fba-4dfa-ac63-398322c3d883 req-81bf5cee-519b-4c91-a8ea-e79a25bc1dc2 service nova] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] No waiting events found dispatching network-vif-unplugged-5534b301-8c40-45db-8ead-84de2782535b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:47:14 user nova-compute[72444]: DEBUG nova.compute.manager [req-05269933-3fba-4dfa-ac63-398322c3d883 req-81bf5cee-519b-4c91-a8ea-e79a25bc1dc2 service nova] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Received event network-vif-unplugged-5534b301-8c40-45db-8ead-84de2782535b for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:47:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:14 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Instance destroyed successfully.
Aug 03 04:47:14 user nova-compute[72444]: DEBUG nova.objects.instance [None req-097c8594-2c35-42a9-9a8a-6b32e6ff7bbc tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Lazy-loading 'resources' on Instance uuid fbaa8179-1294-41ec-88cd-e23a568c5468 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:47:15 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-097c8594-2c35-42a9-9a8a-6b32e6ff7bbc tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:45:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-165254666',display_name='tempest-VolumesActionsTest-instance-165254666',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-165254666',id=18,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:45:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c520dc44eff4401789ef1ff61cc24cd4',ramdisk_id='',reservation_id='r-1d08mpa9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-684402275',owner_user_name='tempest-VolumesActionsTest-684402275-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:45:30Z,user_data=None,user_id='099a590e90f043cba5b076c8dd75999d',uuid=fbaa8179-1294-41ec-88cd-e23a568c5468,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5534b301-8c40-45db-8ead-84de2782535b", "address": "fa:16:3e:b9:8c:72", "network": {"id": "23b52932-5969-4b02-8d35-6cbc7f007838", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1885096873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c520dc44eff4401789ef1ff61cc24cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5534b301-8c", "ovs_interfaceid": "5534b301-8c40-45db-8ead-84de2782535b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:47:15 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-097c8594-2c35-42a9-9a8a-6b32e6ff7bbc tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Converting VIF {"id": "5534b301-8c40-45db-8ead-84de2782535b", "address": "fa:16:3e:b9:8c:72", "network": {"id": "23b52932-5969-4b02-8d35-6cbc7f007838", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1885096873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c520dc44eff4401789ef1ff61cc24cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5534b301-8c", "ovs_interfaceid": "5534b301-8c40-45db-8ead-84de2782535b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:47:15 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-097c8594-2c35-42a9-9a8a-6b32e6ff7bbc tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:8c:72,bridge_name='br-int',has_traffic_filtering=True,id=5534b301-8c40-45db-8ead-84de2782535b,network=Network(23b52932-5969-4b02-8d35-6cbc7f007838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5534b301-8c') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:47:15 user nova-compute[72444]: DEBUG os_vif [None req-097c8594-2c35-42a9-9a8a-6b32e6ff7bbc tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:8c:72,bridge_name='br-int',has_traffic_filtering=True,id=5534b301-8c40-45db-8ead-84de2782535b,network=Network(23b52932-5969-4b02-8d35-6cbc7f007838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5534b301-8c') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:47:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5534b301-8c, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:47:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:47:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:15 user nova-compute[72444]: INFO os_vif [None req-097c8594-2c35-42a9-9a8a-6b32e6ff7bbc tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:8c:72,bridge_name='br-int',has_traffic_filtering=True,id=5534b301-8c40-45db-8ead-84de2782535b,network=Network(23b52932-5969-4b02-8d35-6cbc7f007838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5534b301-8c')
Aug 03 04:47:15 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-097c8594-2c35-42a9-9a8a-6b32e6ff7bbc tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Deleting instance files /opt/stack/data/nova/instances/fbaa8179-1294-41ec-88cd-e23a568c5468_del
Aug 03 04:47:15 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-097c8594-2c35-42a9-9a8a-6b32e6ff7bbc tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Deletion of /opt/stack/data/nova/instances/fbaa8179-1294-41ec-88cd-e23a568c5468_del complete
Aug 03 04:47:15 user nova-compute[72444]: INFO nova.compute.manager [None req-097c8594-2c35-42a9-9a8a-6b32e6ff7bbc tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Took 1.08 seconds to destroy the instance on the hypervisor.
Aug 03 04:47:15 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-097c8594-2c35-42a9-9a8a-6b32e6ff7bbc tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 04:47:15 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 04:47:15 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 04:47:16 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:47:16 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Took 0.91 seconds to deallocate network for instance.
Aug 03 04:47:16 user nova-compute[72444]: DEBUG nova.compute.manager [req-ed2b1a0e-abc4-4bb9-8e72-bc75602d4a39 req-152cbed4-2dfd-4a7f-9758-9fa78b1b2b4f service nova] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Received event network-vif-deleted-5534b301-8c40-45db-8ead-84de2782535b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:47:16 user nova-compute[72444]: INFO nova.compute.manager [req-ed2b1a0e-abc4-4bb9-8e72-bc75602d4a39 req-152cbed4-2dfd-4a7f-9758-9fa78b1b2b4f service nova] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Neutron deleted interface 5534b301-8c40-45db-8ead-84de2782535b; detaching it from the instance and deleting it from the info cache
Aug 03 04:47:16 user nova-compute[72444]: DEBUG nova.network.neutron [req-ed2b1a0e-abc4-4bb9-8e72-bc75602d4a39 req-152cbed4-2dfd-4a7f-9758-9fa78b1b2b4f service nova] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:47:16 user nova-compute[72444]: DEBUG nova.compute.manager [req-ed2b1a0e-abc4-4bb9-8e72-bc75602d4a39 req-152cbed4-2dfd-4a7f-9758-9fa78b1b2b4f service nova] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Detach interface failed, port_id=5534b301-8c40-45db-8ead-84de2782535b, reason: Instance fbaa8179-1294-41ec-88cd-e23a568c5468 could not be found. {{(pid=72444) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 03 04:47:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-097c8594-2c35-42a9-9a8a-6b32e6ff7bbc tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-097c8594-2c35-42a9-9a8a-6b32e6ff7bbc tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:16 user nova-compute[72444]: DEBUG nova.compute.manager [req-6f390618-bf54-4867-aabf-c612837b3e41 req-1877fc97-f488-41db-8882-4c68d4fd62e7 service nova] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Received event network-vif-plugged-5534b301-8c40-45db-8ead-84de2782535b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:47:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6f390618-bf54-4867-aabf-c612837b3e41 req-1877fc97-f488-41db-8882-4c68d4fd62e7 service nova] Acquiring lock "fbaa8179-1294-41ec-88cd-e23a568c5468-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6f390618-bf54-4867-aabf-c612837b3e41 req-1877fc97-f488-41db-8882-4c68d4fd62e7 service nova] Lock "fbaa8179-1294-41ec-88cd-e23a568c5468-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6f390618-bf54-4867-aabf-c612837b3e41 req-1877fc97-f488-41db-8882-4c68d4fd62e7 service nova] Lock "fbaa8179-1294-41ec-88cd-e23a568c5468-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:16 user nova-compute[72444]: DEBUG nova.compute.manager [req-6f390618-bf54-4867-aabf-c612837b3e41 req-1877fc97-f488-41db-8882-4c68d4fd62e7 service nova] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] No waiting events found dispatching network-vif-plugged-5534b301-8c40-45db-8ead-84de2782535b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:47:16 user nova-compute[72444]: WARNING nova.compute.manager [req-6f390618-bf54-4867-aabf-c612837b3e41 req-1877fc97-f488-41db-8882-4c68d4fd62e7 service nova] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Received unexpected event network-vif-plugged-5534b301-8c40-45db-8ead-84de2782535b for instance with vm_state deleted and task_state None.
Aug 03 04:47:16 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-097c8594-2c35-42a9-9a8a-6b32e6ff7bbc tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:47:16 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-097c8594-2c35-42a9-9a8a-6b32e6ff7bbc tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:47:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-097c8594-2c35-42a9-9a8a-6b32e6ff7bbc tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.376s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:16 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-097c8594-2c35-42a9-9a8a-6b32e6ff7bbc tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Deleted allocations for instance fbaa8179-1294-41ec-88cd-e23a568c5468
Aug 03 04:47:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-097c8594-2c35-42a9-9a8a-6b32e6ff7bbc tempest-VolumesActionsTest-684402275 tempest-VolumesActionsTest-684402275-project-member] Lock "fbaa8179-1294-41ec-88cd-e23a568c5468" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.559s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:19 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:21 user nova-compute[72444]: INFO nova.compute.manager [None req-3ccc2cf9-031c-460a-955c-8e890217fc07 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Unrescuing
Aug 03 04:47:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-3ccc2cf9-031c-460a-955c-8e890217fc07 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "refresh_cache-4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:47:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-3ccc2cf9-031c-460a-955c-8e890217fc07 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquired lock "refresh_cache-4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:47:21 user nova-compute[72444]: DEBUG nova.network.neutron [None req-3ccc2cf9-031c-460a-955c-8e890217fc07 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:47:21 user nova-compute[72444]: DEBUG nova.network.neutron [None req-3ccc2cf9-031c-460a-955c-8e890217fc07 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Updating instance_info_cache with network_info: [{"id": "d0cfd0c0-ac67-4335-85d2-6f0b956fae5b", "address": "fa:16:3e:e0:f6:85", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cfd0c0-ac", "ovs_interfaceid": "d0cfd0c0-ac67-4335-85d2-6f0b956fae5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:47:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-3ccc2cf9-031c-460a-955c-8e890217fc07 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Releasing lock "refresh_cache-4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:47:21 user nova-compute[72444]: DEBUG nova.objects.instance [None req-3ccc2cf9-031c-460a-955c-8e890217fc07 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lazy-loading 'flavor' on Instance uuid 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:47:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:21 user nova-compute[72444]: DEBUG nova.compute.manager [req-f51cc668-fe0c-4fc3-8ee6-fdf7708368fd req-d390422b-43af-42aa-9c3e-fb1a73fc3f7d service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Received event network-vif-unplugged-d0cfd0c0-ac67-4335-85d2-6f0b956fae5b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:47:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f51cc668-fe0c-4fc3-8ee6-fdf7708368fd req-d390422b-43af-42aa-9c3e-fb1a73fc3f7d service nova] Acquiring lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f51cc668-fe0c-4fc3-8ee6-fdf7708368fd req-d390422b-43af-42aa-9c3e-fb1a73fc3f7d service nova] Lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f51cc668-fe0c-4fc3-8ee6-fdf7708368fd req-d390422b-43af-42aa-9c3e-fb1a73fc3f7d service nova] Lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:22 user nova-compute[72444]: DEBUG nova.compute.manager [req-f51cc668-fe0c-4fc3-8ee6-fdf7708368fd req-d390422b-43af-42aa-9c3e-fb1a73fc3f7d service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] No waiting events found dispatching network-vif-unplugged-d0cfd0c0-ac67-4335-85d2-6f0b956fae5b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:47:22 user nova-compute[72444]: WARNING nova.compute.manager [req-f51cc668-fe0c-4fc3-8ee6-fdf7708368fd req-d390422b-43af-42aa-9c3e-fb1a73fc3f7d service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Received unexpected event network-vif-unplugged-d0cfd0c0-ac67-4335-85d2-6f0b956fae5b for instance with vm_state rescued and task_state unrescuing.
Aug 03 04:47:22 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:22 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:22 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Instance destroyed successfully.
Aug 03 04:47:23 user nova-compute[72444]: INFO nova.compute.manager [None req-ad09b29c-1076-4479-969f-f06dc2c08408 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Unrescuing
Aug 03 04:47:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ad09b29c-1076-4479-969f-f06dc2c08408 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "refresh_cache-2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:47:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ad09b29c-1076-4479-969f-f06dc2c08408 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquired lock "refresh_cache-2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:47:23 user nova-compute[72444]: DEBUG nova.network.neutron [None req-ad09b29c-1076-4479-969f-f06dc2c08408 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:47:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:24 user nova-compute[72444]: DEBUG nova.compute.manager [req-e44b4f14-de2f-4d62-af87-ff139dd8b674 req-fa6b08c2-7cf6-4504-8b71-8f2722488265 service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Received event network-vif-plugged-d0cfd0c0-ac67-4335-85d2-6f0b956fae5b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:47:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e44b4f14-de2f-4d62-af87-ff139dd8b674 req-fa6b08c2-7cf6-4504-8b71-8f2722488265 service nova] Acquiring lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e44b4f14-de2f-4d62-af87-ff139dd8b674 req-fa6b08c2-7cf6-4504-8b71-8f2722488265 service nova] Lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e44b4f14-de2f-4d62-af87-ff139dd8b674 req-fa6b08c2-7cf6-4504-8b71-8f2722488265 service nova] Lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:24 user nova-compute[72444]: DEBUG nova.compute.manager [req-e44b4f14-de2f-4d62-af87-ff139dd8b674 req-fa6b08c2-7cf6-4504-8b71-8f2722488265 service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] No waiting events found dispatching network-vif-plugged-d0cfd0c0-ac67-4335-85d2-6f0b956fae5b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:47:24 user nova-compute[72444]: WARNING nova.compute.manager [req-e44b4f14-de2f-4d62-af87-ff139dd8b674 req-fa6b08c2-7cf6-4504-8b71-8f2722488265 service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Received unexpected event network-vif-plugged-d0cfd0c0-ac67-4335-85d2-6f0b956fae5b for instance with vm_state rescued and task_state unrescuing.
Aug 03 04:47:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:24 user nova-compute[72444]: DEBUG nova.network.neutron [None req-ad09b29c-1076-4479-969f-f06dc2c08408 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Updating instance_info_cache with network_info: [{"id": "c14e16af-c17e-4152-a400-cbb8fb4f41fa", "address": "fa:16:3e:05:10:6a", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14e16af-c1", "ovs_interfaceid": "c14e16af-c17e-4152-a400-cbb8fb4f41fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:47:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ad09b29c-1076-4479-969f-f06dc2c08408 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Releasing lock "refresh_cache-2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:47:24 user nova-compute[72444]: DEBUG nova.objects.instance [None req-ad09b29c-1076-4479-969f-f06dc2c08408 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lazy-loading 'flavor' on Instance uuid 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:47:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:24 user nova-compute[72444]: DEBUG nova.compute.manager [req-6822b42a-2d44-4851-a5f0-478d87aa6f40 req-05899e6a-f982-459d-8fa4-9fbdbbe20923 service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Received event network-vif-unplugged-c14e16af-c17e-4152-a400-cbb8fb4f41fa {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:47:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6822b42a-2d44-4851-a5f0-478d87aa6f40 req-05899e6a-f982-459d-8fa4-9fbdbbe20923 service nova] Acquiring lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6822b42a-2d44-4851-a5f0-478d87aa6f40 req-05899e6a-f982-459d-8fa4-9fbdbbe20923 service nova] Lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6822b42a-2d44-4851-a5f0-478d87aa6f40 req-05899e6a-f982-459d-8fa4-9fbdbbe20923 service nova] Lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:24 user nova-compute[72444]: DEBUG nova.compute.manager [req-6822b42a-2d44-4851-a5f0-478d87aa6f40 req-05899e6a-f982-459d-8fa4-9fbdbbe20923 service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] No waiting events found dispatching network-vif-unplugged-c14e16af-c17e-4152-a400-cbb8fb4f41fa {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:47:24 user nova-compute[72444]: WARNING nova.compute.manager [req-6822b42a-2d44-4851-a5f0-478d87aa6f40 req-05899e6a-f982-459d-8fa4-9fbdbbe20923 service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Received unexpected event network-vif-unplugged-c14e16af-c17e-4152-a400-cbb8fb4f41fa for instance with vm_state rescued and task_state unrescuing.
Aug 03 04:47:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:24 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:47:25 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Instance destroyed successfully.
Aug 03 04:47:25 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Triggering sync for uuid 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 {{(pid=72444) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Triggering sync for uuid 81725845-6158-4e34-bedb-6e41219bc227 {{(pid=72444) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Triggering sync for uuid b6ed9c42-fa6e-4a0d-8312-588471e157f7 {{(pid=72444) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Triggering sync for uuid e3089887-56df-42de-bc62-88e6db28daf0 {{(pid=72444) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Triggering sync for uuid e2859322-6f99-442d-bee1-65fe49ce6360 {{(pid=72444) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Triggering sync for uuid 07450ea8-cb80-4318-9fc9-4268944d2cae {{(pid=72444) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Triggering sync for uuid 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 {{(pid=72444) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Triggering sync for uuid 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15 {{(pid=72444) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Triggering sync for uuid 6f1a45af-977b-43e2-a7dd-7a9c402840d1 {{(pid=72444) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Triggering sync for uuid 26922d3f-0a2d-48d1-b758-9c87e0621fef {{(pid=72444) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Triggering sync for uuid 1baadfd2-6f00-436b-b3a0-c850cd8cb50e {{(pid=72444) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:25 user nova-compute[72444]: INFO nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "81725845-6158-4e34-bedb-6e41219bc227" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "81725845-6158-4e34-bedb-6e41219bc227" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "b6ed9c42-fa6e-4a0d-8312-588471e157f7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "b6ed9c42-fa6e-4a0d-8312-588471e157f7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "e3089887-56df-42de-bc62-88e6db28daf0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "e3089887-56df-42de-bc62-88e6db28daf0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "e2859322-6f99-442d-bee1-65fe49ce6360" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "e2859322-6f99-442d-bee1-65fe49ce6360" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "07450ea8-cb80-4318-9fc9-4268944d2cae" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "07450ea8-cb80-4318-9fc9-4268944d2cae" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:25 user nova-compute[72444]: INFO nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "26922d3f-0a2d-48d1-b758-9c87e0621fef" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "26922d3f-0a2d-48d1-b758-9c87e0621fef" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "e3089887-56df-42de-bc62-88e6db28daf0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.111s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "b6ed9c42-fa6e-4a0d-8312-588471e157f7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.113s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "81725845-6158-4e34-bedb-6e41219bc227" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.119s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.113s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "07450ea8-cb80-4318-9fc9-4268944d2cae" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.120s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "e2859322-6f99-442d-bee1-65fe49ce6360" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.123s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "26922d3f-0a2d-48d1-b758-9c87e0621fef" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.119s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.122s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-964278d8-4f9a-46eb-b72d-71291adee5bd tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Acquiring lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-964278d8-4f9a-46eb-b72d-71291adee5bd tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-964278d8-4f9a-46eb-b72d-71291adee5bd tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Acquiring lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-964278d8-4f9a-46eb-b72d-71291adee5bd tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-964278d8-4f9a-46eb-b72d-71291adee5bd tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:25 user nova-compute[72444]: INFO nova.compute.manager [None req-964278d8-4f9a-46eb-b72d-71291adee5bd tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Terminating instance
Aug 03 04:47:25 user nova-compute[72444]: DEBUG nova.compute.manager [None req-964278d8-4f9a-46eb-b72d-71291adee5bd tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG nova.compute.manager [req-f9e336bd-e35a-4808-95a4-ee3e4e0c50ea req-c009a0eb-0d02-4b4a-bdee-5127b8e1c830 service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Received event network-vif-unplugged-5119da23-2d00-4603-ba9f-a9d0c35bf261 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f9e336bd-e35a-4808-95a4-ee3e4e0c50ea req-c009a0eb-0d02-4b4a-bdee-5127b8e1c830 service nova] Acquiring lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f9e336bd-e35a-4808-95a4-ee3e4e0c50ea req-c009a0eb-0d02-4b4a-bdee-5127b8e1c830 service nova] Lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f9e336bd-e35a-4808-95a4-ee3e4e0c50ea req-c009a0eb-0d02-4b4a-bdee-5127b8e1c830 service nova] Lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG nova.compute.manager [req-f9e336bd-e35a-4808-95a4-ee3e4e0c50ea req-c009a0eb-0d02-4b4a-bdee-5127b8e1c830 service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] No waiting events found dispatching network-vif-unplugged-5119da23-2d00-4603-ba9f-a9d0c35bf261 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:47:25 user nova-compute[72444]: DEBUG nova.compute.manager [req-f9e336bd-e35a-4808-95a4-ee3e4e0c50ea req-c009a0eb-0d02-4b4a-bdee-5127b8e1c830 service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Received event network-vif-unplugged-5119da23-2d00-4603-ba9f-a9d0c35bf261 for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:47:26 user nova-compute[72444]: DEBUG nova.compute.manager [req-f13b757a-1525-4dca-8472-d82c6b2b9266 req-bb8bd2f6-e21c-4545-8968-3641fa761fa8 service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Received event network-vif-plugged-d0cfd0c0-ac67-4335-85d2-6f0b956fae5b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:47:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f13b757a-1525-4dca-8472-d82c6b2b9266 req-bb8bd2f6-e21c-4545-8968-3641fa761fa8 service nova] Acquiring lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f13b757a-1525-4dca-8472-d82c6b2b9266 req-bb8bd2f6-e21c-4545-8968-3641fa761fa8 service nova] Lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f13b757a-1525-4dca-8472-d82c6b2b9266 req-bb8bd2f6-e21c-4545-8968-3641fa761fa8 service nova] Lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:26 user nova-compute[72444]: DEBUG nova.compute.manager [req-f13b757a-1525-4dca-8472-d82c6b2b9266 req-bb8bd2f6-e21c-4545-8968-3641fa761fa8 service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] No waiting events found dispatching network-vif-plugged-d0cfd0c0-ac67-4335-85d2-6f0b956fae5b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:47:26 user nova-compute[72444]: WARNING nova.compute.manager [req-f13b757a-1525-4dca-8472-d82c6b2b9266 req-bb8bd2f6-e21c-4545-8968-3641fa761fa8 service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Received unexpected event network-vif-plugged-d0cfd0c0-ac67-4335-85d2-6f0b956fae5b for instance with vm_state rescued and task_state unrescuing.
Aug 03 04:47:26 user nova-compute[72444]: DEBUG nova.compute.manager [req-f13b757a-1525-4dca-8472-d82c6b2b9266 req-bb8bd2f6-e21c-4545-8968-3641fa761fa8 service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Received event network-vif-plugged-d0cfd0c0-ac67-4335-85d2-6f0b956fae5b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:47:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f13b757a-1525-4dca-8472-d82c6b2b9266 req-bb8bd2f6-e21c-4545-8968-3641fa761fa8 service nova] Acquiring lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f13b757a-1525-4dca-8472-d82c6b2b9266 req-bb8bd2f6-e21c-4545-8968-3641fa761fa8 service nova] Lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f13b757a-1525-4dca-8472-d82c6b2b9266 req-bb8bd2f6-e21c-4545-8968-3641fa761fa8 service nova] Lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:26 user nova-compute[72444]: DEBUG nova.compute.manager [req-f13b757a-1525-4dca-8472-d82c6b2b9266 req-bb8bd2f6-e21c-4545-8968-3641fa761fa8 service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] No waiting events found dispatching network-vif-plugged-d0cfd0c0-ac67-4335-85d2-6f0b956fae5b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:47:26 user nova-compute[72444]: WARNING nova.compute.manager [req-f13b757a-1525-4dca-8472-d82c6b2b9266 req-bb8bd2f6-e21c-4545-8968-3641fa761fa8 service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Received unexpected event network-vif-plugged-d0cfd0c0-ac67-4335-85d2-6f0b956fae5b for instance with vm_state rescued and task_state unrescuing.
Aug 03 04:47:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Removed pending event for 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 due to event {{(pid=72444) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 03 04:47:26 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038046.3598065, 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:47:26 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] VM Resumed (Lifecycle Event)
Aug 03 04:47:26 user nova-compute[72444]: DEBUG nova.compute.manager [None req-3ccc2cf9-031c-460a-955c-8e890217fc07 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:47:26 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:47:26 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:47:26 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 03 04:47:26 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038046.3616514, 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:47:26 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] VM Started (Lifecycle Event)
Aug 03 04:47:26 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:47:26 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:47:26 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Instance destroyed successfully.
Aug 03 04:47:26 user nova-compute[72444]: DEBUG nova.objects.instance [None req-964278d8-4f9a-46eb-b72d-71291adee5bd tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lazy-loading 'resources' on Instance uuid 6f1a45af-977b-43e2-a7dd-7a9c402840d1 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:47:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-964278d8-4f9a-46eb-b72d-71291adee5bd tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:44:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1468224080',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1468224080',id=16,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaZFwRNEZpiQfGHLwHZY0lzzbAVIRwXRC0MqbLmO16AzRtkc1PNUMZriWOCxZ3hf+0jC1htGoMbWFCsoXZ1AlanFdwAoHBAD6We6zi7g38fpOwMHB+xi90mEeGWehYqlA==',key_name='tempest-keypair-1754610092',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:44:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1dee6e42044847209f1357b13d6d126a',ramdisk_id='',reservation_id='r-qunvoqox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1101837971',owner_user_name='tempest-TaggedAttachmentsTest-1101837971-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:44:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0bdf7a13912407ea16fd1999be5ede0',uuid=6f1a45af-977b-43e2-a7dd-7a9c402840d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5119da23-2d00-4603-ba9f-a9d0c35bf261", "address": "fa:16:3e:b0:20:5c", "network": {"id": "609944ea-0d2a-43ad-9d2b-f06d1c67d9de", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1126534592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1dee6e42044847209f1357b13d6d126a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5119da23-2d", "ovs_interfaceid": "5119da23-2d00-4603-ba9f-a9d0c35bf261", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:47:26 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-964278d8-4f9a-46eb-b72d-71291adee5bd tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Converting VIF {"id": "5119da23-2d00-4603-ba9f-a9d0c35bf261", "address": "fa:16:3e:b0:20:5c", "network": {"id": "609944ea-0d2a-43ad-9d2b-f06d1c67d9de", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1126534592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1dee6e42044847209f1357b13d6d126a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5119da23-2d", "ovs_interfaceid": "5119da23-2d00-4603-ba9f-a9d0c35bf261", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:47:26 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-964278d8-4f9a-46eb-b72d-71291adee5bd tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:20:5c,bridge_name='br-int',has_traffic_filtering=True,id=5119da23-2d00-4603-ba9f-a9d0c35bf261,network=Network(609944ea-0d2a-43ad-9d2b-f06d1c67d9de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5119da23-2d') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:47:26 user nova-compute[72444]: DEBUG os_vif [None req-964278d8-4f9a-46eb-b72d-71291adee5bd tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:20:5c,bridge_name='br-int',has_traffic_filtering=True,id=5119da23-2d00-4603-ba9f-a9d0c35bf261,network=Network(609944ea-0d2a-43ad-9d2b-f06d1c67d9de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5119da23-2d') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:47:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5119da23-2d, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:47:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:47:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:26 user nova-compute[72444]: INFO os_vif [None req-964278d8-4f9a-46eb-b72d-71291adee5bd tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:20:5c,bridge_name='br-int',has_traffic_filtering=True,id=5119da23-2d00-4603-ba9f-a9d0c35bf261,network=Network(609944ea-0d2a-43ad-9d2b-f06d1c67d9de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5119da23-2d')
Aug 03 04:47:26 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-964278d8-4f9a-46eb-b72d-71291adee5bd tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Deleting instance files /opt/stack/data/nova/instances/6f1a45af-977b-43e2-a7dd-7a9c402840d1_del
Aug 03 04:47:26 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-964278d8-4f9a-46eb-b72d-71291adee5bd tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Deletion of /opt/stack/data/nova/instances/6f1a45af-977b-43e2-a7dd-7a9c402840d1_del complete
Aug 03 04:47:26 user nova-compute[72444]: DEBUG nova.compute.manager [req-2067fa96-9cad-4b53-b257-df06643e9586 req-a530335d-1150-43d2-98ff-afa3606104e3 service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Received event network-vif-plugged-c14e16af-c17e-4152-a400-cbb8fb4f41fa {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:47:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2067fa96-9cad-4b53-b257-df06643e9586 req-a530335d-1150-43d2-98ff-afa3606104e3 service nova] Acquiring lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2067fa96-9cad-4b53-b257-df06643e9586 req-a530335d-1150-43d2-98ff-afa3606104e3 service nova] Lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2067fa96-9cad-4b53-b257-df06643e9586 req-a530335d-1150-43d2-98ff-afa3606104e3 service nova] Lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:26 user nova-compute[72444]: DEBUG nova.compute.manager [req-2067fa96-9cad-4b53-b257-df06643e9586 req-a530335d-1150-43d2-98ff-afa3606104e3 service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] No waiting events found dispatching network-vif-plugged-c14e16af-c17e-4152-a400-cbb8fb4f41fa {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:47:26 user nova-compute[72444]: WARNING nova.compute.manager [req-2067fa96-9cad-4b53-b257-df06643e9586 req-a530335d-1150-43d2-98ff-afa3606104e3 service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Received unexpected event network-vif-plugged-c14e16af-c17e-4152-a400-cbb8fb4f41fa for instance with vm_state rescued and task_state unrescuing.
Aug 03 04:47:26 user nova-compute[72444]: INFO nova.compute.manager [None req-964278d8-4f9a-46eb-b72d-71291adee5bd tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Took 1.28 seconds to destroy the instance on the hypervisor.
Aug 03 04:47:26 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-964278d8-4f9a-46eb-b72d-71291adee5bd tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 04:47:26 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 04:47:26 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 04:47:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:27 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:47:27 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Took 1.16 seconds to deallocate network for instance.
Aug 03 04:47:27 user nova-compute[72444]: DEBUG nova.compute.manager [req-ad0632a1-604b-4a74-8300-e119a4d0e5cb req-872c640f-7f58-4149-b221-bde5a5bd70a6 service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Received event network-vif-plugged-5119da23-2d00-4603-ba9f-a9d0c35bf261 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:47:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ad0632a1-604b-4a74-8300-e119a4d0e5cb req-872c640f-7f58-4149-b221-bde5a5bd70a6 service nova] Acquiring lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ad0632a1-604b-4a74-8300-e119a4d0e5cb req-872c640f-7f58-4149-b221-bde5a5bd70a6 service nova] Lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ad0632a1-604b-4a74-8300-e119a4d0e5cb req-872c640f-7f58-4149-b221-bde5a5bd70a6 service nova] Lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:27 user nova-compute[72444]: DEBUG nova.compute.manager [req-ad0632a1-604b-4a74-8300-e119a4d0e5cb req-872c640f-7f58-4149-b221-bde5a5bd70a6 service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] No waiting events found dispatching network-vif-plugged-5119da23-2d00-4603-ba9f-a9d0c35bf261 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:47:27 user nova-compute[72444]: WARNING nova.compute.manager [req-ad0632a1-604b-4a74-8300-e119a4d0e5cb req-872c640f-7f58-4149-b221-bde5a5bd70a6 service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Received unexpected event network-vif-plugged-5119da23-2d00-4603-ba9f-a9d0c35bf261 for instance with vm_state active and task_state deleting.
Aug 03 04:47:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-964278d8-4f9a-46eb-b72d-71291adee5bd tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-964278d8-4f9a-46eb-b72d-71291adee5bd tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:28 user nova-compute[72444]: DEBUG nova.compute.manager [req-54c0a987-4833-4112-a461-12b55d2446d6 req-03da23d5-758b-4621-bf9f-d3f3389cde9d service nova] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Received event network-vif-deleted-5119da23-2d00-4603-ba9f-a9d0c35bf261 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:47:28 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-964278d8-4f9a-46eb-b72d-71291adee5bd tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:47:28 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-964278d8-4f9a-46eb-b72d-71291adee5bd tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:47:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-964278d8-4f9a-46eb-b72d-71291adee5bd tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:28 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-964278d8-4f9a-46eb-b72d-71291adee5bd tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Deleted allocations for instance 6f1a45af-977b-43e2-a7dd-7a9c402840d1
Aug 03 04:47:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-964278d8-4f9a-46eb-b72d-71291adee5bd tempest-TaggedAttachmentsTest-1101837971 tempest-TaggedAttachmentsTest-1101837971-project-member] Lock "6f1a45af-977b-43e2-a7dd-7a9c402840d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.018s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:28 user nova-compute[72444]: DEBUG nova.compute.manager [req-fb30c5fa-32ea-46a4-8cb3-9dddc9b405d3 req-aab9b1d0-43b4-4f42-b5f0-ae8b89dcc20a service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Received event network-vif-plugged-c14e16af-c17e-4152-a400-cbb8fb4f41fa {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:47:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-fb30c5fa-32ea-46a4-8cb3-9dddc9b405d3 req-aab9b1d0-43b4-4f42-b5f0-ae8b89dcc20a service nova] Acquiring lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-fb30c5fa-32ea-46a4-8cb3-9dddc9b405d3 req-aab9b1d0-43b4-4f42-b5f0-ae8b89dcc20a service nova] Lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-fb30c5fa-32ea-46a4-8cb3-9dddc9b405d3 req-aab9b1d0-43b4-4f42-b5f0-ae8b89dcc20a service nova] Lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:28 user nova-compute[72444]: DEBUG nova.compute.manager [req-fb30c5fa-32ea-46a4-8cb3-9dddc9b405d3 req-aab9b1d0-43b4-4f42-b5f0-ae8b89dcc20a service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] No waiting events found dispatching network-vif-plugged-c14e16af-c17e-4152-a400-cbb8fb4f41fa {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:47:28 user nova-compute[72444]: WARNING nova.compute.manager [req-fb30c5fa-32ea-46a4-8cb3-9dddc9b405d3 req-aab9b1d0-43b4-4f42-b5f0-ae8b89dcc20a service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Received unexpected event network-vif-plugged-c14e16af-c17e-4152-a400-cbb8fb4f41fa for instance with vm_state rescued and task_state unrescuing.
Aug 03 04:47:28 user nova-compute[72444]: DEBUG nova.compute.manager [req-fb30c5fa-32ea-46a4-8cb3-9dddc9b405d3 req-aab9b1d0-43b4-4f42-b5f0-ae8b89dcc20a service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Received event network-vif-plugged-c14e16af-c17e-4152-a400-cbb8fb4f41fa {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:47:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-fb30c5fa-32ea-46a4-8cb3-9dddc9b405d3 req-aab9b1d0-43b4-4f42-b5f0-ae8b89dcc20a service nova] Acquiring lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-fb30c5fa-32ea-46a4-8cb3-9dddc9b405d3 req-aab9b1d0-43b4-4f42-b5f0-ae8b89dcc20a service nova] Lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-fb30c5fa-32ea-46a4-8cb3-9dddc9b405d3 req-aab9b1d0-43b4-4f42-b5f0-ae8b89dcc20a service nova] Lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:28 user nova-compute[72444]: DEBUG nova.compute.manager [req-fb30c5fa-32ea-46a4-8cb3-9dddc9b405d3 req-aab9b1d0-43b4-4f42-b5f0-ae8b89dcc20a service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] No waiting events found dispatching network-vif-plugged-c14e16af-c17e-4152-a400-cbb8fb4f41fa {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:47:28 user nova-compute[72444]: WARNING nova.compute.manager [req-fb30c5fa-32ea-46a4-8cb3-9dddc9b405d3 req-aab9b1d0-43b4-4f42-b5f0-ae8b89dcc20a service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Received unexpected event network-vif-plugged-c14e16af-c17e-4152-a400-cbb8fb4f41fa for instance with vm_state rescued and task_state unrescuing.
Aug 03 04:47:29 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:29 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Removed pending event for 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15 due to event {{(pid=72444) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 03 04:47:29 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038049.2603605, 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:47:29 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] VM Resumed (Lifecycle Event)
Aug 03 04:47:29 user nova-compute[72444]: DEBUG nova.compute.manager [None req-ad09b29c-1076-4479-969f-f06dc2c08408 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:47:29 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:47:29 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:47:29 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 03 04:47:29 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038049.26165, 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:47:29 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] VM Started (Lifecycle Event)
Aug 03 04:47:29 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:47:29 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:47:29 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691038034.9044993, fbaa8179-1294-41ec-88cd-e23a568c5468 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:47:29 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] VM Stopped (Lifecycle Event)
Aug 03 04:47:29 user nova-compute[72444]: DEBUG nova.compute.manager [None req-eb7302cb-eacb-4c00-ab61-52abb750273e None None] [instance: fbaa8179-1294-41ec-88cd-e23a568c5468] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:47:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:39 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:47:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8727a443-a7d6-4ae8-a969-1adf81516eca tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Acquiring lock "07450ea8-cb80-4318-9fc9-4268944d2cae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8727a443-a7d6-4ae8-a969-1adf81516eca tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "07450ea8-cb80-4318-9fc9-4268944d2cae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8727a443-a7d6-4ae8-a969-1adf81516eca tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Acquiring lock "07450ea8-cb80-4318-9fc9-4268944d2cae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8727a443-a7d6-4ae8-a969-1adf81516eca tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "07450ea8-cb80-4318-9fc9-4268944d2cae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8727a443-a7d6-4ae8-a969-1adf81516eca tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "07450ea8-cb80-4318-9fc9-4268944d2cae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:40 user nova-compute[72444]: INFO nova.compute.manager [None req-8727a443-a7d6-4ae8-a969-1adf81516eca tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Terminating instance
Aug 03 04:47:40 user nova-compute[72444]: DEBUG nova.compute.manager [None req-8727a443-a7d6-4ae8-a969-1adf81516eca tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 04:47:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:41 user nova-compute[72444]: DEBUG nova.compute.manager [req-618a8d34-30cc-4d22-83e8-1f87909c4f32 req-464ff07d-9037-452f-89a3-f9555e94162f service nova] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Received event network-vif-unplugged-fcb29ef9-b342-48cf-9fab-165ea205728f {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:47:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-618a8d34-30cc-4d22-83e8-1f87909c4f32 req-464ff07d-9037-452f-89a3-f9555e94162f service nova] Acquiring lock "07450ea8-cb80-4318-9fc9-4268944d2cae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-618a8d34-30cc-4d22-83e8-1f87909c4f32 req-464ff07d-9037-452f-89a3-f9555e94162f service nova] Lock "07450ea8-cb80-4318-9fc9-4268944d2cae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-618a8d34-30cc-4d22-83e8-1f87909c4f32 req-464ff07d-9037-452f-89a3-f9555e94162f service nova] Lock "07450ea8-cb80-4318-9fc9-4268944d2cae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:41 user nova-compute[72444]: DEBUG nova.compute.manager [req-618a8d34-30cc-4d22-83e8-1f87909c4f32 req-464ff07d-9037-452f-89a3-f9555e94162f service nova] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] No waiting events found dispatching network-vif-unplugged-fcb29ef9-b342-48cf-9fab-165ea205728f {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:47:41 user nova-compute[72444]: DEBUG nova.compute.manager [req-618a8d34-30cc-4d22-83e8-1f87909c4f32 req-464ff07d-9037-452f-89a3-f9555e94162f service nova] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Received event network-vif-unplugged-fcb29ef9-b342-48cf-9fab-165ea205728f for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:47:41 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Instance destroyed successfully.
Aug 03 04:47:41 user nova-compute[72444]: DEBUG nova.objects.instance [None req-8727a443-a7d6-4ae8-a969-1adf81516eca tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lazy-loading 'resources' on Instance uuid 07450ea8-cb80-4318-9fc9-4268944d2cae {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:47:41 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691038046.6167133, 6f1a45af-977b-43e2-a7dd-7a9c402840d1 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:47:41 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] VM Stopped (Lifecycle Event)
Aug 03 04:47:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-8727a443-a7d6-4ae8-a969-1adf81516eca tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:40:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-747885102',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-747885102',id=7,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFo0buMaxWNwdHLG0PZYLL3TeRl0HBq+TBQ2hljJEyZEtGF1M4DacF/MEi7f+iwmSmEgmz3SST3pjWb/tffOZurJMk3tNoT0suNR4yNbRo0+QA4I59cUEShoHlyupzG1XQ==',key_name='tempest-keypair-880955591',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:41:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6037670c8c6450bb3663e55b50c6dd5',ramdisk_id='',reservation_id='r-ob8r083f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-780888408',owner_user_name='tempest-ServerActionsV293TestJSON-780888408-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:41:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6837fb4f8f04f38a0e429d8905eae54',uuid=07450ea8-cb80-4318-9fc9-4268944d2cae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fcb29ef9-b342-48cf-9fab-165ea205728f", "address": "fa:16:3e:26:71:73", "network": {"id": "f0b4a33e-e079-4817-8747-412ca56818fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1198621443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6037670c8c6450bb3663e55b50c6dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb29ef9-b3", "ovs_interfaceid": "fcb29ef9-b342-48cf-9fab-165ea205728f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:47:41 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-8727a443-a7d6-4ae8-a969-1adf81516eca tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Converting VIF {"id": "fcb29ef9-b342-48cf-9fab-165ea205728f", "address": "fa:16:3e:26:71:73", "network": {"id": "f0b4a33e-e079-4817-8747-412ca56818fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1198621443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6037670c8c6450bb3663e55b50c6dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcb29ef9-b3", "ovs_interfaceid": "fcb29ef9-b342-48cf-9fab-165ea205728f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:47:41 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-8727a443-a7d6-4ae8-a969-1adf81516eca tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:71:73,bridge_name='br-int',has_traffic_filtering=True,id=fcb29ef9-b342-48cf-9fab-165ea205728f,network=Network(f0b4a33e-e079-4817-8747-412ca56818fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcb29ef9-b3') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:47:41 user nova-compute[72444]: DEBUG os_vif [None req-8727a443-a7d6-4ae8-a969-1adf81516eca tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:71:73,bridge_name='br-int',has_traffic_filtering=True,id=fcb29ef9-b342-48cf-9fab-165ea205728f,network=Network(f0b4a33e-e079-4817-8747-412ca56818fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcb29ef9-b3') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:47:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfcb29ef9-b3, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:47:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:41 user nova-compute[72444]: DEBUG nova.compute.manager [None req-58f7feaa-d2e4-41b3-963c-d52f3eea6253 None None] [instance: 6f1a45af-977b-43e2-a7dd-7a9c402840d1] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:47:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:47:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:41 user nova-compute[72444]: INFO os_vif [None req-8727a443-a7d6-4ae8-a969-1adf81516eca tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:71:73,bridge_name='br-int',has_traffic_filtering=True,id=fcb29ef9-b342-48cf-9fab-165ea205728f,network=Network(f0b4a33e-e079-4817-8747-412ca56818fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcb29ef9-b3')
Aug 03 04:47:41 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-8727a443-a7d6-4ae8-a969-1adf81516eca tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Deleting instance files /opt/stack/data/nova/instances/07450ea8-cb80-4318-9fc9-4268944d2cae_del
Aug 03 04:47:41 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-8727a443-a7d6-4ae8-a969-1adf81516eca tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Deletion of /opt/stack/data/nova/instances/07450ea8-cb80-4318-9fc9-4268944d2cae_del complete
Aug 03 04:47:41 user nova-compute[72444]: INFO nova.compute.manager [None req-8727a443-a7d6-4ae8-a969-1adf81516eca tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 03 04:47:41 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-8727a443-a7d6-4ae8-a969-1adf81516eca tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 04:47:41 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 04:47:41 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 04:47:42 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:47:42 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Took 1.00 seconds to deallocate network for instance.
Aug 03 04:47:42 user nova-compute[72444]: DEBUG nova.compute.manager [req-3c428047-7a1f-428b-93c2-f5565d4a906f req-83610a52-c953-4695-ba27-e046d7938a42 service nova] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Received event network-vif-deleted-fcb29ef9-b342-48cf-9fab-165ea205728f {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:47:42 user nova-compute[72444]: INFO nova.compute.manager [req-3c428047-7a1f-428b-93c2-f5565d4a906f req-83610a52-c953-4695-ba27-e046d7938a42 service nova] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Neutron deleted interface fcb29ef9-b342-48cf-9fab-165ea205728f; detaching it from the instance and deleting it from the info cache
Aug 03 04:47:42 user nova-compute[72444]: DEBUG nova.network.neutron [req-3c428047-7a1f-428b-93c2-f5565d4a906f req-83610a52-c953-4695-ba27-e046d7938a42 service nova] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:47:42 user nova-compute[72444]: DEBUG nova.compute.manager [req-3c428047-7a1f-428b-93c2-f5565d4a906f req-83610a52-c953-4695-ba27-e046d7938a42 service nova] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Detach interface failed, port_id=fcb29ef9-b342-48cf-9fab-165ea205728f, reason: Instance 07450ea8-cb80-4318-9fc9-4268944d2cae could not be found. {{(pid=72444) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 03 04:47:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8727a443-a7d6-4ae8-a969-1adf81516eca tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8727a443-a7d6-4ae8-a969-1adf81516eca tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:42 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:47:42 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:47:42 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:47:42 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 04:47:43 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-8727a443-a7d6-4ae8-a969-1adf81516eca tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:47:43 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-8727a443-a7d6-4ae8-a969-1adf81516eca tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:47:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8727a443-a7d6-4ae8-a969-1adf81516eca tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:43 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-8727a443-a7d6-4ae8-a969-1adf81516eca tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Deleted allocations for instance 07450ea8-cb80-4318-9fc9-4268944d2cae
Aug 03 04:47:43 user nova-compute[72444]: DEBUG nova.compute.manager [req-19475de5-63c5-47c7-ac02-ec51d47c668c req-d0e36c14-f051-4776-8e08-d3d335fd42c0 service nova] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Received event network-vif-plugged-fcb29ef9-b342-48cf-9fab-165ea205728f {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:47:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-19475de5-63c5-47c7-ac02-ec51d47c668c req-d0e36c14-f051-4776-8e08-d3d335fd42c0 service nova] Acquiring lock "07450ea8-cb80-4318-9fc9-4268944d2cae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-19475de5-63c5-47c7-ac02-ec51d47c668c req-d0e36c14-f051-4776-8e08-d3d335fd42c0 service nova] Lock "07450ea8-cb80-4318-9fc9-4268944d2cae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-19475de5-63c5-47c7-ac02-ec51d47c668c req-d0e36c14-f051-4776-8e08-d3d335fd42c0 service nova] Lock "07450ea8-cb80-4318-9fc9-4268944d2cae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:43 user nova-compute[72444]: DEBUG nova.compute.manager [req-19475de5-63c5-47c7-ac02-ec51d47c668c req-d0e36c14-f051-4776-8e08-d3d335fd42c0 service nova] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] No waiting events found dispatching network-vif-plugged-fcb29ef9-b342-48cf-9fab-165ea205728f {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:47:43 user nova-compute[72444]: WARNING nova.compute.manager [req-19475de5-63c5-47c7-ac02-ec51d47c668c req-d0e36c14-f051-4776-8e08-d3d335fd42c0 service nova] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Received unexpected event network-vif-plugged-fcb29ef9-b342-48cf-9fab-165ea205728f for instance with vm_state deleted and task_state None.
Aug 03 04:47:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8727a443-a7d6-4ae8-a969-1adf81516eca tempest-ServerActionsV293TestJSON-780888408 tempest-ServerActionsV293TestJSON-780888408-project-member] Lock "07450ea8-cb80-4318-9fc9-4268944d2cae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.492s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:43 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:47:43 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:47:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:43 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 04:47:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:44 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:44 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:47:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1baadfd2-6f00-436b-b3a0-c850cd8cb50e/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1baadfd2-6f00-436b-b3a0-c850cd8cb50e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1baadfd2-6f00-436b-b3a0-c850cd8cb50e/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1baadfd2-6f00-436b-b3a0-c850cd8cb50e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26922d3f-0a2d-48d1-b758-9c87e0621fef/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26922d3f-0a2d-48d1-b758-9c87e0621fef/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26922d3f-0a2d-48d1-b758-9c87e0621fef/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26922d3f-0a2d-48d1-b758-9c87e0621fef/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json" returned: 0 in 0.128s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:46 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:47:47 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:47:47 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:47:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=7611MB free_disk=25.642772674560547GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 04:47:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:47:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 81725845-6158-4e34-bedb-6e41219bc227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:47:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance b6ed9c42-fa6e-4a0d-8312-588471e157f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:47:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance e3089887-56df-42de-bc62-88e6db28daf0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:47:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance e2859322-6f99-442d-bee1-65fe49ce6360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:47:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:47:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:47:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 26922d3f-0a2d-48d1-b758-9c87e0621fef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:47:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 1baadfd2-6f00-436b-b3a0-c850cd8cb50e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:47:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 04:47:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 04:47:47 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:47:47 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:47:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 04:47:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.433s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:48 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:47:48 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:47:48 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:47:48 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 04:47:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-7daab2c6-8768-46ed-a7bb-0ffbd107cf82" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:47:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-7daab2c6-8768-46ed-a7bb-0ffbd107cf82" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:47:49 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 04:47:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8ae6c0b0-84c8-4376-ae01-2d294172834c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "e2859322-6f99-442d-bee1-65fe49ce6360" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8ae6c0b0-84c8-4376-ae01-2d294172834c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "e2859322-6f99-442d-bee1-65fe49ce6360" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:49 user nova-compute[72444]: INFO nova.compute.manager [None req-8ae6c0b0-84c8-4376-ae01-2d294172834c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Detaching volume 6ea0c40c-f48f-4312-a6d2-229e3ab09ec2
Aug 03 04:47:49 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Updating instance_info_cache with network_info: [{"id": "841a11a2-ffb3-44cf-9e15-c8099578d405", "address": "fa:16:3e:12:4d:37", "network": {"id": "628fbd1c-7104-4911-9eb9-1f38c394bebd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-366258398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a65efd00e0ac4039bf1d6429787b8595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841a11a2-ff", "ovs_interfaceid": "841a11a2-ffb3-44cf-9e15-c8099578d405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:47:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-7daab2c6-8768-46ed-a7bb-0ffbd107cf82" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:47:49 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 04:47:49 user nova-compute[72444]: INFO nova.virt.block_device [None req-8ae6c0b0-84c8-4376-ae01-2d294172834c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Attempting to driver detach volume 6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 from mountpoint /dev/vdb
Aug 03 04:47:49 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-8ae6c0b0-84c8-4376-ae01-2d294172834c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Attempting to detach device vdb from instance e2859322-6f99-442d-bee1-65fe49ce6360 from the persistent domain config. {{(pid=72444) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 04:47:49 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-8ae6c0b0-84c8-4376-ae01-2d294172834c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 04:47:49 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:47:49 user nova-compute[72444]:   <source dev="/dev/sdc"/>
Aug 03 04:47:49 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:47:49 user nova-compute[72444]:   <serial>6ea0c40c-f48f-4312-a6d2-229e3ab09ec2</serial>
Aug 03 04:47:49 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 03 04:47:49 user nova-compute[72444]: </disk>
Aug 03 04:47:49 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:47:49 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-8ae6c0b0-84c8-4376-ae01-2d294172834c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Successfully detached device vdb from instance e2859322-6f99-442d-bee1-65fe49ce6360 from the persistent domain config.
Aug 03 04:47:49 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-8ae6c0b0-84c8-4376-ae01-2d294172834c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e2859322-6f99-442d-bee1-65fe49ce6360 from the live domain config. {{(pid=72444) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 04:47:49 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-8ae6c0b0-84c8-4376-ae01-2d294172834c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 04:47:49 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:47:49 user nova-compute[72444]:   <source dev="/dev/sdc"/>
Aug 03 04:47:49 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:47:49 user nova-compute[72444]:   <serial>6ea0c40c-f48f-4312-a6d2-229e3ab09ec2</serial>
Aug 03 04:47:49 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 03 04:47:49 user nova-compute[72444]: </disk>
Aug 03 04:47:49 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Received event <DeviceRemovedEvent: 1691038070.0433435, e2859322-6f99-442d-bee1-65fe49ce6360 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72444) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-8ae6c0b0-84c8-4376-ae01-2d294172834c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e2859322-6f99-442d-bee1-65fe49ce6360 {{(pid=72444) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 04:47:50 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-8ae6c0b0-84c8-4376-ae01-2d294172834c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Successfully detached device vdb from instance e2859322-6f99-442d-bee1-65fe49ce6360 from the live domain config.
Aug 03 04:47:50 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ae6c0b0-84c8-4376-ae01-2d294172834c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae6c0b0-84c8-4376-ae01-2d294172834c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'unJWagdE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:47:50 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-8ae6c0b0-84c8-4376-ae01-2d294172834c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:47:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-8ae6c0b0-84c8-4376-ae01-2d294172834c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-8ae6c0b0-84c8-4376-ae01-2d294172834c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae6c0b0-84c8-4376-ae01-2d294172834c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1f50c8-5abd-4e57-bcc2-fe4e44b64779]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[336f8854-50f8-4e03-aa19-8b4573cb1ae0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae6c0b0-84c8-4376-ae01-2d294172834c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)
Aug 03 04:47:50 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:47:50 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae6c0b0-84c8-4376-ae01-2d294172834c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 (non-flash)
Aug 03 04:47:50 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:47:50 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae6c0b0-84c8-4376-ae01-2d294172834c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3094493b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2'): ({'sdc'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-8ae6c0b0-84c8-4376-ae01-2d294172834c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Removing single pathed devices sdc {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84da889-3d23-4888-80f4-70362c201234]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[69638330-6ef4-4e06-8f78-60fb7a84fca4]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-8ae6c0b0-84c8-4376-ae01-2d294172834c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Flushing IO for device /dev/sdc {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da01361-cca4-4756-8a35-455665d23bac]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-8ae6c0b0-84c8-4376-ae01-2d294172834c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b37c40c-a09e-416c-95ae-580f7d09574d]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-8ae6c0b0-84c8-4376-ae01-2d294172834c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-8ae6c0b0-84c8-4376-ae01-2d294172834c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] SCSI volumes sdc have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae6c0b0-84c8-4376-ae01-2d294172834c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[126b7666-f86c-407d-91aa-8bd6b8a9539e]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae6c0b0-84c8-4376-ae01-2d294172834c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb5f19b-d9c3-4dd0-b290-622fe4354e9d]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae6c0b0-84c8-4376-ae01-2d294172834c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2, portal: 172.16.0.220,3260]
Aug 03 04:47:50 user nova-compute[72444]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2, portal: 172.16.0.220,3260] successful.
Aug 03 04:47:50 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ea0c40c-f48f-4312-a6d2-229e3ab09ec2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e4d87a-8ff9-43eb-9f10-f332f05888a7]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae6c0b0-84c8-4376-ae01-2d294172834c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-8ae6c0b0-84c8-4376-ae01-2d294172834c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.252s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae6c0b0-84c8-4376-ae01-2d294172834c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] <== disconnect_volume: return (253ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:47:50 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ae6c0b0-84c8-4376-ae01-2d294172834c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:47:51 user nova-compute[72444]: DEBUG nova.objects.instance [None req-8ae6c0b0-84c8-4376-ae01-2d294172834c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lazy-loading 'flavor' on Instance uuid e2859322-6f99-442d-bee1-65fe49ce6360 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:47:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8ae6c0b0-84c8-4376-ae01-2d294172834c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "e2859322-6f99-442d-bee1-65fe49ce6360" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.655s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Acquiring lock "2d74a02f-7180-4a2b-ac27-14c28d0b1d27" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "2d74a02f-7180-4a2b-ac27-14c28d0b1d27" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:52 user nova-compute[72444]: DEBUG nova.compute.manager [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 04:47:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:52 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 04:47:52 user nova-compute[72444]: INFO nova.compute.claims [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Claim successful on node user
Aug 03 04:47:52 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:47:52 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:47:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.383s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:52 user nova-compute[72444]: DEBUG nova.compute.manager [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 04:47:52 user nova-compute[72444]: DEBUG nova.compute.manager [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 04:47:52 user nova-compute[72444]: DEBUG nova.network.neutron [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 04:47:52 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 04:47:52 user nova-compute[72444]: DEBUG nova.compute.manager [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 04:47:53 user nova-compute[72444]: DEBUG nova.policy [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d998191ef0943ed95ba213e84d87bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccbd62645f54327a2b8999dcd9736ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 04:47:53 user nova-compute[72444]: DEBUG nova.compute.manager [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 04:47:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 04:47:53 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Creating image(s)
Aug 03 04:47:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Acquiring lock "/opt/stack/data/nova/instances/2d74a02f-7180-4a2b-ac27-14c28d0b1d27/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "/opt/stack/data/nova/instances/2d74a02f-7180-4a2b-ac27-14c28d0b1d27/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "/opt/stack/data/nova/instances/2d74a02f-7180-4a2b-ac27-14c28d0b1d27/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.132s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.133s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/2d74a02f-7180-4a2b-ac27-14c28d0b1d27/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/2d74a02f-7180-4a2b-ac27-14c28d0b1d27/disk 1073741824" returned: 0 in 0.065s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.135s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:53 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2d74a02f-7180-4a2b-ac27-14c28d0b1d27/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 04:47:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d74a02f-7180-4a2b-ac27-14c28d0b1d27/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:47:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d74a02f-7180-4a2b-ac27-14c28d0b1d27/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:47:53 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Cannot resize image /opt/stack/data/nova/instances/2d74a02f-7180-4a2b-ac27-14c28d0b1d27/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 04:47:53 user nova-compute[72444]: DEBUG nova.objects.instance [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lazy-loading 'migration_context' on Instance uuid 2d74a02f-7180-4a2b-ac27-14c28d0b1d27 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:47:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 04:47:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Ensure instance console log exists: /opt/stack/data/nova/instances/2d74a02f-7180-4a2b-ac27-14c28d0b1d27/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 04:47:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:53 user nova-compute[72444]: DEBUG nova.network.neutron [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Successfully created port: 12b5d245-d368-4a11-ad0f-29bb48dc743c {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:47:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:54 user nova-compute[72444]: DEBUG nova.network.neutron [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Successfully updated port: 12b5d245-d368-4a11-ad0f-29bb48dc743c {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:47:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Acquiring lock "refresh_cache-2d74a02f-7180-4a2b-ac27-14c28d0b1d27" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:47:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Acquired lock "refresh_cache-2d74a02f-7180-4a2b-ac27-14c28d0b1d27" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:47:54 user nova-compute[72444]: DEBUG nova.network.neutron [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:47:54 user nova-compute[72444]: DEBUG nova.compute.manager [req-16750094-a8e3-42cd-b0a7-1edbb8215fbf req-3b6da9dd-caf6-4524-aea9-af6bb37b59f0 service nova] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Received event network-changed-12b5d245-d368-4a11-ad0f-29bb48dc743c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:47:54 user nova-compute[72444]: DEBUG nova.compute.manager [req-16750094-a8e3-42cd-b0a7-1edbb8215fbf req-3b6da9dd-caf6-4524-aea9-af6bb37b59f0 service nova] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Refreshing instance network info cache due to event network-changed-12b5d245-d368-4a11-ad0f-29bb48dc743c. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:47:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-16750094-a8e3-42cd-b0a7-1edbb8215fbf req-3b6da9dd-caf6-4524-aea9-af6bb37b59f0 service nova] Acquiring lock "refresh_cache-2d74a02f-7180-4a2b-ac27-14c28d0b1d27" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:47:54 user nova-compute[72444]: DEBUG nova.network.neutron [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG nova.network.neutron [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Updating instance_info_cache with network_info: [{"id": "12b5d245-d368-4a11-ad0f-29bb48dc743c", "address": "fa:16:3e:52:1b:c5", "network": {"id": "dc891e23-2b3b-44ae-8110-60fe01fe5e24", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1956899419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ccbd62645f54327a2b8999dcd9736ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12b5d245-d3", "ovs_interfaceid": "12b5d245-d368-4a11-ad0f-29bb48dc743c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Releasing lock "refresh_cache-2d74a02f-7180-4a2b-ac27-14c28d0b1d27" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG nova.compute.manager [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Instance network_info: |[{"id": "12b5d245-d368-4a11-ad0f-29bb48dc743c", "address": "fa:16:3e:52:1b:c5", "network": {"id": "dc891e23-2b3b-44ae-8110-60fe01fe5e24", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1956899419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ccbd62645f54327a2b8999dcd9736ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12b5d245-d3", "ovs_interfaceid": "12b5d245-d368-4a11-ad0f-29bb48dc743c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-16750094-a8e3-42cd-b0a7-1edbb8215fbf req-3b6da9dd-caf6-4524-aea9-af6bb37b59f0 service nova] Acquired lock "refresh_cache-2d74a02f-7180-4a2b-ac27-14c28d0b1d27" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG nova.network.neutron [req-16750094-a8e3-42cd-b0a7-1edbb8215fbf req-3b6da9dd-caf6-4524-aea9-af6bb37b59f0 service nova] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Refreshing network info cache for port 12b5d245-d368-4a11-ad0f-29bb48dc743c {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Start _get_guest_xml network_info=[{"id": "12b5d245-d368-4a11-ad0f-29bb48dc743c", "address": "fa:16:3e:52:1b:c5", "network": {"id": "dc891e23-2b3b-44ae-8110-60fe01fe5e24", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1956899419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ccbd62645f54327a2b8999dcd9736ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12b5d245-d3", "ovs_interfaceid": "12b5d245-d368-4a11-ad0f-29bb48dc743c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:47:55 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:47:55 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:47:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:47:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1369067319',display_name='tempest-VolumesAdminNegativeTest-server-1369067319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1369067319',id=20,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ccbd62645f54327a2b8999dcd9736ce',ramdisk_id='',reservation_id='r-1utgk7kb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1069854833',owner_user_name='tempest-VolumesAdminNegativeTest-1069854833-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:47:53Z,user_data=None,user_id='4d998191ef0943ed95ba213e84d87bdc',uuid=2d74a02f-7180-4a2b-ac27-14c28d0b1d27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12b5d245-d368-4a11-ad0f-29bb48dc743c", "address": "fa:16:3e:52:1b:c5", "network": {"id": "dc891e23-2b3b-44ae-8110-60fe01fe5e24", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1956899419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ccbd62645f54327a2b8999dcd9736ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12b5d245-d3", "ovs_interfaceid": "12b5d245-d368-4a11-ad0f-29bb48dc743c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Converting VIF {"id": "12b5d245-d368-4a11-ad0f-29bb48dc743c", "address": "fa:16:3e:52:1b:c5", "network": {"id": "dc891e23-2b3b-44ae-8110-60fe01fe5e24", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1956899419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ccbd62645f54327a2b8999dcd9736ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12b5d245-d3", "ovs_interfaceid": "12b5d245-d368-4a11-ad0f-29bb48dc743c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:1b:c5,bridge_name='br-int',has_traffic_filtering=True,id=12b5d245-d368-4a11-ad0f-29bb48dc743c,network=Network(dc891e23-2b3b-44ae-8110-60fe01fe5e24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12b5d245-d3') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG nova.objects.instance [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d74a02f-7180-4a2b-ac27-14c28d0b1d27 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:47:55 user nova-compute[72444]:   <uuid>2d74a02f-7180-4a2b-ac27-14c28d0b1d27</uuid>
Aug 03 04:47:55 user nova-compute[72444]:   <name>instance-00000014</name>
Aug 03 04:47:55 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:47:55 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:47:55 user nova-compute[72444]:   <metadata>
Aug 03 04:47:55 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:47:55 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:47:55 user nova-compute[72444]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1369067319</nova:name>
Aug 03 04:47:55 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:47:55</nova:creationTime>
Aug 03 04:47:55 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:47:55 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:47:55 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:47:55 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:47:55 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:47:55 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:47:55 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:47:55 user nova-compute[72444]:       <nova:owner>
Aug 03 04:47:55 user nova-compute[72444]:         <nova:user uuid="4d998191ef0943ed95ba213e84d87bdc">tempest-VolumesAdminNegativeTest-1069854833-project-member</nova:user>
Aug 03 04:47:55 user nova-compute[72444]:         <nova:project uuid="5ccbd62645f54327a2b8999dcd9736ce">tempest-VolumesAdminNegativeTest-1069854833</nova:project>
Aug 03 04:47:55 user nova-compute[72444]:       </nova:owner>
Aug 03 04:47:55 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:47:55 user nova-compute[72444]:       <nova:ports>
Aug 03 04:47:55 user nova-compute[72444]:         <nova:port uuid="12b5d245-d368-4a11-ad0f-29bb48dc743c">
Aug 03 04:47:55 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 03 04:47:55 user nova-compute[72444]:         </nova:port>
Aug 03 04:47:55 user nova-compute[72444]:       </nova:ports>
Aug 03 04:47:55 user nova-compute[72444]:     </nova:instance>
Aug 03 04:47:55 user nova-compute[72444]:   </metadata>
Aug 03 04:47:55 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:47:55 user nova-compute[72444]:     <system>
Aug 03 04:47:55 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:47:55 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:47:55 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:47:55 user nova-compute[72444]:       <entry name="serial">2d74a02f-7180-4a2b-ac27-14c28d0b1d27</entry>
Aug 03 04:47:55 user nova-compute[72444]:       <entry name="uuid">2d74a02f-7180-4a2b-ac27-14c28d0b1d27</entry>
Aug 03 04:47:55 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:47:55 user nova-compute[72444]:     </system>
Aug 03 04:47:55 user nova-compute[72444]:   </sysinfo>
Aug 03 04:47:55 user nova-compute[72444]:   <os>
Aug 03 04:47:55 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:47:55 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:47:55 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:47:55 user nova-compute[72444]:   </os>
Aug 03 04:47:55 user nova-compute[72444]:   <features>
Aug 03 04:47:55 user nova-compute[72444]:     <acpi/>
Aug 03 04:47:55 user nova-compute[72444]:     <apic/>
Aug 03 04:47:55 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:47:55 user nova-compute[72444]:   </features>
Aug 03 04:47:55 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:47:55 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:47:55 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:47:55 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:47:55 user nova-compute[72444]:   </clock>
Aug 03 04:47:55 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:47:55 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:47:55 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:47:55 user nova-compute[72444]:   </cpu>
Aug 03 04:47:55 user nova-compute[72444]:   <devices>
Aug 03 04:47:55 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:47:55 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:47:55 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/2d74a02f-7180-4a2b-ac27-14c28d0b1d27/disk"/>
Aug 03 04:47:55 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:47:55 user nova-compute[72444]:     </disk>
Aug 03 04:47:55 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:47:55 user nova-compute[72444]:       <mac address="fa:16:3e:52:1b:c5"/>
Aug 03 04:47:55 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:47:55 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:47:55 user nova-compute[72444]:       <target dev="tap12b5d245-d3"/>
Aug 03 04:47:55 user nova-compute[72444]:     </interface>
Aug 03 04:47:55 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:47:55 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/2d74a02f-7180-4a2b-ac27-14c28d0b1d27/console.log" append="off"/>
Aug 03 04:47:55 user nova-compute[72444]:     </serial>
Aug 03 04:47:55 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:47:55 user nova-compute[72444]:     <video>
Aug 03 04:47:55 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:47:55 user nova-compute[72444]:     </video>
Aug 03 04:47:55 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:47:55 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:47:55 user nova-compute[72444]:     </rng>
Aug 03 04:47:55 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:47:55 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:47:55 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:47:55 user nova-compute[72444]:     </memballoon>
Aug 03 04:47:55 user nova-compute[72444]:   </devices>
Aug 03 04:47:55 user nova-compute[72444]: </domain>
Aug 03 04:47:55 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:47:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1369067319',display_name='tempest-VolumesAdminNegativeTest-server-1369067319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1369067319',id=20,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ccbd62645f54327a2b8999dcd9736ce',ramdisk_id='',reservation_id='r-1utgk7kb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1069854833',owner_user_name='tempest-VolumesAdminNegativeTest-1069854833-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:47:53Z,user_data=None,user_id='4d998191ef0943ed95ba213e84d87bdc',uuid=2d74a02f-7180-4a2b-ac27-14c28d0b1d27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12b5d245-d368-4a11-ad0f-29bb48dc743c", "address": "fa:16:3e:52:1b:c5", "network": {"id": "dc891e23-2b3b-44ae-8110-60fe01fe5e24", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1956899419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ccbd62645f54327a2b8999dcd9736ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12b5d245-d3", "ovs_interfaceid": "12b5d245-d368-4a11-ad0f-29bb48dc743c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Converting VIF {"id": "12b5d245-d368-4a11-ad0f-29bb48dc743c", "address": "fa:16:3e:52:1b:c5", "network": {"id": "dc891e23-2b3b-44ae-8110-60fe01fe5e24", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1956899419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ccbd62645f54327a2b8999dcd9736ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12b5d245-d3", "ovs_interfaceid": "12b5d245-d368-4a11-ad0f-29bb48dc743c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:1b:c5,bridge_name='br-int',has_traffic_filtering=True,id=12b5d245-d368-4a11-ad0f-29bb48dc743c,network=Network(dc891e23-2b3b-44ae-8110-60fe01fe5e24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12b5d245-d3') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG os_vif [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:1b:c5,bridge_name='br-int',has_traffic_filtering=True,id=12b5d245-d368-4a11-ad0f-29bb48dc743c,network=Network(dc891e23-2b3b-44ae-8110-60fe01fe5e24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12b5d245-d3') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap12b5d245-d3, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap12b5d245-d3, col_values=(('external_ids', {'iface-id': '12b5d245-d368-4a11-ad0f-29bb48dc743c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:1b:c5', 'vm-uuid': '2d74a02f-7180-4a2b-ac27-14c28d0b1d27'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:55 user nova-compute[72444]: INFO os_vif [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:1b:c5,bridge_name='br-int',has_traffic_filtering=True,id=12b5d245-d368-4a11-ad0f-29bb48dc743c,network=Network(dc891e23-2b3b-44ae-8110-60fe01fe5e24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12b5d245-d3')
Aug 03 04:47:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] No VIF found with MAC fa:16:3e:52:1b:c5, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG nova.network.neutron [req-16750094-a8e3-42cd-b0a7-1edbb8215fbf req-3b6da9dd-caf6-4524-aea9-af6bb37b59f0 service nova] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Updated VIF entry in instance network info cache for port 12b5d245-d368-4a11-ad0f-29bb48dc743c. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG nova.network.neutron [req-16750094-a8e3-42cd-b0a7-1edbb8215fbf req-3b6da9dd-caf6-4524-aea9-af6bb37b59f0 service nova] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Updating instance_info_cache with network_info: [{"id": "12b5d245-d368-4a11-ad0f-29bb48dc743c", "address": "fa:16:3e:52:1b:c5", "network": {"id": "dc891e23-2b3b-44ae-8110-60fe01fe5e24", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1956899419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ccbd62645f54327a2b8999dcd9736ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12b5d245-d3", "ovs_interfaceid": "12b5d245-d368-4a11-ad0f-29bb48dc743c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:47:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-16750094-a8e3-42cd-b0a7-1edbb8215fbf req-3b6da9dd-caf6-4524-aea9-af6bb37b59f0 service nova] Releasing lock "refresh_cache-2d74a02f-7180-4a2b-ac27-14c28d0b1d27" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:47:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:56 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691038061.6085632, 07450ea8-cb80-4318-9fc9-4268944d2cae => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:47:56 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] VM Stopped (Lifecycle Event)
Aug 03 04:47:56 user nova-compute[72444]: DEBUG nova.compute.manager [None req-be3bae55-64e1-4d8c-ac08-d1170a9d047e None None] [instance: 07450ea8-cb80-4318-9fc9-4268944d2cae] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:47:56 user nova-compute[72444]: DEBUG nova.compute.manager [req-b7dd9b58-9446-420b-9bfd-60b1f068e7fc req-a56dd949-d05b-4a1d-9158-30e6f93387e5 service nova] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Received event network-vif-plugged-12b5d245-d368-4a11-ad0f-29bb48dc743c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:47:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b7dd9b58-9446-420b-9bfd-60b1f068e7fc req-a56dd949-d05b-4a1d-9158-30e6f93387e5 service nova] Acquiring lock "2d74a02f-7180-4a2b-ac27-14c28d0b1d27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b7dd9b58-9446-420b-9bfd-60b1f068e7fc req-a56dd949-d05b-4a1d-9158-30e6f93387e5 service nova] Lock "2d74a02f-7180-4a2b-ac27-14c28d0b1d27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b7dd9b58-9446-420b-9bfd-60b1f068e7fc req-a56dd949-d05b-4a1d-9158-30e6f93387e5 service nova] Lock "2d74a02f-7180-4a2b-ac27-14c28d0b1d27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:56 user nova-compute[72444]: DEBUG nova.compute.manager [req-b7dd9b58-9446-420b-9bfd-60b1f068e7fc req-a56dd949-d05b-4a1d-9158-30e6f93387e5 service nova] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] No waiting events found dispatching network-vif-plugged-12b5d245-d368-4a11-ad0f-29bb48dc743c {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:47:56 user nova-compute[72444]: WARNING nova.compute.manager [req-b7dd9b58-9446-420b-9bfd-60b1f068e7fc req-a56dd949-d05b-4a1d-9158-30e6f93387e5 service nova] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Received unexpected event network-vif-plugged-12b5d245-d368-4a11-ad0f-29bb48dc743c for instance with vm_state building and task_state spawning.
Aug 03 04:47:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:47:58 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038078.7131386, 2d74a02f-7180-4a2b-ac27-14c28d0b1d27 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:47:58 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] VM Resumed (Lifecycle Event)
Aug 03 04:47:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:47:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 04:47:58 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Instance spawned successfully.
Aug 03 04:47:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 04:47:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:47:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:47:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:47:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:47:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:47:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:47:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:47:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:47:58 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:47:58 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038078.714237, 2d74a02f-7180-4a2b-ac27-14c28d0b1d27 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:47:58 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] VM Started (Lifecycle Event)
Aug 03 04:47:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:47:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:47:58 user nova-compute[72444]: DEBUG nova.compute.manager [req-f29257bf-a69f-44f8-8a23-a2de8d8356e5 req-2be026ee-a284-457b-b4aa-2d02b013980d service nova] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Received event network-vif-plugged-12b5d245-d368-4a11-ad0f-29bb48dc743c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:47:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f29257bf-a69f-44f8-8a23-a2de8d8356e5 req-2be026ee-a284-457b-b4aa-2d02b013980d service nova] Acquiring lock "2d74a02f-7180-4a2b-ac27-14c28d0b1d27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:47:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f29257bf-a69f-44f8-8a23-a2de8d8356e5 req-2be026ee-a284-457b-b4aa-2d02b013980d service nova] Lock "2d74a02f-7180-4a2b-ac27-14c28d0b1d27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:47:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f29257bf-a69f-44f8-8a23-a2de8d8356e5 req-2be026ee-a284-457b-b4aa-2d02b013980d service nova] Lock "2d74a02f-7180-4a2b-ac27-14c28d0b1d27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:58 user nova-compute[72444]: DEBUG nova.compute.manager [req-f29257bf-a69f-44f8-8a23-a2de8d8356e5 req-2be026ee-a284-457b-b4aa-2d02b013980d service nova] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] No waiting events found dispatching network-vif-plugged-12b5d245-d368-4a11-ad0f-29bb48dc743c {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:47:58 user nova-compute[72444]: WARNING nova.compute.manager [req-f29257bf-a69f-44f8-8a23-a2de8d8356e5 req-2be026ee-a284-457b-b4aa-2d02b013980d service nova] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Received unexpected event network-vif-plugged-12b5d245-d368-4a11-ad0f-29bb48dc743c for instance with vm_state building and task_state spawning.
Aug 03 04:47:58 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:47:58 user nova-compute[72444]: INFO nova.compute.manager [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Took 5.72 seconds to spawn the instance on the hypervisor.
Aug 03 04:47:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:47:58 user nova-compute[72444]: INFO nova.compute.manager [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Took 6.40 seconds to build instance.
Aug 03 04:47:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0f7de760-03e8-4fb5-92d4-fd35de6d7b1c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "2d74a02f-7180-4a2b-ac27-14c28d0b1d27" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.492s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:47:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:18 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:19 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:29 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:40 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:48:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:42 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:48:43 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:48:43 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 04:48:44 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:44 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:48:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:45 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:48:45 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:48:45 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:48:45 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:48:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:48:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:48:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:48:45 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 04:48:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:48:46 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:48:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:48:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:48:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:48:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:48:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:48:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:48:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:48:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:48:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:48:47 user nova-compute[72444]: DEBUG nova.objects.instance [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lazy-loading 'flavor' on Instance uuid 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:48:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:48:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "refresh_cache-7daab2c6-8768-46ed-a7bb-0ffbd107cf82" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:48:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquired lock "refresh_cache-7daab2c6-8768-46ed-a7bb-0ffbd107cf82" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:48:47 user nova-compute[72444]: DEBUG nova.network.neutron [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:48:47 user nova-compute[72444]: DEBUG nova.objects.instance [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lazy-loading 'info_cache' on Instance uuid 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:48:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1baadfd2-6f00-436b-b3a0-c850cd8cb50e/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:48:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1baadfd2-6f00-436b-b3a0-c850cd8cb50e/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:48:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1baadfd2-6f00-436b-b3a0-c850cd8cb50e/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:48:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1baadfd2-6f00-436b-b3a0-c850cd8cb50e/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:48:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:48:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:48:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:48:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:48:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26922d3f-0a2d-48d1-b758-9c87e0621fef/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:48:47 user nova-compute[72444]: DEBUG nova.network.neutron [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Updating instance_info_cache with network_info: [{"id": "841a11a2-ffb3-44cf-9e15-c8099578d405", "address": "fa:16:3e:12:4d:37", "network": {"id": "628fbd1c-7104-4911-9eb9-1f38c394bebd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-366258398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a65efd00e0ac4039bf1d6429787b8595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841a11a2-ff", "ovs_interfaceid": "841a11a2-ffb3-44cf-9e15-c8099578d405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:48:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Releasing lock "refresh_cache-7daab2c6-8768-46ed-a7bb-0ffbd107cf82" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:48:48 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Instance destroyed successfully.
Aug 03 04:48:48 user nova-compute[72444]: DEBUG nova.objects.instance [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lazy-loading 'resources' on Instance uuid 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1937092257',display_name='tempest-AttachVolumeTestJSON-server-1937092257',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1937092257',id=8,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4GYonfRcDLCfzVaxO6+Z3h0SUoVfhhQmBtRpHMqljFVb2ikupLBIuKrpUkeWbdkWIlD6P8Fdx/ixyrvXF+8nK0TaaJy2ZUXJb0m3JpcoPOM4+0nQ1vkeu15aXRWeoGNg==',key_name='tempest-keypair-142269823',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:41:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a65efd00e0ac4039bf1d6429787b8595',ramdisk_id='',reservation_id='r-gcoy75p0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1814863301',owner_user_name='tempest-AttachVolumeTestJSON-1814863301-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:46:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e44603a26afa49098e76422420c825c2',uuid=7daab2c6-8768-46ed-a7bb-0ffbd107cf82,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "841a11a2-ffb3-44cf-9e15-c8099578d405", "address": "fa:16:3e:12:4d:37", "network": {"id": "628fbd1c-7104-4911-9eb9-1f38c394bebd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-366258398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a65efd00e0ac4039bf1d6429787b8595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841a11a2-ff", "ovs_interfaceid": "841a11a2-ffb3-44cf-9e15-c8099578d405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Converting VIF {"id": "841a11a2-ffb3-44cf-9e15-c8099578d405", "address": "fa:16:3e:12:4d:37", "network": {"id": "628fbd1c-7104-4911-9eb9-1f38c394bebd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-366258398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a65efd00e0ac4039bf1d6429787b8595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841a11a2-ff", "ovs_interfaceid": "841a11a2-ffb3-44cf-9e15-c8099578d405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:4d:37,bridge_name='br-int',has_traffic_filtering=True,id=841a11a2-ffb3-44cf-9e15-c8099578d405,network=Network(628fbd1c-7104-4911-9eb9-1f38c394bebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841a11a2-ff') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG os_vif [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:4d:37,bridge_name='br-int',has_traffic_filtering=True,id=841a11a2-ffb3-44cf-9e15-c8099578d405,network=Network(628fbd1c-7104-4911-9eb9-1f38c394bebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841a11a2-ff') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap841a11a2-ff, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:48 user nova-compute[72444]: INFO os_vif [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:4d:37,bridge_name='br-int',has_traffic_filtering=True,id=841a11a2-ffb3-44cf-9e15-c8099578d405,network=Network(628fbd1c-7104-4911-9eb9-1f38c394bebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841a11a2-ff')
Aug 03 04:48:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26922d3f-0a2d-48d1-b758-9c87e0621fef/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26922d3f-0a2d-48d1-b758-9c87e0621fef/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Start _get_guest_xml network_info=[{"id": "841a11a2-ffb3-44cf-9e15-c8099578d405", "address": "fa:16:3e:12:4d:37", "network": {"id": "628fbd1c-7104-4911-9eb9-1f38c394bebd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-366258398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a65efd00e0ac4039bf1d6429787b8595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841a11a2-ff", "ovs_interfaceid": "841a11a2-ffb3-44cf-9e15-c8099578d405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG nova.objects.instance [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lazy-loading 'numa_topology' on Instance uuid 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:48:48 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:48:48 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:48:48 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG nova.objects.instance [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1937092257',display_name='tempest-AttachVolumeTestJSON-server-1937092257',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1937092257',id=8,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4GYonfRcDLCfzVaxO6+Z3h0SUoVfhhQmBtRpHMqljFVb2ikupLBIuKrpUkeWbdkWIlD6P8Fdx/ixyrvXF+8nK0TaaJy2ZUXJb0m3JpcoPOM4+0nQ1vkeu15aXRWeoGNg==',key_name='tempest-keypair-142269823',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:41:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a65efd00e0ac4039bf1d6429787b8595',ramdisk_id='',reservation_id='r-gcoy75p0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1814863301',owner_user_name='tempest-AttachVolumeTestJSON-1814863301-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:46:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e44603a26afa49098e76422420c825c2',uuid=7daab2c6-8768-46ed-a7bb-0ffbd107cf82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "841a11a2-ffb3-44cf-9e15-c8099578d405", "address": "fa:16:3e:12:4d:37", "network": {"id": "628fbd1c-7104-4911-9eb9-1f38c394bebd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-366258398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a65efd00e0ac4039bf1d6429787b8595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841a11a2-ff", "ovs_interfaceid": "841a11a2-ffb3-44cf-9e15-c8099578d405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Converting VIF {"id": "841a11a2-ffb3-44cf-9e15-c8099578d405", "address": "fa:16:3e:12:4d:37", "network": {"id": "628fbd1c-7104-4911-9eb9-1f38c394bebd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-366258398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a65efd00e0ac4039bf1d6429787b8595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841a11a2-ff", "ovs_interfaceid": "841a11a2-ffb3-44cf-9e15-c8099578d405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:4d:37,bridge_name='br-int',has_traffic_filtering=True,id=841a11a2-ffb3-44cf-9e15-c8099578d405,network=Network(628fbd1c-7104-4911-9eb9-1f38c394bebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841a11a2-ff') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG nova.objects.instance [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lazy-loading 'pci_devices' on Instance uuid 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26922d3f-0a2d-48d1-b758-9c87e0621fef/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:48:48 user nova-compute[72444]:   <uuid>7daab2c6-8768-46ed-a7bb-0ffbd107cf82</uuid>
Aug 03 04:48:48 user nova-compute[72444]:   <name>instance-00000008</name>
Aug 03 04:48:48 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:48:48 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:48:48 user nova-compute[72444]:   <metadata>
Aug 03 04:48:48 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:48:48 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:48:48 user nova-compute[72444]:       <nova:name>tempest-AttachVolumeTestJSON-server-1937092257</nova:name>
Aug 03 04:48:48 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:48:48</nova:creationTime>
Aug 03 04:48:48 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:48:48 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:48:48 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:48:48 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:48:48 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:48:48 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:48:48 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:48:48 user nova-compute[72444]:       <nova:owner>
Aug 03 04:48:48 user nova-compute[72444]:         <nova:user uuid="e44603a26afa49098e76422420c825c2">tempest-AttachVolumeTestJSON-1814863301-project-member</nova:user>
Aug 03 04:48:48 user nova-compute[72444]:         <nova:project uuid="a65efd00e0ac4039bf1d6429787b8595">tempest-AttachVolumeTestJSON-1814863301</nova:project>
Aug 03 04:48:48 user nova-compute[72444]:       </nova:owner>
Aug 03 04:48:48 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:48:48 user nova-compute[72444]:       <nova:ports>
Aug 03 04:48:48 user nova-compute[72444]:         <nova:port uuid="841a11a2-ffb3-44cf-9e15-c8099578d405">
Aug 03 04:48:48 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 03 04:48:48 user nova-compute[72444]:         </nova:port>
Aug 03 04:48:48 user nova-compute[72444]:       </nova:ports>
Aug 03 04:48:48 user nova-compute[72444]:     </nova:instance>
Aug 03 04:48:48 user nova-compute[72444]:   </metadata>
Aug 03 04:48:48 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:48:48 user nova-compute[72444]:     <system>
Aug 03 04:48:48 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:48:48 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:48:48 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:48:48 user nova-compute[72444]:       <entry name="serial">7daab2c6-8768-46ed-a7bb-0ffbd107cf82</entry>
Aug 03 04:48:48 user nova-compute[72444]:       <entry name="uuid">7daab2c6-8768-46ed-a7bb-0ffbd107cf82</entry>
Aug 03 04:48:48 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:48:48 user nova-compute[72444]:     </system>
Aug 03 04:48:48 user nova-compute[72444]:   </sysinfo>
Aug 03 04:48:48 user nova-compute[72444]:   <os>
Aug 03 04:48:48 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:48:48 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:48:48 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:48:48 user nova-compute[72444]:   </os>
Aug 03 04:48:48 user nova-compute[72444]:   <features>
Aug 03 04:48:48 user nova-compute[72444]:     <acpi/>
Aug 03 04:48:48 user nova-compute[72444]:     <apic/>
Aug 03 04:48:48 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:48:48 user nova-compute[72444]:   </features>
Aug 03 04:48:48 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:48:48 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:48:48 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:48:48 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:48:48 user nova-compute[72444]:   </clock>
Aug 03 04:48:48 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:48:48 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:48:48 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:48:48 user nova-compute[72444]:   </cpu>
Aug 03 04:48:48 user nova-compute[72444]:   <devices>
Aug 03 04:48:48 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:48:48 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:48:48 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk"/>
Aug 03 04:48:48 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:48:48 user nova-compute[72444]:     </disk>
Aug 03 04:48:48 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:48:48 user nova-compute[72444]:       <mac address="fa:16:3e:12:4d:37"/>
Aug 03 04:48:48 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:48:48 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:48:48 user nova-compute[72444]:       <target dev="tap841a11a2-ff"/>
Aug 03 04:48:48 user nova-compute[72444]:     </interface>
Aug 03 04:48:48 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:48:48 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/console.log" append="off"/>
Aug 03 04:48:48 user nova-compute[72444]:     </serial>
Aug 03 04:48:48 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:48:48 user nova-compute[72444]:     <video>
Aug 03 04:48:48 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:48:48 user nova-compute[72444]:     </video>
Aug 03 04:48:48 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:48:48 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:48:48 user nova-compute[72444]:     </rng>
Aug 03 04:48:48 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:48:48 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:48:48 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:48:48 user nova-compute[72444]:     </memballoon>
Aug 03 04:48:48 user nova-compute[72444]:   </devices>
Aug 03 04:48:48 user nova-compute[72444]: </domain>
Aug 03 04:48:48 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json" returned: 0 in 0.477s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json" returned: 0 in 0.423s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG nova.objects.instance [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:48:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:48:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:48:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:48:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.153s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:48:49 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 04:48:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:48:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:48:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:48:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:48:49 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Cannot resize image /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 04:48:49 user nova-compute[72444]: DEBUG nova.objects.instance [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lazy-loading 'migration_context' on Instance uuid 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:48:49 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1937092257',display_name='tempest-AttachVolumeTestJSON-server-1937092257',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1937092257',id=8,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4GYonfRcDLCfzVaxO6+Z3h0SUoVfhhQmBtRpHMqljFVb2ikupLBIuKrpUkeWbdkWIlD6P8Fdx/ixyrvXF+8nK0TaaJy2ZUXJb0m3JpcoPOM4+0nQ1vkeu15aXRWeoGNg==',key_name='tempest-keypair-142269823',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:41:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='a65efd00e0ac4039bf1d6429787b8595',ramdisk_id='',reservation_id='r-gcoy75p0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1814863301',owner_user_name='tempest-AttachVolumeTestJSON-1814863301-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:46:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e44603a26afa49098e76422420c825c2',uuid=7daab2c6-8768-46ed-a7bb-0ffbd107cf82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "841a11a2-ffb3-44cf-9e15-c8099578d405", "address": "fa:16:3e:12:4d:37", "network": {"id": "628fbd1c-7104-4911-9eb9-1f38c394bebd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-366258398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a65efd00e0ac4039bf1d6429787b8595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841a11a2-ff", "ovs_interfaceid": "841a11a2-ffb3-44cf-9e15-c8099578d405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:48:49 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Converting VIF {"id": "841a11a2-ffb3-44cf-9e15-c8099578d405", "address": "fa:16:3e:12:4d:37", "network": {"id": "628fbd1c-7104-4911-9eb9-1f38c394bebd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-366258398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a65efd00e0ac4039bf1d6429787b8595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841a11a2-ff", "ovs_interfaceid": "841a11a2-ffb3-44cf-9e15-c8099578d405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:48:49 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:4d:37,bridge_name='br-int',has_traffic_filtering=True,id=841a11a2-ffb3-44cf-9e15-c8099578d405,network=Network(628fbd1c-7104-4911-9eb9-1f38c394bebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841a11a2-ff') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:48:49 user nova-compute[72444]: DEBUG os_vif [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:4d:37,bridge_name='br-int',has_traffic_filtering=True,id=841a11a2-ffb3-44cf-9e15-c8099578d405,network=Network(628fbd1c-7104-4911-9eb9-1f38c394bebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841a11a2-ff') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:48:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:48:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:48:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap841a11a2-ff, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:48:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap841a11a2-ff, col_values=(('external_ids', {'iface-id': '841a11a2-ffb3-44cf-9e15-c8099578d405', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:4d:37', 'vm-uuid': '7daab2c6-8768-46ed-a7bb-0ffbd107cf82'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:48:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:48:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:49 user nova-compute[72444]: INFO os_vif [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:4d:37,bridge_name='br-int',has_traffic_filtering=True,id=841a11a2-ffb3-44cf-9e15-c8099578d405,network=Network(628fbd1c-7104-4911-9eb9-1f38c394bebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841a11a2-ff')
Aug 03 04:48:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:48:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:48:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:48:49 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:48:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d74a02f-7180-4a2b-ac27-14c28d0b1d27/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:48:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Acquiring lock "bc1913f1-dc7d-40ef-9ab4-83e295135f30" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:48:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Lock "bc1913f1-dc7d-40ef-9ab4-83e295135f30" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:48:49 user nova-compute[72444]: DEBUG nova.compute.manager [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 04:48:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d74a02f-7180-4a2b-ac27-14c28d0b1d27/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:48:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d74a02f-7180-4a2b-ac27-14c28d0b1d27/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:48:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:48:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:48:49 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 04:48:49 user nova-compute[72444]: INFO nova.compute.claims [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Claim successful on node user
Aug 03 04:48:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d74a02f-7180-4a2b-ac27-14c28d0b1d27/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:48:50 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:48:50 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:48:50 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=7677MB free_disk=25.609622955322266GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 04:48:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:48:50 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:48:50 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:48:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.916s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:48:50 user nova-compute[72444]: DEBUG nova.compute.manager [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 04:48:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.404s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:48:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:50 user nova-compute[72444]: DEBUG nova.compute.manager [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 04:48:50 user nova-compute[72444]: DEBUG nova.network.neutron [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 04:48:50 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 04:48:50 user nova-compute[72444]: DEBUG nova.compute.manager [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 04:48:50 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:48:50 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 81725845-6158-4e34-bedb-6e41219bc227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:48:50 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance b6ed9c42-fa6e-4a0d-8312-588471e157f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:48:50 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance e3089887-56df-42de-bc62-88e6db28daf0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:48:50 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance e2859322-6f99-442d-bee1-65fe49ce6360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 26922d3f-0a2d-48d1-b758-9c87e0621fef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 1baadfd2-6f00-436b-b3a0-c850cd8cb50e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 2d74a02f-7180-4a2b-ac27-14c28d0b1d27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance bc1913f1-dc7d-40ef-9ab4-83e295135f30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG nova.policy [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'afb9c50fa527465a92b94d11c1e149fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e9906216f4b84b3fcc344a9b897ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG nova.compute.manager [req-db76237b-bd8e-4e04-b311-3b09e42c6611 req-41f186c0-1d12-4c5a-bb94-c3e1b20f5444 service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Received event network-vif-plugged-841a11a2-ffb3-44cf-9e15-c8099578d405 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-db76237b-bd8e-4e04-b311-3b09e42c6611 req-41f186c0-1d12-4c5a-bb94-c3e1b20f5444 service nova] Acquiring lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-db76237b-bd8e-4e04-b311-3b09e42c6611 req-41f186c0-1d12-4c5a-bb94-c3e1b20f5444 service nova] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-db76237b-bd8e-4e04-b311-3b09e42c6611 req-41f186c0-1d12-4c5a-bb94-c3e1b20f5444 service nova] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG nova.compute.manager [req-db76237b-bd8e-4e04-b311-3b09e42c6611 req-41f186c0-1d12-4c5a-bb94-c3e1b20f5444 service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] No waiting events found dispatching network-vif-plugged-841a11a2-ffb3-44cf-9e15-c8099578d405 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:48:51 user nova-compute[72444]: WARNING nova.compute.manager [req-db76237b-bd8e-4e04-b311-3b09e42c6611 req-41f186c0-1d12-4c5a-bb94-c3e1b20f5444 service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Received unexpected event network-vif-plugged-841a11a2-ffb3-44cf-9e15-c8099578d405 for instance with vm_state stopped and task_state powering-on.
Aug 03 04:48:51 user nova-compute[72444]: DEBUG nova.compute.manager [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 04:48:51 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Creating image(s)
Aug 03 04:48:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc1913f1-dc7d-40ef-9ab4-83e295135f30/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Lock "/opt/stack/data/nova/instances/bc1913f1-dc7d-40ef-9ab4-83e295135f30/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Lock "/opt/stack/data/nova/instances/bc1913f1-dc7d-40ef-9ab4-83e295135f30/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.143s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.189s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/bc1913f1-dc7d-40ef-9ab4-83e295135f30/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/bc1913f1-dc7d-40ef-9ab4-83e295135f30/disk 1073741824" returned: 0 in 0.064s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.927s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.158s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc1913f1-dc7d-40ef-9ab4-83e295135f30/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc1913f1-dc7d-40ef-9ab4-83e295135f30/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc1913f1-dc7d-40ef-9ab4-83e295135f30/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Cannot resize image /opt/stack/data/nova/instances/bc1913f1-dc7d-40ef-9ab4-83e295135f30/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG nova.objects.instance [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Lazy-loading 'migration_context' on Instance uuid bc1913f1-dc7d-40ef-9ab4-83e295135f30 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Ensure instance console log exists: /opt/stack/data/nova/instances/bc1913f1-dc7d-40ef-9ab4-83e295135f30/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:48:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:48:52 user nova-compute[72444]: DEBUG nova.network.neutron [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Successfully created port: 28c3ac17-8cc0-46b6-83cd-911b8b65665d {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:48:52 user nova-compute[72444]: DEBUG nova.network.neutron [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Successfully updated port: 28c3ac17-8cc0-46b6-83cd-911b8b65665d {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:48:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Acquiring lock "refresh_cache-bc1913f1-dc7d-40ef-9ab4-83e295135f30" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:48:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Acquired lock "refresh_cache-bc1913f1-dc7d-40ef-9ab4-83e295135f30" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:48:52 user nova-compute[72444]: DEBUG nova.network.neutron [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:48:52 user nova-compute[72444]: DEBUG nova.compute.manager [req-3be143cf-30cf-41f3-910c-56abbf14c687 req-148997ed-141a-4e3d-bfd3-4acd02834af3 service nova] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Received event network-changed-28c3ac17-8cc0-46b6-83cd-911b8b65665d {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:48:52 user nova-compute[72444]: DEBUG nova.compute.manager [req-3be143cf-30cf-41f3-910c-56abbf14c687 req-148997ed-141a-4e3d-bfd3-4acd02834af3 service nova] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Refreshing instance network info cache due to event network-changed-28c3ac17-8cc0-46b6-83cd-911b8b65665d. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:48:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3be143cf-30cf-41f3-910c-56abbf14c687 req-148997ed-141a-4e3d-bfd3-4acd02834af3 service nova] Acquiring lock "refresh_cache-bc1913f1-dc7d-40ef-9ab4-83e295135f30" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:48:52 user nova-compute[72444]: DEBUG nova.network.neutron [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:48:52 user nova-compute[72444]: DEBUG nova.compute.manager [req-fe8c514c-a991-48fa-b608-e1ae5bc9eba4 req-d9e168a3-2743-46e7-8f17-5858d060115d service nova] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Received event network-changed-2f55f137-3b34-49a7-a77c-e03f9c263c43 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:48:52 user nova-compute[72444]: DEBUG nova.compute.manager [req-fe8c514c-a991-48fa-b608-e1ae5bc9eba4 req-d9e168a3-2743-46e7-8f17-5858d060115d service nova] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Refreshing instance network info cache due to event network-changed-2f55f137-3b34-49a7-a77c-e03f9c263c43. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:48:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-fe8c514c-a991-48fa-b608-e1ae5bc9eba4 req-d9e168a3-2743-46e7-8f17-5858d060115d service nova] Acquiring lock "refresh_cache-1baadfd2-6f00-436b-b3a0-c850cd8cb50e" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:48:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-fe8c514c-a991-48fa-b608-e1ae5bc9eba4 req-d9e168a3-2743-46e7-8f17-5858d060115d service nova] Acquired lock "refresh_cache-1baadfd2-6f00-436b-b3a0-c850cd8cb50e" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:48:52 user nova-compute[72444]: DEBUG nova.network.neutron [req-fe8c514c-a991-48fa-b608-e1ae5bc9eba4 req-d9e168a3-2743-46e7-8f17-5858d060115d service nova] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Refreshing network info cache for port 2f55f137-3b34-49a7-a77c-e03f9c263c43 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038133.107368, 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:48:53 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] VM Resumed (Lifecycle Event)
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.compute.manager [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:48:53 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Instance rebooted successfully.
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.compute.manager [None req-75074060-79b4-416e-889c-014ab071ff5b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.compute.manager [req-d6d6fb63-c11a-48e3-8fb8-c363d22a8980 req-5d0cd1c2-65da-4f05-95a5-6027970914ba service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Received event network-vif-plugged-841a11a2-ffb3-44cf-9e15-c8099578d405 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d6d6fb63-c11a-48e3-8fb8-c363d22a8980 req-5d0cd1c2-65da-4f05-95a5-6027970914ba service nova] Acquiring lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d6d6fb63-c11a-48e3-8fb8-c363d22a8980 req-5d0cd1c2-65da-4f05-95a5-6027970914ba service nova] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d6d6fb63-c11a-48e3-8fb8-c363d22a8980 req-5d0cd1c2-65da-4f05-95a5-6027970914ba service nova] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.compute.manager [req-d6d6fb63-c11a-48e3-8fb8-c363d22a8980 req-5d0cd1c2-65da-4f05-95a5-6027970914ba service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] No waiting events found dispatching network-vif-plugged-841a11a2-ffb3-44cf-9e15-c8099578d405 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:48:53 user nova-compute[72444]: WARNING nova.compute.manager [req-d6d6fb63-c11a-48e3-8fb8-c363d22a8980 req-5d0cd1c2-65da-4f05-95a5-6027970914ba service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Received unexpected event network-vif-plugged-841a11a2-ffb3-44cf-9e15-c8099578d405 for instance with vm_state stopped and task_state powering-on.
Aug 03 04:48:53 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038133.1078188, 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:48:53 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] VM Started (Lifecycle Event)
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.network.neutron [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Updating instance_info_cache with network_info: [{"id": "28c3ac17-8cc0-46b6-83cd-911b8b65665d", "address": "fa:16:3e:87:b0:41", "network": {"id": "6f50f871-ca48-46cd-9678-f4358293735b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "50aa3805febd42378b17cc229e7597c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c3ac17-8c", "ovs_interfaceid": "28c3ac17-8cc0-46b6-83cd-911b8b65665d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Releasing lock "refresh_cache-bc1913f1-dc7d-40ef-9ab4-83e295135f30" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.compute.manager [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Instance network_info: |[{"id": "28c3ac17-8cc0-46b6-83cd-911b8b65665d", "address": "fa:16:3e:87:b0:41", "network": {"id": "6f50f871-ca48-46cd-9678-f4358293735b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "50aa3805febd42378b17cc229e7597c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c3ac17-8c", "ovs_interfaceid": "28c3ac17-8cc0-46b6-83cd-911b8b65665d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3be143cf-30cf-41f3-910c-56abbf14c687 req-148997ed-141a-4e3d-bfd3-4acd02834af3 service nova] Acquired lock "refresh_cache-bc1913f1-dc7d-40ef-9ab4-83e295135f30" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.network.neutron [req-3be143cf-30cf-41f3-910c-56abbf14c687 req-148997ed-141a-4e3d-bfd3-4acd02834af3 service nova] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Refreshing network info cache for port 28c3ac17-8cc0-46b6-83cd-911b8b65665d {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Start _get_guest_xml network_info=[{"id": "28c3ac17-8cc0-46b6-83cd-911b8b65665d", "address": "fa:16:3e:87:b0:41", "network": {"id": "6f50f871-ca48-46cd-9678-f4358293735b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "50aa3805febd42378b17cc229e7597c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c3ac17-8c", "ovs_interfaceid": "28c3ac17-8cc0-46b6-83cd-911b8b65665d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:48:53 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:48:53 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:48:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-318910725',display_name='tempest-VolumesNegativeTest-instance-318910725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-318910725',id=21,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac3e9906216f4b84b3fcc344a9b897ff',ramdisk_id='',reservation_id='r-f94o08q0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1019810687',owner_user_name='tempest-VolumesNegativeTest-1019810687-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:48:51Z,user_data=None,user_id='afb9c50fa527465a92b94d11c1e149fd',uuid=bc1913f1-dc7d-40ef-9ab4-83e295135f30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28c3ac17-8cc0-46b6-83cd-911b8b65665d", "address": "fa:16:3e:87:b0:41", "network": {"id": "6f50f871-ca48-46cd-9678-f4358293735b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "50aa3805febd42378b17cc229e7597c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c3ac17-8c", "ovs_interfaceid": "28c3ac17-8cc0-46b6-83cd-911b8b65665d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Converting VIF {"id": "28c3ac17-8cc0-46b6-83cd-911b8b65665d", "address": "fa:16:3e:87:b0:41", "network": {"id": "6f50f871-ca48-46cd-9678-f4358293735b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "50aa3805febd42378b17cc229e7597c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c3ac17-8c", "ovs_interfaceid": "28c3ac17-8cc0-46b6-83cd-911b8b65665d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:b0:41,bridge_name='br-int',has_traffic_filtering=True,id=28c3ac17-8cc0-46b6-83cd-911b8b65665d,network=Network(6f50f871-ca48-46cd-9678-f4358293735b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c3ac17-8c') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.objects.instance [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Lazy-loading 'pci_devices' on Instance uuid bc1913f1-dc7d-40ef-9ab4-83e295135f30 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:48:53 user nova-compute[72444]:   <uuid>bc1913f1-dc7d-40ef-9ab4-83e295135f30</uuid>
Aug 03 04:48:53 user nova-compute[72444]:   <name>instance-00000015</name>
Aug 03 04:48:53 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:48:53 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:48:53 user nova-compute[72444]:   <metadata>
Aug 03 04:48:53 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:48:53 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:48:53 user nova-compute[72444]:       <nova:name>tempest-VolumesNegativeTest-instance-318910725</nova:name>
Aug 03 04:48:53 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:48:53</nova:creationTime>
Aug 03 04:48:53 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:48:53 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:48:53 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:48:53 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:48:53 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:48:53 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:48:53 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:48:53 user nova-compute[72444]:       <nova:owner>
Aug 03 04:48:53 user nova-compute[72444]:         <nova:user uuid="afb9c50fa527465a92b94d11c1e149fd">tempest-VolumesNegativeTest-1019810687-project-member</nova:user>
Aug 03 04:48:53 user nova-compute[72444]:         <nova:project uuid="ac3e9906216f4b84b3fcc344a9b897ff">tempest-VolumesNegativeTest-1019810687</nova:project>
Aug 03 04:48:53 user nova-compute[72444]:       </nova:owner>
Aug 03 04:48:53 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:48:53 user nova-compute[72444]:       <nova:ports>
Aug 03 04:48:53 user nova-compute[72444]:         <nova:port uuid="28c3ac17-8cc0-46b6-83cd-911b8b65665d">
Aug 03 04:48:53 user nova-compute[72444]:           <nova:ip type="fixed" address="192.168.233.57" ipVersion="4"/>
Aug 03 04:48:53 user nova-compute[72444]:         </nova:port>
Aug 03 04:48:53 user nova-compute[72444]:       </nova:ports>
Aug 03 04:48:53 user nova-compute[72444]:     </nova:instance>
Aug 03 04:48:53 user nova-compute[72444]:   </metadata>
Aug 03 04:48:53 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:48:53 user nova-compute[72444]:     <system>
Aug 03 04:48:53 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:48:53 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:48:53 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:48:53 user nova-compute[72444]:       <entry name="serial">bc1913f1-dc7d-40ef-9ab4-83e295135f30</entry>
Aug 03 04:48:53 user nova-compute[72444]:       <entry name="uuid">bc1913f1-dc7d-40ef-9ab4-83e295135f30</entry>
Aug 03 04:48:53 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:48:53 user nova-compute[72444]:     </system>
Aug 03 04:48:53 user nova-compute[72444]:   </sysinfo>
Aug 03 04:48:53 user nova-compute[72444]:   <os>
Aug 03 04:48:53 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:48:53 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:48:53 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:48:53 user nova-compute[72444]:   </os>
Aug 03 04:48:53 user nova-compute[72444]:   <features>
Aug 03 04:48:53 user nova-compute[72444]:     <acpi/>
Aug 03 04:48:53 user nova-compute[72444]:     <apic/>
Aug 03 04:48:53 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:48:53 user nova-compute[72444]:   </features>
Aug 03 04:48:53 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:48:53 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:48:53 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:48:53 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:48:53 user nova-compute[72444]:   </clock>
Aug 03 04:48:53 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:48:53 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:48:53 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:48:53 user nova-compute[72444]:   </cpu>
Aug 03 04:48:53 user nova-compute[72444]:   <devices>
Aug 03 04:48:53 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:48:53 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:48:53 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/bc1913f1-dc7d-40ef-9ab4-83e295135f30/disk"/>
Aug 03 04:48:53 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:48:53 user nova-compute[72444]:     </disk>
Aug 03 04:48:53 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:48:53 user nova-compute[72444]:       <mac address="fa:16:3e:87:b0:41"/>
Aug 03 04:48:53 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:48:53 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:48:53 user nova-compute[72444]:       <target dev="tap28c3ac17-8c"/>
Aug 03 04:48:53 user nova-compute[72444]:     </interface>
Aug 03 04:48:53 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:48:53 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/bc1913f1-dc7d-40ef-9ab4-83e295135f30/console.log" append="off"/>
Aug 03 04:48:53 user nova-compute[72444]:     </serial>
Aug 03 04:48:53 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:48:53 user nova-compute[72444]:     <video>
Aug 03 04:48:53 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:48:53 user nova-compute[72444]:     </video>
Aug 03 04:48:53 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:48:53 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:48:53 user nova-compute[72444]:     </rng>
Aug 03 04:48:53 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:48:53 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:48:53 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:48:53 user nova-compute[72444]:     </memballoon>
Aug 03 04:48:53 user nova-compute[72444]:   </devices>
Aug 03 04:48:53 user nova-compute[72444]: </domain>
Aug 03 04:48:53 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:48:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-318910725',display_name='tempest-VolumesNegativeTest-instance-318910725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-318910725',id=21,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac3e9906216f4b84b3fcc344a9b897ff',ramdisk_id='',reservation_id='r-f94o08q0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1019810687',owner_user_name='tempest-VolumesNegativeTest-1019810687-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:48:51Z,user_data=None,user_id='afb9c50fa527465a92b94d11c1e149fd',uuid=bc1913f1-dc7d-40ef-9ab4-83e295135f30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28c3ac17-8cc0-46b6-83cd-911b8b65665d", "address": "fa:16:3e:87:b0:41", "network": {"id": "6f50f871-ca48-46cd-9678-f4358293735b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "50aa3805febd42378b17cc229e7597c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c3ac17-8c", "ovs_interfaceid": "28c3ac17-8cc0-46b6-83cd-911b8b65665d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Converting VIF {"id": "28c3ac17-8cc0-46b6-83cd-911b8b65665d", "address": "fa:16:3e:87:b0:41", "network": {"id": "6f50f871-ca48-46cd-9678-f4358293735b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "50aa3805febd42378b17cc229e7597c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c3ac17-8c", "ovs_interfaceid": "28c3ac17-8cc0-46b6-83cd-911b8b65665d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:b0:41,bridge_name='br-int',has_traffic_filtering=True,id=28c3ac17-8cc0-46b6-83cd-911b8b65665d,network=Network(6f50f871-ca48-46cd-9678-f4358293735b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c3ac17-8c') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG os_vif [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:b0:41,bridge_name='br-int',has_traffic_filtering=True,id=28c3ac17-8cc0-46b6-83cd-911b8b65665d,network=Network(6f50f871-ca48-46cd-9678-f4358293735b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c3ac17-8c') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28c3ac17-8c, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap28c3ac17-8c, col_values=(('external_ids', {'iface-id': '28c3ac17-8cc0-46b6-83cd-911b8b65665d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:b0:41', 'vm-uuid': 'bc1913f1-dc7d-40ef-9ab4-83e295135f30'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:53 user nova-compute[72444]: INFO os_vif [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:b0:41,bridge_name='br-int',has_traffic_filtering=True,id=28c3ac17-8cc0-46b6-83cd-911b8b65665d,network=Network(6f50f871-ca48-46cd-9678-f4358293735b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c3ac17-8c')
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] No VIF found with MAC fa:16:3e:87:b0:41, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.network.neutron [req-fe8c514c-a991-48fa-b608-e1ae5bc9eba4 req-d9e168a3-2743-46e7-8f17-5858d060115d service nova] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Updated VIF entry in instance network info cache for port 2f55f137-3b34-49a7-a77c-e03f9c263c43. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.network.neutron [req-fe8c514c-a991-48fa-b608-e1ae5bc9eba4 req-d9e168a3-2743-46e7-8f17-5858d060115d service nova] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Updating instance_info_cache with network_info: [{"id": "2f55f137-3b34-49a7-a77c-e03f9c263c43", "address": "fa:16:3e:cc:5c:79", "network": {"id": "66fcf59b-a2bc-4a34-a881-bf1534ba9e3f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1260837866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256e3a45110d4bc683f3a9b6c250e522", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f55f137-3b", "ovs_interfaceid": "2f55f137-3b34-49a7-a77c-e03f9c263c43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-fe8c514c-a991-48fa-b608-e1ae5bc9eba4 req-d9e168a3-2743-46e7-8f17-5858d060115d service nova] Releasing lock "refresh_cache-1baadfd2-6f00-436b-b3a0-c850cd8cb50e" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.network.neutron [req-3be143cf-30cf-41f3-910c-56abbf14c687 req-148997ed-141a-4e3d-bfd3-4acd02834af3 service nova] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Updated VIF entry in instance network info cache for port 28c3ac17-8cc0-46b6-83cd-911b8b65665d. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.network.neutron [req-3be143cf-30cf-41f3-910c-56abbf14c687 req-148997ed-141a-4e3d-bfd3-4acd02834af3 service nova] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Updating instance_info_cache with network_info: [{"id": "28c3ac17-8cc0-46b6-83cd-911b8b65665d", "address": "fa:16:3e:87:b0:41", "network": {"id": "6f50f871-ca48-46cd-9678-f4358293735b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "50aa3805febd42378b17cc229e7597c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c3ac17-8c", "ovs_interfaceid": "28c3ac17-8cc0-46b6-83cd-911b8b65665d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Acquiring lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3be143cf-30cf-41f3-910c-56abbf14c687 req-148997ed-141a-4e3d-bfd3-4acd02834af3 service nova] Releasing lock "refresh_cache-bc1913f1-dc7d-40ef-9ab4-83e295135f30" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG nova.objects.instance [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lazy-loading 'flavor' on Instance uuid 1baadfd2-6f00-436b-b3a0-c850cd8cb50e {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:48:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:48:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Acquiring lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:48:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:48:54 user nova-compute[72444]: INFO nova.compute.manager [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Attaching volume e69663dd-b408-4fc0-9694-de9040d7e1d7 to /dev/vdb
Aug 03 04:48:54 user nova-compute[72444]: DEBUG os_brick.utils [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:48:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:48:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:48:54 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63b0b0d-391b-4869-9f1c-187eff2656ec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:48:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:48:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:48:54 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e02f61-c177-4147-961a-03093ef0dfb9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:48:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:48:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:48:54 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[43bf4333-fc00-438d-9251-4e8e4cd2c7e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:48:54 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06070ec-e4d5-49a9-b034-9a65678f028f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:48:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:48:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:48:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 04:48:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:48:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:48:54 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 04:48:54 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27a88ec-70bf-4e0c-bc76-b79b7e8f1296]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:48:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 04:48:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 04:48:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 04:48:54 user nova-compute[72444]: DEBUG os_brick.utils [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:48:54 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Updating existing volume attachment record: 66244bd7-e687-4caa-90bb-84d39223ace8 {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 04:48:54 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:48:54 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:48:54 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 04:48:54 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Didn't find any instances for network info cache update. {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 03 04:48:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:55 user nova-compute[72444]: DEBUG nova.compute.manager [req-9740a9c7-f155-465e-9865-aceeb31e7e54 req-44aeaa2b-ec57-453d-ad62-8bf64f767466 service nova] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Received event network-vif-plugged-28c3ac17-8cc0-46b6-83cd-911b8b65665d {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:48:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9740a9c7-f155-465e-9865-aceeb31e7e54 req-44aeaa2b-ec57-453d-ad62-8bf64f767466 service nova] Acquiring lock "bc1913f1-dc7d-40ef-9ab4-83e295135f30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:48:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9740a9c7-f155-465e-9865-aceeb31e7e54 req-44aeaa2b-ec57-453d-ad62-8bf64f767466 service nova] Lock "bc1913f1-dc7d-40ef-9ab4-83e295135f30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:48:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9740a9c7-f155-465e-9865-aceeb31e7e54 req-44aeaa2b-ec57-453d-ad62-8bf64f767466 service nova] Lock "bc1913f1-dc7d-40ef-9ab4-83e295135f30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:48:55 user nova-compute[72444]: DEBUG nova.compute.manager [req-9740a9c7-f155-465e-9865-aceeb31e7e54 req-44aeaa2b-ec57-453d-ad62-8bf64f767466 service nova] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] No waiting events found dispatching network-vif-plugged-28c3ac17-8cc0-46b6-83cd-911b8b65665d {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:48:55 user nova-compute[72444]: WARNING nova.compute.manager [req-9740a9c7-f155-465e-9865-aceeb31e7e54 req-44aeaa2b-ec57-453d-ad62-8bf64f767466 service nova] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Received unexpected event network-vif-plugged-28c3ac17-8cc0-46b6-83cd-911b8b65665d for instance with vm_state building and task_state spawning.
Aug 03 04:48:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:57 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038137.3758755, bc1913f1-dc7d-40ef-9ab4-83e295135f30 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:48:57 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] VM Resumed (Lifecycle Event)
Aug 03 04:48:57 user nova-compute[72444]: DEBUG nova.compute.manager [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:48:57 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 04:48:57 user nova-compute[72444]: DEBUG nova.compute.manager [req-b49ab4fd-8468-49a5-b9fc-1e706978690a req-83f98db3-7495-4ad2-81b8-c53578fef3d8 service nova] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Received event network-vif-plugged-28c3ac17-8cc0-46b6-83cd-911b8b65665d {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:48:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b49ab4fd-8468-49a5-b9fc-1e706978690a req-83f98db3-7495-4ad2-81b8-c53578fef3d8 service nova] Acquiring lock "bc1913f1-dc7d-40ef-9ab4-83e295135f30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:48:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b49ab4fd-8468-49a5-b9fc-1e706978690a req-83f98db3-7495-4ad2-81b8-c53578fef3d8 service nova] Lock "bc1913f1-dc7d-40ef-9ab4-83e295135f30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:48:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b49ab4fd-8468-49a5-b9fc-1e706978690a req-83f98db3-7495-4ad2-81b8-c53578fef3d8 service nova] Lock "bc1913f1-dc7d-40ef-9ab4-83e295135f30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:48:57 user nova-compute[72444]: DEBUG nova.compute.manager [req-b49ab4fd-8468-49a5-b9fc-1e706978690a req-83f98db3-7495-4ad2-81b8-c53578fef3d8 service nova] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] No waiting events found dispatching network-vif-plugged-28c3ac17-8cc0-46b6-83cd-911b8b65665d {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:48:57 user nova-compute[72444]: WARNING nova.compute.manager [req-b49ab4fd-8468-49a5-b9fc-1e706978690a req-83f98db3-7495-4ad2-81b8-c53578fef3d8 service nova] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Received unexpected event network-vif-plugged-28c3ac17-8cc0-46b6-83cd-911b8b65665d for instance with vm_state building and task_state spawning.
Aug 03 04:48:57 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:48:57 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Instance spawned successfully.
Aug 03 04:48:57 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 04:48:57 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:48:57 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:48:57 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:48:57 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:48:57 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:48:57 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:48:57 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:48:57 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:48:57 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038137.3771784, bc1913f1-dc7d-40ef-9ab4-83e295135f30 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:48:57 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] VM Started (Lifecycle Event)
Aug 03 04:48:57 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:48:57 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:48:57 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:48:57 user nova-compute[72444]: INFO nova.compute.manager [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Took 6.43 seconds to spawn the instance on the hypervisor.
Aug 03 04:48:57 user nova-compute[72444]: DEBUG nova.compute.manager [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:48:57 user nova-compute[72444]: INFO nova.compute.manager [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Took 7.86 seconds to build instance.
Aug 03 04:48:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0411a839-359d-412e-95b6-537f21d0415e tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Lock "bc1913f1-dc7d-40ef-9ab4-83e295135f30" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.989s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:48:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:48:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvQAtMxn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:49:03 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:49:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:49:03 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:49:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:49:03 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:49:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01d01af-9c2f-4333-92f3-2f65ba86dbb2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 04:49:03 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d98807-5da0-4f0a-8c5c-9fada220af79]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7] added
Aug 03 04:49:03 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79a07c8-9e81-449c-a7a9-0203e6375462]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9a13aa-28de-41e3-9efb-13f7bae3d136]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qvQAtMxn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qvQAtMxn" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[94649a38-c8d8-4bf6-ac21-6deedede5783]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qvQAtMxn'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1ba83e-0c4c-4cc8-8a2b-882de05b1318]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b815706e-7857-449e-be34-113c88447ef7]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:49:03 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:49:03 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b22103-7f27-4bef-8074-0a38acd01d0a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7, portal: 172.16.0.220,3260]
Aug 03 04:49:03 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7, portal: 172.16.0.220,3260] successful.
Aug 03 04:49:03 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3129e38d-3a5b-428c-983c-3bb7102683d1]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39fdca0-0107-454b-8093-3f1c83283204]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 (non-flash)
Aug 03 04:49:03 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:49:03 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 (non-flash)
Aug 03 04:49:03 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:49:03 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a4bce4-f630-4ba6-9e73-415893733eb7]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvQAtMxn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:49:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:04 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:49:04 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26230633830326265', 'path': '/dev/sdb'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:49:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230633830326265', 'path': '/dev/sdb'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:49:04 user nova-compute[72444]: DEBUG nova.objects.instance [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lazy-loading 'flavor' on Instance uuid 1baadfd2-6f00-436b-b3a0-c850cd8cb50e {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:49:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 04:49:04 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:49:04 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 04:49:04 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:49:04 user nova-compute[72444]:   <serial>e69663dd-b408-4fc0-9694-de9040d7e1d7</serial>
Aug 03 04:49:04 user nova-compute[72444]: </disk>
Aug 03 04:49:04 user nova-compute[72444]:  {{(pid=72444) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 04:49:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:49:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:49:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] No VIF found with MAC fa:16:3e:cc:5c:79, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:49:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-56522f50-c6c3-484d-bda7-4c7f1de7a726 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.833s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Acquiring lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:09 user nova-compute[72444]: DEBUG nova.objects.instance [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lazy-loading 'flavor' on Instance uuid 1baadfd2-6f00-436b-b3a0-c850cd8cb50e {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:49:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Acquiring lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:09 user nova-compute[72444]: INFO nova.compute.manager [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Attaching volume ff6e747f-fc94-4211-aebb-5dafaff8d251 to /dev/vdc
Aug 03 04:49:10 user nova-compute[72444]: DEBUG os_brick.utils [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:49:10 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:10 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:10 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95c215f-9ded-44d4-b670-459b25b7ee03]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:10 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:10 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:10 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16da9c6-72f3-4600-aa4a-3f83d365ffcd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:10 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:10 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:10 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed67cfb-bec7-4516-ab2a-7c816197e2cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:10 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfcbe56-8142-4af8-a085-b72aed4564c9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:10 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:10 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:49:10 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 04:49:10 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:10 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:49:10 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 04:49:10 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[db089e10-f75b-4ec0-b97b-0a31072123ed]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:10 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 04:49:10 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 04:49:10 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 04:49:10 user nova-compute[72444]: DEBUG os_brick.utils [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:49:10 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Updating existing volume attachment record: eb738b5a-dc74-4b7f-947f-ae9d5d55bea9 {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 04:49:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Acquiring lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:14 user nova-compute[72444]: DEBUG nova.compute.manager [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 04:49:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:14 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 04:49:14 user nova-compute[72444]: INFO nova.compute.claims [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Claim successful on node user
Aug 03 04:49:15 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:49:15 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:49:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:15 user nova-compute[72444]: DEBUG nova.compute.manager [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 04:49:15 user nova-compute[72444]: DEBUG nova.compute.manager [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 04:49:15 user nova-compute[72444]: DEBUG nova.network.neutron [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 04:49:15 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 04:49:15 user nova-compute[72444]: DEBUG nova.compute.manager [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 04:49:15 user nova-compute[72444]: INFO nova.virt.block_device [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Booting with volume 4a7eeea2-85c7-436b-8003-948ca1dbbcab at /dev/vda
Aug 03 04:49:15 user nova-compute[72444]: DEBUG os_brick.utils [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:49:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:15 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac9bcff-4bde-4123-9648-684b6bbe9f45]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:15 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[38be28cf-daeb-4033-a074-42f246b34ace]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:15 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc4c62f-73e5-4510-8da2-d22e69e891ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:15 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0fa965-47b1-4ab0-8682-f05a4b7c631a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:49:15 user nova-compute[72444]: DEBUG nova.policy [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd24fc36445c245ff83f65f2a86f4f393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1996f0a97dc84be4906a638ee6e19b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 04:49:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 04:49:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:49:15 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 04:49:15 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[470dd6b5-61bd-42c2-b4a3-49b9d539fa3e]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 04:49:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 04:49:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 04:49:15 user nova-compute[72444]: DEBUG os_brick.utils [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:49:15 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Updating existing volume attachment record: 45739afe-7068-4e13-ac00-641253077d85 {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 04:49:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "0b219bf3-a3b6-44b5-946e-c10e7498e1d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "0b219bf3-a3b6-44b5-946e-c10e7498e1d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:15 user nova-compute[72444]: DEBUG nova.compute.manager [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 04:49:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:15 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 04:49:15 user nova-compute[72444]: INFO nova.compute.claims [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Claim successful on node user
Aug 03 04:49:16 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:49:16 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:49:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.674s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:16 user nova-compute[72444]: DEBUG nova.compute.manager [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 04:49:16 user nova-compute[72444]: DEBUG nova.network.neutron [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Successfully created port: 0b5e2297-6ab0-4965-a202-3f36a81e5646 {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:49:16 user nova-compute[72444]: DEBUG nova.compute.manager [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 04:49:16 user nova-compute[72444]: DEBUG nova.network.neutron [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 04:49:16 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 04:49:16 user nova-compute[72444]: DEBUG nova.compute.manager [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 04:49:16 user nova-compute[72444]: DEBUG nova.policy [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ceede92aa3a74060a7f57d29d0d97aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '929fd4a3127b475282426d4412e58def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 04:49:16 user nova-compute[72444]: DEBUG nova.compute.manager [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 04:49:16 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 04:49:16 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Creating image(s)
Aug 03 04:49:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "/opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "/opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "/opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.141s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.135s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:17 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk 1073741824" returned: 0 in 0.057s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:17 user nova-compute[72444]: DEBUG nova.network.neutron [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Successfully created port: 88715119-aa32-4ad2-8c22-8188ee7a1a1f {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:49:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.167s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:17 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 04:49:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:17 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Cannot resize image /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 04:49:17 user nova-compute[72444]: DEBUG nova.objects.instance [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lazy-loading 'migration_context' on Instance uuid 0b219bf3-a3b6-44b5-946e-c10e7498e1d3 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:49:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 04:49:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Ensure instance console log exists: /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 04:49:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:17 user nova-compute[72444]: DEBUG nova.network.neutron [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Successfully created port: ab45da29-a935-4aa8-9a10-1793ddbc7ab1 {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:49:18 user nova-compute[72444]: DEBUG nova.network.neutron [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Successfully created port: 5c810fce-bc56-4763-a65d-dbc53bf0c08a {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:49:18 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:18 user nova-compute[72444]: DEBUG nova.network.neutron [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Successfully created port: 4b540799-a36a-4b46-a678-53a6db44477a {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:49:18 user nova-compute[72444]: DEBUG nova.network.neutron [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Successfully updated port: 5c810fce-bc56-4763-a65d-dbc53bf0c08a {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:49:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "refresh_cache-0b219bf3-a3b6-44b5-946e-c10e7498e1d3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:49:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquired lock "refresh_cache-0b219bf3-a3b6-44b5-946e-c10e7498e1d3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:49:18 user nova-compute[72444]: DEBUG nova.network.neutron [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:49:18 user nova-compute[72444]: DEBUG nova.compute.manager [req-a85b9ca1-c608-415f-a5a2-483912d95c74 req-5809cfcb-bccd-4901-b10c-e8003bd49cfa service nova] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Received event network-changed-5c810fce-bc56-4763-a65d-dbc53bf0c08a {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:49:18 user nova-compute[72444]: DEBUG nova.compute.manager [req-a85b9ca1-c608-415f-a5a2-483912d95c74 req-5809cfcb-bccd-4901-b10c-e8003bd49cfa service nova] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Refreshing instance network info cache due to event network-changed-5c810fce-bc56-4763-a65d-dbc53bf0c08a. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:49:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a85b9ca1-c608-415f-a5a2-483912d95c74 req-5809cfcb-bccd-4901-b10c-e8003bd49cfa service nova] Acquiring lock "refresh_cache-0b219bf3-a3b6-44b5-946e-c10e7498e1d3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG nova.network.neutron [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG nova.network.neutron [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Updating instance_info_cache with network_info: [{"id": "5c810fce-bc56-4763-a65d-dbc53bf0c08a", "address": "fa:16:3e:d6:a1:18", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c810fce-bc", "ovs_interfaceid": "5c810fce-bc56-4763-a65d-dbc53bf0c08a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Releasing lock "refresh_cache-0b219bf3-a3b6-44b5-946e-c10e7498e1d3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG nova.compute.manager [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Instance network_info: |[{"id": "5c810fce-bc56-4763-a65d-dbc53bf0c08a", "address": "fa:16:3e:d6:a1:18", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c810fce-bc", "ovs_interfaceid": "5c810fce-bc56-4763-a65d-dbc53bf0c08a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a85b9ca1-c608-415f-a5a2-483912d95c74 req-5809cfcb-bccd-4901-b10c-e8003bd49cfa service nova] Acquired lock "refresh_cache-0b219bf3-a3b6-44b5-946e-c10e7498e1d3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG nova.network.neutron [req-a85b9ca1-c608-415f-a5a2-483912d95c74 req-5809cfcb-bccd-4901-b10c-e8003bd49cfa service nova] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Refreshing network info cache for port 5c810fce-bc56-4763-a65d-dbc53bf0c08a {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Start _get_guest_xml network_info=[{"id": "5c810fce-bc56-4763-a65d-dbc53bf0c08a", "address": "fa:16:3e:d6:a1:18", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c810fce-bc", "ovs_interfaceid": "5c810fce-bc56-4763-a65d-dbc53bf0c08a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:49:19 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:49:19 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:49:19 user nova-compute[72444]: DEBUG nova.network.neutron [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Successfully created port: 0290730e-648d-44ba-b03b-53918307a717 {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:49:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1040749505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1040749505',id=23,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='929fd4a3127b475282426d4412e58def',ramdisk_id='',reservation_id='r-tovcwt35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1082770125',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:49:17Z,user_data=None,user_id='ceede92aa3a74060a7f57d29d0d97aee',uuid=0b219bf3-a3b6-44b5-946e-c10e7498e1d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c810fce-bc56-4763-a65d-dbc53bf0c08a", "address": "fa:16:3e:d6:a1:18", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c810fce-bc", "ovs_interfaceid": "5c810fce-bc56-4763-a65d-dbc53bf0c08a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Converting VIF {"id": "5c810fce-bc56-4763-a65d-dbc53bf0c08a", "address": "fa:16:3e:d6:a1:18", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c810fce-bc", "ovs_interfaceid": "5c810fce-bc56-4763-a65d-dbc53bf0c08a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:a1:18,bridge_name='br-int',has_traffic_filtering=True,id=5c810fce-bc56-4763-a65d-dbc53bf0c08a,network=Network(0e8b3ddd-e35a-45eb-a34c-614654c25549),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c810fce-bc') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG nova.objects.instance [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b219bf3-a3b6-44b5-946e-c10e7498e1d3 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:49:19 user nova-compute[72444]:   <uuid>0b219bf3-a3b6-44b5-946e-c10e7498e1d3</uuid>
Aug 03 04:49:19 user nova-compute[72444]:   <name>instance-00000017</name>
Aug 03 04:49:19 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:49:19 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:49:19 user nova-compute[72444]:   <metadata>
Aug 03 04:49:19 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:49:19 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:49:19 user nova-compute[72444]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1040749505</nova:name>
Aug 03 04:49:19 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:49:19</nova:creationTime>
Aug 03 04:49:19 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:49:19 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:49:19 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:49:19 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:49:19 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:49:19 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:49:19 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:49:19 user nova-compute[72444]:       <nova:owner>
Aug 03 04:49:19 user nova-compute[72444]:         <nova:user uuid="ceede92aa3a74060a7f57d29d0d97aee">tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member</nova:user>
Aug 03 04:49:19 user nova-compute[72444]:         <nova:project uuid="929fd4a3127b475282426d4412e58def">tempest-ServerBootFromVolumeStableRescueTest-1082770125</nova:project>
Aug 03 04:49:19 user nova-compute[72444]:       </nova:owner>
Aug 03 04:49:19 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:49:19 user nova-compute[72444]:       <nova:ports>
Aug 03 04:49:19 user nova-compute[72444]:         <nova:port uuid="5c810fce-bc56-4763-a65d-dbc53bf0c08a">
Aug 03 04:49:19 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 03 04:49:19 user nova-compute[72444]:         </nova:port>
Aug 03 04:49:19 user nova-compute[72444]:       </nova:ports>
Aug 03 04:49:19 user nova-compute[72444]:     </nova:instance>
Aug 03 04:49:19 user nova-compute[72444]:   </metadata>
Aug 03 04:49:19 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:49:19 user nova-compute[72444]:     <system>
Aug 03 04:49:19 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:49:19 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:49:19 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:49:19 user nova-compute[72444]:       <entry name="serial">0b219bf3-a3b6-44b5-946e-c10e7498e1d3</entry>
Aug 03 04:49:19 user nova-compute[72444]:       <entry name="uuid">0b219bf3-a3b6-44b5-946e-c10e7498e1d3</entry>
Aug 03 04:49:19 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:49:19 user nova-compute[72444]:     </system>
Aug 03 04:49:19 user nova-compute[72444]:   </sysinfo>
Aug 03 04:49:19 user nova-compute[72444]:   <os>
Aug 03 04:49:19 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:49:19 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:49:19 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:49:19 user nova-compute[72444]:   </os>
Aug 03 04:49:19 user nova-compute[72444]:   <features>
Aug 03 04:49:19 user nova-compute[72444]:     <acpi/>
Aug 03 04:49:19 user nova-compute[72444]:     <apic/>
Aug 03 04:49:19 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:49:19 user nova-compute[72444]:   </features>
Aug 03 04:49:19 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:49:19 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:49:19 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:49:19 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:49:19 user nova-compute[72444]:   </clock>
Aug 03 04:49:19 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:49:19 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:49:19 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:49:19 user nova-compute[72444]:   </cpu>
Aug 03 04:49:19 user nova-compute[72444]:   <devices>
Aug 03 04:49:19 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:49:19 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:49:19 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk"/>
Aug 03 04:49:19 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:49:19 user nova-compute[72444]:     </disk>
Aug 03 04:49:19 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:49:19 user nova-compute[72444]:       <mac address="fa:16:3e:d6:a1:18"/>
Aug 03 04:49:19 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:49:19 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:49:19 user nova-compute[72444]:       <target dev="tap5c810fce-bc"/>
Aug 03 04:49:19 user nova-compute[72444]:     </interface>
Aug 03 04:49:19 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:49:19 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/console.log" append="off"/>
Aug 03 04:49:19 user nova-compute[72444]:     </serial>
Aug 03 04:49:19 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:49:19 user nova-compute[72444]:     <video>
Aug 03 04:49:19 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:49:19 user nova-compute[72444]:     </video>
Aug 03 04:49:19 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:49:19 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:49:19 user nova-compute[72444]:     </rng>
Aug 03 04:49:19 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:49:19 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:49:19 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:49:19 user nova-compute[72444]:     </memballoon>
Aug 03 04:49:19 user nova-compute[72444]:   </devices>
Aug 03 04:49:19 user nova-compute[72444]: </domain>
Aug 03 04:49:19 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:49:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1040749505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1040749505',id=23,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='929fd4a3127b475282426d4412e58def',ramdisk_id='',reservation_id='r-tovcwt35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1082770125',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:49:17Z,user_data=None,user_id='ceede92aa3a74060a7f57d29d0d97aee',uuid=0b219bf3-a3b6-44b5-946e-c10e7498e1d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c810fce-bc56-4763-a65d-dbc53bf0c08a", "address": "fa:16:3e:d6:a1:18", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c810fce-bc", "ovs_interfaceid": "5c810fce-bc56-4763-a65d-dbc53bf0c08a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Converting VIF {"id": "5c810fce-bc56-4763-a65d-dbc53bf0c08a", "address": "fa:16:3e:d6:a1:18", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c810fce-bc", "ovs_interfaceid": "5c810fce-bc56-4763-a65d-dbc53bf0c08a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:a1:18,bridge_name='br-int',has_traffic_filtering=True,id=5c810fce-bc56-4763-a65d-dbc53bf0c08a,network=Network(0e8b3ddd-e35a-45eb-a34c-614654c25549),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c810fce-bc') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG os_vif [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:a1:18,bridge_name='br-int',has_traffic_filtering=True,id=5c810fce-bc56-4763-a65d-dbc53bf0c08a,network=Network(0e8b3ddd-e35a-45eb-a34c-614654c25549),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c810fce-bc') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c810fce-bc, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5c810fce-bc, col_values=(('external_ids', {'iface-id': '5c810fce-bc56-4763-a65d-dbc53bf0c08a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:a1:18', 'vm-uuid': '0b219bf3-a3b6-44b5-946e-c10e7498e1d3'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:19 user nova-compute[72444]: INFO os_vif [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:a1:18,bridge_name='br-int',has_traffic_filtering=True,id=5c810fce-bc56-4763-a65d-dbc53bf0c08a,network=Network(0e8b3ddd-e35a-45eb-a34c-614654c25549),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c810fce-bc')
Aug 03 04:49:19 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] No VIF found with MAC fa:16:3e:d6:a1:18, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG nova.compute.manager [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 04:49:19 user nova-compute[72444]: INFO nova.compute.claims [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Claim successful on node user
Aug 03 04:49:19 user nova-compute[72444]: DEBUG nova.network.neutron [req-a85b9ca1-c608-415f-a5a2-483912d95c74 req-5809cfcb-bccd-4901-b10c-e8003bd49cfa service nova] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Updated VIF entry in instance network info cache for port 5c810fce-bc56-4763-a65d-dbc53bf0c08a. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG nova.network.neutron [req-a85b9ca1-c608-415f-a5a2-483912d95c74 req-5809cfcb-bccd-4901-b10c-e8003bd49cfa service nova] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Updating instance_info_cache with network_info: [{"id": "5c810fce-bc56-4763-a65d-dbc53bf0c08a", "address": "fa:16:3e:d6:a1:18", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c810fce-bc", "ovs_interfaceid": "5c810fce-bc56-4763-a65d-dbc53bf0c08a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:49:19 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a85b9ca1-c608-415f-a5a2-483912d95c74 req-5809cfcb-bccd-4901-b10c-e8003bd49cfa service nova] Releasing lock "refresh_cache-0b219bf3-a3b6-44b5-946e-c10e7498e1d3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:49:20 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:49:20 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:49:20 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.563s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:20 user nova-compute[72444]: DEBUG nova.compute.manager [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 04:49:20 user nova-compute[72444]: DEBUG nova.compute.manager [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 04:49:20 user nova-compute[72444]: DEBUG nova.network.neutron [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 04:49:20 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 04:49:20 user nova-compute[72444]: DEBUG nova.compute.manager [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 04:49:20 user nova-compute[72444]: DEBUG nova.policy [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '07e8b540c9194e1195cb898ad08acaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a2a64796f4b87a44383014f0af3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 04:49:20 user nova-compute[72444]: DEBUG nova.compute.manager [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 04:49:20 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 04:49:20 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Creating image(s)
Aug 03 04:49:20 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "/opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:20 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "/opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:20 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "/opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:20 user nova-compute[72444]: DEBUG nova.network.neutron [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Successfully updated port: 0b5e2297-6ab0-4965-a202-3f36a81e5646 {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:49:20 user nova-compute[72444]: DEBUG nova.compute.manager [req-6b4eb32d-5159-4151-b655-0e9145e5d7e1 req-6dfbde35-012e-4968-bb13-7e4659738ebb service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-changed-0b5e2297-6ab0-4965-a202-3f36a81e5646 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:49:20 user nova-compute[72444]: DEBUG nova.compute.manager [req-6b4eb32d-5159-4151-b655-0e9145e5d7e1 req-6dfbde35-012e-4968-bb13-7e4659738ebb service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Refreshing instance network info cache due to event network-changed-0b5e2297-6ab0-4965-a202-3f36a81e5646. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:49:20 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6b4eb32d-5159-4151-b655-0e9145e5d7e1 req-6dfbde35-012e-4968-bb13-7e4659738ebb service nova] Acquiring lock "refresh_cache-6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:49:20 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6b4eb32d-5159-4151-b655-0e9145e5d7e1 req-6dfbde35-012e-4968-bb13-7e4659738ebb service nova] Acquired lock "refresh_cache-6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:49:20 user nova-compute[72444]: DEBUG nova.network.neutron [req-6b4eb32d-5159-4151-b655-0e9145e5d7e1 req-6dfbde35-012e-4968-bb13-7e4659738ebb service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Refreshing network info cache for port 0b5e2297-6ab0-4965-a202-3f36a81e5646 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:49:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.141s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:20 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:20 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:20 user nova-compute[72444]: DEBUG nova.network.neutron [req-6b4eb32d-5159-4151-b655-0e9145e5d7e1 req-6dfbde35-012e-4968-bb13-7e4659738ebb service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:49:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.139s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk 1073741824" returned: 0 in 0.066s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:20 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.159s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:21 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 04:49:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:21 user nova-compute[72444]: DEBUG nova.network.neutron [req-6b4eb32d-5159-4151-b655-0e9145e5d7e1 req-6dfbde35-012e-4968-bb13-7e4659738ebb service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:49:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:21 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Cannot resize image /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 04:49:21 user nova-compute[72444]: DEBUG nova.objects.instance [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lazy-loading 'migration_context' on Instance uuid c77e96da-6411-4ae9-af05-8e9bb3c432c6 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:49:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6b4eb32d-5159-4151-b655-0e9145e5d7e1 req-6dfbde35-012e-4968-bb13-7e4659738ebb service nova] Releasing lock "refresh_cache-6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:49:21 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 04:49:21 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Ensure instance console log exists: /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 04:49:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:21 user nova-compute[72444]: DEBUG nova.compute.manager [req-cc34ac21-3c98-43e4-b039-eb4fe53f5093 req-849e5154-6918-4bbf-a881-5c033d517fa6 service nova] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Received event network-vif-plugged-5c810fce-bc56-4763-a65d-dbc53bf0c08a {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:49:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-cc34ac21-3c98-43e4-b039-eb4fe53f5093 req-849e5154-6918-4bbf-a881-5c033d517fa6 service nova] Acquiring lock "0b219bf3-a3b6-44b5-946e-c10e7498e1d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-cc34ac21-3c98-43e4-b039-eb4fe53f5093 req-849e5154-6918-4bbf-a881-5c033d517fa6 service nova] Lock "0b219bf3-a3b6-44b5-946e-c10e7498e1d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-cc34ac21-3c98-43e4-b039-eb4fe53f5093 req-849e5154-6918-4bbf-a881-5c033d517fa6 service nova] Lock "0b219bf3-a3b6-44b5-946e-c10e7498e1d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:21 user nova-compute[72444]: DEBUG nova.compute.manager [req-cc34ac21-3c98-43e4-b039-eb4fe53f5093 req-849e5154-6918-4bbf-a881-5c033d517fa6 service nova] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] No waiting events found dispatching network-vif-plugged-5c810fce-bc56-4763-a65d-dbc53bf0c08a {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:49:21 user nova-compute[72444]: WARNING nova.compute.manager [req-cc34ac21-3c98-43e4-b039-eb4fe53f5093 req-849e5154-6918-4bbf-a881-5c033d517fa6 service nova] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Received unexpected event network-vif-plugged-5c810fce-bc56-4763-a65d-dbc53bf0c08a for instance with vm_state building and task_state spawning.
Aug 03 04:49:21 user nova-compute[72444]: DEBUG nova.network.neutron [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Successfully created port: 90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:49:21 user nova-compute[72444]: DEBUG nova.network.neutron [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Successfully updated port: a0819cee-25ca-4271-aca3-47125f12360b {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:49:22 user nova-compute[72444]: DEBUG nova.network.neutron [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Successfully updated port: 36cd0894-4081-4d21-870e-3d635e0ed9c4 {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:49:22 user nova-compute[72444]: DEBUG nova.network.neutron [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Successfully updated port: 90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:49:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "refresh_cache-c77e96da-6411-4ae9-af05-8e9bb3c432c6" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:49:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquired lock "refresh_cache-c77e96da-6411-4ae9-af05-8e9bb3c432c6" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:49:22 user nova-compute[72444]: DEBUG nova.network.neutron [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:49:22 user nova-compute[72444]: DEBUG nova.network.neutron [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:49:22 user nova-compute[72444]: DEBUG nova.compute.manager [req-5e69d7a5-399b-4163-bf94-6389b7eb5e1b req-d15cf836-c244-44d1-8b51-92e372b623f9 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-changed-a0819cee-25ca-4271-aca3-47125f12360b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:49:22 user nova-compute[72444]: DEBUG nova.compute.manager [req-5e69d7a5-399b-4163-bf94-6389b7eb5e1b req-d15cf836-c244-44d1-8b51-92e372b623f9 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Refreshing instance network info cache due to event network-changed-a0819cee-25ca-4271-aca3-47125f12360b. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:49:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5e69d7a5-399b-4163-bf94-6389b7eb5e1b req-d15cf836-c244-44d1-8b51-92e372b623f9 service nova] Acquiring lock "refresh_cache-6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:49:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5e69d7a5-399b-4163-bf94-6389b7eb5e1b req-d15cf836-c244-44d1-8b51-92e372b623f9 service nova] Acquired lock "refresh_cache-6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:49:22 user nova-compute[72444]: DEBUG nova.network.neutron [req-5e69d7a5-399b-4163-bf94-6389b7eb5e1b req-d15cf836-c244-44d1-8b51-92e372b623f9 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Refreshing network info cache for port a0819cee-25ca-4271-aca3-47125f12360b {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:49:22 user nova-compute[72444]: DEBUG nova.network.neutron [req-5e69d7a5-399b-4163-bf94-6389b7eb5e1b req-d15cf836-c244-44d1-8b51-92e372b623f9 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:49:22 user nova-compute[72444]: DEBUG nova.network.neutron [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Updating instance_info_cache with network_info: [{"id": "90104ef6-fe9b-4347-8df6-934a276e077b", "address": "fa:16:3e:22:ec:e0", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90104ef6-fe", "ovs_interfaceid": "90104ef6-fe9b-4347-8df6-934a276e077b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:49:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Releasing lock "refresh_cache-c77e96da-6411-4ae9-af05-8e9bb3c432c6" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:49:22 user nova-compute[72444]: DEBUG nova.compute.manager [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Instance network_info: |[{"id": "90104ef6-fe9b-4347-8df6-934a276e077b", "address": "fa:16:3e:22:ec:e0", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90104ef6-fe", "ovs_interfaceid": "90104ef6-fe9b-4347-8df6-934a276e077b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 04:49:22 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Start _get_guest_xml network_info=[{"id": "90104ef6-fe9b-4347-8df6-934a276e077b", "address": "fa:16:3e:22:ec:e0", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90104ef6-fe", "ovs_interfaceid": "90104ef6-fe9b-4347-8df6-934a276e077b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:49:22 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:49:22 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:49:22 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:49:22 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:49:22 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:49:22 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:49:22 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:49:22 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:49:22 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:49:22 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:49:22 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:49:22 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:49:22 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:49:22 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:49:22 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:49:22 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:49:22 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:49:22 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:49:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-542782890',display_name='tempest-ServerRescueNegativeTestJSON-server-542782890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-542782890',id=24,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmAjhUOOKCDltmr3EihMJCY9iEkC7NkRXw90VLoV9/lViPdH11qRTjE77g0xdU01gSL4ArFvtdc3yFICpu7HOjpk1RPgfTzpHtHhNK+y/xi3IO0oDY9ffaaWHdtTe8QZQ==',key_name='tempest-keypair-242052909',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='063a2a64796f4b87a44383014f0af3dc',ramdisk_id='',reservation_id='r-nw7lk90d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-665683708',owner_user_name='tempest-ServerRescueNegativeTestJSON-665683708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:49:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07e8b540c9194e1195cb898ad08acaa0',uuid=c77e96da-6411-4ae9-af05-8e9bb3c432c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90104ef6-fe9b-4347-8df6-934a276e077b", "address": "fa:16:3e:22:ec:e0", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90104ef6-fe", "ovs_interfaceid": "90104ef6-fe9b-4347-8df6-934a276e077b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Converting VIF {"id": "90104ef6-fe9b-4347-8df6-934a276e077b", "address": "fa:16:3e:22:ec:e0", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90104ef6-fe", "ovs_interfaceid": "90104ef6-fe9b-4347-8df6-934a276e077b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:ec:e0,bridge_name='br-int',has_traffic_filtering=True,id=90104ef6-fe9b-4347-8df6-934a276e077b,network=Network(bc85da72-7764-4b65-a071-aec46e3a2398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90104ef6-fe') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG nova.objects.instance [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lazy-loading 'pci_devices' on Instance uuid c77e96da-6411-4ae9-af05-8e9bb3c432c6 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jDmVMpia', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:49:23 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:49:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:49:23 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:49:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:49:23 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:49:23 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:49:23 user nova-compute[72444]:   <uuid>c77e96da-6411-4ae9-af05-8e9bb3c432c6</uuid>
Aug 03 04:49:23 user nova-compute[72444]:   <name>instance-00000018</name>
Aug 03 04:49:23 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:49:23 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:49:23 user nova-compute[72444]:   <metadata>
Aug 03 04:49:23 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:49:23 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:49:23 user nova-compute[72444]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-542782890</nova:name>
Aug 03 04:49:23 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:49:22</nova:creationTime>
Aug 03 04:49:23 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:49:23 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:49:23 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:49:23 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:49:23 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:49:23 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:49:23 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:49:23 user nova-compute[72444]:       <nova:owner>
Aug 03 04:49:23 user nova-compute[72444]:         <nova:user uuid="07e8b540c9194e1195cb898ad08acaa0">tempest-ServerRescueNegativeTestJSON-665683708-project-member</nova:user>
Aug 03 04:49:23 user nova-compute[72444]:         <nova:project uuid="063a2a64796f4b87a44383014f0af3dc">tempest-ServerRescueNegativeTestJSON-665683708</nova:project>
Aug 03 04:49:23 user nova-compute[72444]:       </nova:owner>
Aug 03 04:49:23 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:49:23 user nova-compute[72444]:       <nova:ports>
Aug 03 04:49:23 user nova-compute[72444]:         <nova:port uuid="90104ef6-fe9b-4347-8df6-934a276e077b">
Aug 03 04:49:23 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 03 04:49:23 user nova-compute[72444]:         </nova:port>
Aug 03 04:49:23 user nova-compute[72444]:       </nova:ports>
Aug 03 04:49:23 user nova-compute[72444]:     </nova:instance>
Aug 03 04:49:23 user nova-compute[72444]:   </metadata>
Aug 03 04:49:23 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:49:23 user nova-compute[72444]:     <system>
Aug 03 04:49:23 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:49:23 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:49:23 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:49:23 user nova-compute[72444]:       <entry name="serial">c77e96da-6411-4ae9-af05-8e9bb3c432c6</entry>
Aug 03 04:49:23 user nova-compute[72444]:       <entry name="uuid">c77e96da-6411-4ae9-af05-8e9bb3c432c6</entry>
Aug 03 04:49:23 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:49:23 user nova-compute[72444]:     </system>
Aug 03 04:49:23 user nova-compute[72444]:   </sysinfo>
Aug 03 04:49:23 user nova-compute[72444]:   <os>
Aug 03 04:49:23 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:49:23 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:49:23 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:49:23 user nova-compute[72444]:   </os>
Aug 03 04:49:23 user nova-compute[72444]:   <features>
Aug 03 04:49:23 user nova-compute[72444]:     <acpi/>
Aug 03 04:49:23 user nova-compute[72444]:     <apic/>
Aug 03 04:49:23 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:49:23 user nova-compute[72444]:   </features>
Aug 03 04:49:23 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:49:23 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:49:23 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:49:23 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:49:23 user nova-compute[72444]:   </clock>
Aug 03 04:49:23 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:49:23 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:49:23 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:49:23 user nova-compute[72444]:   </cpu>
Aug 03 04:49:23 user nova-compute[72444]:   <devices>
Aug 03 04:49:23 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:49:23 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:49:23 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk"/>
Aug 03 04:49:23 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:49:23 user nova-compute[72444]:     </disk>
Aug 03 04:49:23 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:49:23 user nova-compute[72444]:       <mac address="fa:16:3e:22:ec:e0"/>
Aug 03 04:49:23 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:49:23 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:49:23 user nova-compute[72444]:       <target dev="tap90104ef6-fe"/>
Aug 03 04:49:23 user nova-compute[72444]:     </interface>
Aug 03 04:49:23 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:49:23 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/console.log" append="off"/>
Aug 03 04:49:23 user nova-compute[72444]:     </serial>
Aug 03 04:49:23 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:49:23 user nova-compute[72444]:     <video>
Aug 03 04:49:23 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:49:23 user nova-compute[72444]:     </video>
Aug 03 04:49:23 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:49:23 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:49:23 user nova-compute[72444]:     </rng>
Aug 03 04:49:23 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:49:23 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:49:23 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:49:23 user nova-compute[72444]:     </memballoon>
Aug 03 04:49:23 user nova-compute[72444]:   </devices>
Aug 03 04:49:23 user nova-compute[72444]: </domain>
Aug 03 04:49:23 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:49:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-542782890',display_name='tempest-ServerRescueNegativeTestJSON-server-542782890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-542782890',id=24,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmAjhUOOKCDltmr3EihMJCY9iEkC7NkRXw90VLoV9/lViPdH11qRTjE77g0xdU01gSL4ArFvtdc3yFICpu7HOjpk1RPgfTzpHtHhNK+y/xi3IO0oDY9ffaaWHdtTe8QZQ==',key_name='tempest-keypair-242052909',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='063a2a64796f4b87a44383014f0af3dc',ramdisk_id='',reservation_id='r-nw7lk90d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-665683708',owner_user_name='tempest-ServerRescueNegativeTestJSON-665683708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:49:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07e8b540c9194e1195cb898ad08acaa0',uuid=c77e96da-6411-4ae9-af05-8e9bb3c432c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90104ef6-fe9b-4347-8df6-934a276e077b", "address": "fa:16:3e:22:ec:e0", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90104ef6-fe", "ovs_interfaceid": "90104ef6-fe9b-4347-8df6-934a276e077b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Converting VIF {"id": "90104ef6-fe9b-4347-8df6-934a276e077b", "address": "fa:16:3e:22:ec:e0", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90104ef6-fe", "ovs_interfaceid": "90104ef6-fe9b-4347-8df6-934a276e077b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:ec:e0,bridge_name='br-int',has_traffic_filtering=True,id=90104ef6-fe9b-4347-8df6-934a276e077b,network=Network(bc85da72-7764-4b65-a071-aec46e3a2398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90104ef6-fe') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG os_vif [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:ec:e0,bridge_name='br-int',has_traffic_filtering=True,id=90104ef6-fe9b-4347-8df6-934a276e077b,network=Network(bc85da72-7764-4b65-a071-aec46e3a2398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90104ef6-fe') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG nova.network.neutron [req-5e69d7a5-399b-4163-bf94-6389b7eb5e1b req-d15cf836-c244-44d1-8b51-92e372b623f9 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8830dd-5ea0-45db-b691-fef5cc4dc2d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 04:49:23 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90104ef6-fe, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap90104ef6-fe, col_values=(('external_ids', {'iface-id': '90104ef6-fe9b-4347-8df6-934a276e077b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:ec:e0', 'vm-uuid': 'c77e96da-6411-4ae9-af05-8e9bb3c432c6'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251 -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5e69d7a5-399b-4163-bf94-6389b7eb5e1b req-d15cf836-c244-44d1-8b51-92e372b623f9 service nova] Releasing lock "refresh_cache-6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG nova.compute.manager [req-5e69d7a5-399b-4163-bf94-6389b7eb5e1b req-d15cf836-c244-44d1-8b51-92e372b623f9 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-changed-36cd0894-4081-4d21-870e-3d635e0ed9c4 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG nova.compute.manager [req-5e69d7a5-399b-4163-bf94-6389b7eb5e1b req-d15cf836-c244-44d1-8b51-92e372b623f9 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Refreshing instance network info cache due to event network-changed-36cd0894-4081-4d21-870e-3d635e0ed9c4. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5e69d7a5-399b-4163-bf94-6389b7eb5e1b req-d15cf836-c244-44d1-8b51-92e372b623f9 service nova] Acquiring lock "refresh_cache-6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5e69d7a5-399b-4163-bf94-6389b7eb5e1b req-d15cf836-c244-44d1-8b51-92e372b623f9 service nova] Acquired lock "refresh_cache-6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG nova.network.neutron [req-5e69d7a5-399b-4163-bf94-6389b7eb5e1b req-d15cf836-c244-44d1-8b51-92e372b623f9 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Refreshing network info cache for port 36cd0894-4081-4d21-870e-3d635e0ed9c4 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:23 user nova-compute[72444]: INFO os_vif [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:ec:e0,bridge_name='br-int',has_traffic_filtering=True,id=90104ef6-fe9b-4347-8df6-934a276e077b,network=Network(bc85da72-7764-4b65-a071-aec46e3a2398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90104ef6-fe')
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e494d60-ccf2-4130-9917-69a78e237a56]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251] added
Aug 03 04:49:23 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fe9d93-518c-451d-ad5d-d02a246d280a]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cab64a6-1fc6-4ed2-8f47-64c4874ebe7a]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jDmVMpia {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] No VIF found with MAC fa:16:3e:22:ec:e0, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG nova.network.neutron [req-5e69d7a5-399b-4163-bf94-6389b7eb5e1b req-d15cf836-c244-44d1-8b51-92e372b623f9 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jDmVMpia" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[63deaa43-60c5-4fad-8dc5-7e36eb80c903]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jDmVMpia'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[64422e22-0375-4372-950d-6b76551ff7e8]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038163.2342567, 0b219bf3-a3b6-44b5-946e-c10e7498e1d3 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:49:23 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] VM Resumed (Lifecycle Event)
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[983a1e39-0486-4779-93f5-72e054dc4540]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 (non-flash)
Aug 03 04:49:23 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:49:23 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 (non-flash)
Aug 03 04:49:23 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:49:23 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG nova.compute.manager [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251 -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:23 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Instance spawned successfully.
Aug 03 04:49:23 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:49:23 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:49:23 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038163.2367234, 0b219bf3-a3b6-44b5-946e-c10e7498e1d3 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:49:23 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] VM Started (Lifecycle Event)
Aug 03 04:49:23 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f9e39a-aa01-4d57-aa9d-bd73b313f357]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251, portal: 172.16.0.220,3260]
Aug 03 04:49:23 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251, portal: 172.16.0.220,3260] successful.
Aug 03 04:49:23 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b227e6c6-20f6-48e5-bf72-e3b1813b53bd]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:23 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98ff21b-8dea-4f00-a3c8-bcd87d906e38]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 (non-flash)
Aug 03 04:49:23 user nova-compute[72444]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251 (non-flash)
Aug 03 04:49:23 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:49:23 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 (non-flash)
Aug 03 04:49:23 user nova-compute[72444]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251 (non-flash)
Aug 03 04:49:23 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:49:23 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:49:23 user nova-compute[72444]: INFO nova.compute.manager [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Took 6.65 seconds to spawn the instance on the hypervisor.
Aug 03 04:49:23 user nova-compute[72444]: DEBUG nova.compute.manager [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.030s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[080331d6-a99b-45b9-a0d1-5a4055afedbe]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jDmVMpia', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG nova.compute.manager [req-3004b805-da85-49de-a207-34bb5299d9d6 req-5374ae6f-a02f-4d3c-9fc7-c518abdfd01b service nova] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Received event network-vif-plugged-5c810fce-bc56-4763-a65d-dbc53bf0c08a {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3004b805-da85-49de-a207-34bb5299d9d6 req-5374ae6f-a02f-4d3c-9fc7-c518abdfd01b service nova] Acquiring lock "0b219bf3-a3b6-44b5-946e-c10e7498e1d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3004b805-da85-49de-a207-34bb5299d9d6 req-5374ae6f-a02f-4d3c-9fc7-c518abdfd01b service nova] Lock "0b219bf3-a3b6-44b5-946e-c10e7498e1d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3004b805-da85-49de-a207-34bb5299d9d6 req-5374ae6f-a02f-4d3c-9fc7-c518abdfd01b service nova] Lock "0b219bf3-a3b6-44b5-946e-c10e7498e1d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG nova.compute.manager [req-3004b805-da85-49de-a207-34bb5299d9d6 req-5374ae6f-a02f-4d3c-9fc7-c518abdfd01b service nova] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] No waiting events found dispatching network-vif-plugged-5c810fce-bc56-4763-a65d-dbc53bf0c08a {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:49:23 user nova-compute[72444]: WARNING nova.compute.manager [req-3004b805-da85-49de-a207-34bb5299d9d6 req-5374ae6f-a02f-4d3c-9fc7-c518abdfd01b service nova] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Received unexpected event network-vif-plugged-5c810fce-bc56-4763-a65d-dbc53bf0c08a for instance with vm_state building and task_state spawning.
Aug 03 04:49:23 user nova-compute[72444]: DEBUG nova.compute.manager [req-3004b805-da85-49de-a207-34bb5299d9d6 req-5374ae6f-a02f-4d3c-9fc7-c518abdfd01b service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Received event network-changed-90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG nova.compute.manager [req-3004b805-da85-49de-a207-34bb5299d9d6 req-5374ae6f-a02f-4d3c-9fc7-c518abdfd01b service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Refreshing instance network info cache due to event network-changed-90104ef6-fe9b-4347-8df6-934a276e077b. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3004b805-da85-49de-a207-34bb5299d9d6 req-5374ae6f-a02f-4d3c-9fc7-c518abdfd01b service nova] Acquiring lock "refresh_cache-c77e96da-6411-4ae9-af05-8e9bb3c432c6" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3004b805-da85-49de-a207-34bb5299d9d6 req-5374ae6f-a02f-4d3c-9fc7-c518abdfd01b service nova] Acquired lock "refresh_cache-c77e96da-6411-4ae9-af05-8e9bb3c432c6" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG nova.network.neutron [req-3004b805-da85-49de-a207-34bb5299d9d6 req-5374ae6f-a02f-4d3c-9fc7-c518abdfd01b service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Refreshing network info cache for port 90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG nova.network.neutron [req-5e69d7a5-399b-4163-bf94-6389b7eb5e1b req-d15cf836-c244-44d1-8b51-92e372b623f9 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:49:23 user nova-compute[72444]: INFO nova.compute.manager [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Took 7.73 seconds to build instance.
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5e69d7a5-399b-4163-bf94-6389b7eb5e1b req-d15cf836-c244-44d1-8b51-92e372b623f9 service nova] Releasing lock "refresh_cache-6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2043a08e-a8c9-457a-8644-cc498594ebcb tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "0b219bf3-a3b6-44b5-946e-c10e7498e1d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.842s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:23 user nova-compute[72444]: DEBUG nova.network.neutron [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Successfully updated port: 88715119-aa32-4ad2-8c22-8188ee7a1a1f {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:49:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:24 user nova-compute[72444]: DEBUG nova.network.neutron [req-3004b805-da85-49de-a207-34bb5299d9d6 req-5374ae6f-a02f-4d3c-9fc7-c518abdfd01b service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Updated VIF entry in instance network info cache for port 90104ef6-fe9b-4347-8df6-934a276e077b. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:49:24 user nova-compute[72444]: DEBUG nova.network.neutron [req-3004b805-da85-49de-a207-34bb5299d9d6 req-5374ae6f-a02f-4d3c-9fc7-c518abdfd01b service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Updating instance_info_cache with network_info: [{"id": "90104ef6-fe9b-4347-8df6-934a276e077b", "address": "fa:16:3e:22:ec:e0", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90104ef6-fe", "ovs_interfaceid": "90104ef6-fe9b-4347-8df6-934a276e077b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:49:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3004b805-da85-49de-a207-34bb5299d9d6 req-5374ae6f-a02f-4d3c-9fc7-c518abdfd01b service nova] Releasing lock "refresh_cache-c77e96da-6411-4ae9-af05-8e9bb3c432c6" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:49:24 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:49:24 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '23537633163366637', 'path': '/dev/sdc'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:49:24 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537633163366637', 'path': '/dev/sdc'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:49:24 user nova-compute[72444]: DEBUG nova.network.neutron [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Successfully updated port: ab45da29-a935-4aa8-9a10-1793ddbc7ab1 {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:49:24 user nova-compute[72444]: DEBUG nova.objects.instance [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lazy-loading 'flavor' on Instance uuid 1baadfd2-6f00-436b-b3a0-c850cd8cb50e {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:49:24 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 04:49:24 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:49:24 user nova-compute[72444]:   <source dev="/dev/sdc"/>
Aug 03 04:49:24 user nova-compute[72444]:   <target dev="vdc" bus="virtio"/>
Aug 03 04:49:24 user nova-compute[72444]:   <serial>ff6e747f-fc94-4211-aebb-5dafaff8d251</serial>
Aug 03 04:49:24 user nova-compute[72444]: </disk>
Aug 03 04:49:24 user nova-compute[72444]:  {{(pid=72444) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 04:49:24 user nova-compute[72444]: INFO nova.virt.block_device [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Booting with volume 066c7beb-14e3-4f6e-aa2e-90e8f82590f2 at /dev/vdb
Aug 03 04:49:24 user nova-compute[72444]: DEBUG os_brick.utils [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:49:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:24 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0fbae1-d24a-47c4-a465-9527643934af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:24 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77ab3fc-6779-46ec-80fa-4be8e52d78e4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:24 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c65e6b-a8ad-4f40-a6a1-d10c4cef957b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:24 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[587dd9a2-a8c2-4691-82a9-0485d5153b47]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:49:24 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 04:49:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:49:24 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 04:49:24 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6c7fb8-b735-48a3-91bc-054198a20242]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:24 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 04:49:24 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 04:49:24 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 04:49:24 user nova-compute[72444]: DEBUG os_brick.utils [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:49:24 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Updating existing volume attachment record: 988d0165-da49-45a6-a23d-75413d26cdad {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 04:49:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:24 user nova-compute[72444]: DEBUG nova.compute.manager [req-117dba1f-d45f-4a0d-9ee3-5de4ae9452e8 req-83d500da-8105-4e11-b6be-103847a9e2ba service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-changed-88715119-aa32-4ad2-8c22-8188ee7a1a1f {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:49:24 user nova-compute[72444]: DEBUG nova.compute.manager [req-117dba1f-d45f-4a0d-9ee3-5de4ae9452e8 req-83d500da-8105-4e11-b6be-103847a9e2ba service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Refreshing instance network info cache due to event network-changed-88715119-aa32-4ad2-8c22-8188ee7a1a1f. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:49:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-117dba1f-d45f-4a0d-9ee3-5de4ae9452e8 req-83d500da-8105-4e11-b6be-103847a9e2ba service nova] Acquiring lock "refresh_cache-6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:49:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-117dba1f-d45f-4a0d-9ee3-5de4ae9452e8 req-83d500da-8105-4e11-b6be-103847a9e2ba service nova] Acquired lock "refresh_cache-6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:49:24 user nova-compute[72444]: DEBUG nova.network.neutron [req-117dba1f-d45f-4a0d-9ee3-5de4ae9452e8 req-83d500da-8105-4e11-b6be-103847a9e2ba service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Refreshing network info cache for port 88715119-aa32-4ad2-8c22-8188ee7a1a1f {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:49:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:25 user nova-compute[72444]: DEBUG nova.compute.manager [req-eb636c57-6bba-4c04-ac46-9df708fe0ae6 req-6d1dea9f-5a0d-4276-beaa-544e8f768abf service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Received event network-vif-plugged-90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:49:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-eb636c57-6bba-4c04-ac46-9df708fe0ae6 req-6d1dea9f-5a0d-4276-beaa-544e8f768abf service nova] Acquiring lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-eb636c57-6bba-4c04-ac46-9df708fe0ae6 req-6d1dea9f-5a0d-4276-beaa-544e8f768abf service nova] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-eb636c57-6bba-4c04-ac46-9df708fe0ae6 req-6d1dea9f-5a0d-4276-beaa-544e8f768abf service nova] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:25 user nova-compute[72444]: DEBUG nova.compute.manager [req-eb636c57-6bba-4c04-ac46-9df708fe0ae6 req-6d1dea9f-5a0d-4276-beaa-544e8f768abf service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] No waiting events found dispatching network-vif-plugged-90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:49:25 user nova-compute[72444]: WARNING nova.compute.manager [req-eb636c57-6bba-4c04-ac46-9df708fe0ae6 req-6d1dea9f-5a0d-4276-beaa-544e8f768abf service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Received unexpected event network-vif-plugged-90104ef6-fe9b-4347-8df6-934a276e077b for instance with vm_state building and task_state spawning.
Aug 03 04:49:25 user nova-compute[72444]: DEBUG nova.network.neutron [req-117dba1f-d45f-4a0d-9ee3-5de4ae9452e8 req-83d500da-8105-4e11-b6be-103847a9e2ba service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:49:25 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:49:25 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:49:25 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:49:25 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] No VIF found with MAC fa:16:3e:cc:5c:79, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:49:25 user nova-compute[72444]: DEBUG nova.network.neutron [req-117dba1f-d45f-4a0d-9ee3-5de4ae9452e8 req-83d500da-8105-4e11-b6be-103847a9e2ba service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:49:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-117dba1f-d45f-4a0d-9ee3-5de4ae9452e8 req-83d500da-8105-4e11-b6be-103847a9e2ba service nova] Releasing lock "refresh_cache-6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:49:25 user nova-compute[72444]: DEBUG nova.compute.manager [req-117dba1f-d45f-4a0d-9ee3-5de4ae9452e8 req-83d500da-8105-4e11-b6be-103847a9e2ba service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-changed-ab45da29-a935-4aa8-9a10-1793ddbc7ab1 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:49:25 user nova-compute[72444]: DEBUG nova.compute.manager [req-117dba1f-d45f-4a0d-9ee3-5de4ae9452e8 req-83d500da-8105-4e11-b6be-103847a9e2ba service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Refreshing instance network info cache due to event network-changed-ab45da29-a935-4aa8-9a10-1793ddbc7ab1. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:49:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-117dba1f-d45f-4a0d-9ee3-5de4ae9452e8 req-83d500da-8105-4e11-b6be-103847a9e2ba service nova] Acquiring lock "refresh_cache-6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:49:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-117dba1f-d45f-4a0d-9ee3-5de4ae9452e8 req-83d500da-8105-4e11-b6be-103847a9e2ba service nova] Acquired lock "refresh_cache-6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:49:25 user nova-compute[72444]: DEBUG nova.network.neutron [req-117dba1f-d45f-4a0d-9ee3-5de4ae9452e8 req-83d500da-8105-4e11-b6be-103847a9e2ba service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Refreshing network info cache for port ab45da29-a935-4aa8-9a10-1793ddbc7ab1 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:49:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d8e1c44c-51c3-4f75-b7d9-819651343111 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.419s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:25 user nova-compute[72444]: DEBUG nova.network.neutron [req-117dba1f-d45f-4a0d-9ee3-5de4ae9452e8 req-83d500da-8105-4e11-b6be-103847a9e2ba service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:49:25 user nova-compute[72444]: DEBUG nova.network.neutron [req-117dba1f-d45f-4a0d-9ee3-5de4ae9452e8 req-83d500da-8105-4e11-b6be-103847a9e2ba service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:49:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-117dba1f-d45f-4a0d-9ee3-5de4ae9452e8 req-83d500da-8105-4e11-b6be-103847a9e2ba service nova] Releasing lock "refresh_cache-6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:49:25 user nova-compute[72444]: DEBUG nova.network.neutron [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Successfully updated port: 4b540799-a36a-4b46-a678-53a6db44477a {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:49:26 user nova-compute[72444]: DEBUG nova.network.neutron [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Successfully updated port: 0290730e-648d-44ba-b03b-53918307a717 {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:49:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-82d40625-7b08-49a7-b815-923a5065c033 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Acquiring lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-82d40625-7b08-49a7-b815-923a5065c033 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Acquiring lock "refresh_cache-6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:49:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Acquired lock "refresh_cache-6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:49:26 user nova-compute[72444]: DEBUG nova.network.neutron [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:49:26 user nova-compute[72444]: INFO nova.compute.manager [None req-82d40625-7b08-49a7-b815-923a5065c033 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Detaching volume ff6e747f-fc94-4211-aebb-5dafaff8d251
Aug 03 04:49:26 user nova-compute[72444]: DEBUG nova.network.neutron [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:49:26 user nova-compute[72444]: INFO nova.virt.block_device [None req-82d40625-7b08-49a7-b815-923a5065c033 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Attempting to driver detach volume ff6e747f-fc94-4211-aebb-5dafaff8d251 from mountpoint /dev/vdc
Aug 03 04:49:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-82d40625-7b08-49a7-b815-923a5065c033 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Attempting to detach device vdc from instance 1baadfd2-6f00-436b-b3a0-c850cd8cb50e from the persistent domain config. {{(pid=72444) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 04:49:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-82d40625-7b08-49a7-b815-923a5065c033 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 04:49:26 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:49:26 user nova-compute[72444]:   <source dev="/dev/sdc"/>
Aug 03 04:49:26 user nova-compute[72444]:   <target dev="vdc" bus="virtio"/>
Aug 03 04:49:26 user nova-compute[72444]:   <serial>ff6e747f-fc94-4211-aebb-5dafaff8d251</serial>
Aug 03 04:49:26 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 03 04:49:26 user nova-compute[72444]: </disk>
Aug 03 04:49:26 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:49:26 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-82d40625-7b08-49a7-b815-923a5065c033 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Successfully detached device vdc from instance 1baadfd2-6f00-436b-b3a0-c850cd8cb50e from the persistent domain config.
Aug 03 04:49:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-82d40625-7b08-49a7-b815-923a5065c033 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 1baadfd2-6f00-436b-b3a0-c850cd8cb50e from the live domain config. {{(pid=72444) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 04:49:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-82d40625-7b08-49a7-b815-923a5065c033 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 04:49:26 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:49:26 user nova-compute[72444]:   <source dev="/dev/sdc"/>
Aug 03 04:49:26 user nova-compute[72444]:   <target dev="vdc" bus="virtio"/>
Aug 03 04:49:26 user nova-compute[72444]:   <serial>ff6e747f-fc94-4211-aebb-5dafaff8d251</serial>
Aug 03 04:49:26 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 03 04:49:26 user nova-compute[72444]: </disk>
Aug 03 04:49:26 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:49:26 user nova-compute[72444]: DEBUG nova.compute.manager [req-6eb270fc-d460-49c4-bad0-82273e65c368 req-7d5789fb-d7c9-4ba7-91aa-ca3ba4bfe0ee service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-changed-4b540799-a36a-4b46-a678-53a6db44477a {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:49:26 user nova-compute[72444]: DEBUG nova.compute.manager [req-6eb270fc-d460-49c4-bad0-82273e65c368 req-7d5789fb-d7c9-4ba7-91aa-ca3ba4bfe0ee service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Refreshing instance network info cache due to event network-changed-4b540799-a36a-4b46-a678-53a6db44477a. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:49:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6eb270fc-d460-49c4-bad0-82273e65c368 req-7d5789fb-d7c9-4ba7-91aa-ca3ba4bfe0ee service nova] Acquiring lock "refresh_cache-6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG nova.compute.manager [req-98dee7c8-912a-4bf8-86ee-5afa1327c119 req-0c1212e0-ad62-4267-b5ab-e8bc8fbeb9dd service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Received event network-vif-plugged-90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-98dee7c8-912a-4bf8-86ee-5afa1327c119 req-0c1212e0-ad62-4267-b5ab-e8bc8fbeb9dd service nova] Acquiring lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-98dee7c8-912a-4bf8-86ee-5afa1327c119 req-0c1212e0-ad62-4267-b5ab-e8bc8fbeb9dd service nova] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-98dee7c8-912a-4bf8-86ee-5afa1327c119 req-0c1212e0-ad62-4267-b5ab-e8bc8fbeb9dd service nova] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG nova.compute.manager [req-98dee7c8-912a-4bf8-86ee-5afa1327c119 req-0c1212e0-ad62-4267-b5ab-e8bc8fbeb9dd service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] No waiting events found dispatching network-vif-plugged-90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:49:27 user nova-compute[72444]: WARNING nova.compute.manager [req-98dee7c8-912a-4bf8-86ee-5afa1327c119 req-0c1212e0-ad62-4267-b5ab-e8bc8fbeb9dd service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Received unexpected event network-vif-plugged-90104ef6-fe9b-4347-8df6-934a276e077b for instance with vm_state building and task_state spawning.
Aug 03 04:49:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Received event <DeviceRemovedEvent: 1691038167.2512684, 1baadfd2-6f00-436b-b3a0-c850cd8cb50e => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72444) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-82d40625-7b08-49a7-b815-923a5065c033 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 1baadfd2-6f00-436b-b3a0-c850cd8cb50e {{(pid=72444) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 04:49:27 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-82d40625-7b08-49a7-b815-923a5065c033 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Successfully detached device vdc from instance 1baadfd2-6f00-436b-b3a0-c850cd8cb50e from the live domain config.
Aug 03 04:49:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82d40625-7b08-49a7-b815-923a5065c033 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d40625-7b08-49a7-b815-923a5065c033 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jDmVMpia', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:49:27 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-82d40625-7b08-49a7-b815-923a5065c033 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:49:27 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-82d40625-7b08-49a7-b815-923a5065c033 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-82d40625-7b08-49a7-b815-923a5065c033 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d40625-7b08-49a7-b815-923a5065c033 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[914c1ee8-6f64-404e-8544-9d9d0c5c6daf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d177454-dc89-4349-bd47-94be13866d60]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d40625-7b08-49a7-b815-923a5065c033 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 (non-flash)
Aug 03 04:49:27 user nova-compute[72444]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251 (non-flash)
Aug 03 04:49:27 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:49:27 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d40625-7b08-49a7-b815-923a5065c033 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 (non-flash)
Aug 03 04:49:27 user nova-compute[72444]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251 (non-flash)
Aug 03 04:49:27 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:49:27 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d40625-7b08-49a7-b815-923a5065c033 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30a0dbe050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251'): ({'sdc'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-82d40625-7b08-49a7-b815-923a5065c033 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Removing single pathed devices sdc {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bc739c-5405-468a-be0d-f6df00b481ab]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[afcad307-f210-4371-b148-0eefb5bc5c2d]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-82d40625-7b08-49a7-b815-923a5065c033 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Flushing IO for device /dev/sdc {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5cea58-ba9c-46d8-b0e6-5333d314bd40]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-82d40625-7b08-49a7-b815-923a5065c033 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038167.4509575, c77e96da-6411-4ae9-af05-8e9bb3c432c6 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:49:27 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] VM Resumed (Lifecycle Event)
Aug 03 04:49:27 user nova-compute[72444]: DEBUG nova.compute.manager [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.060s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfaa97c-af9f-426a-b1c3-dc6087182e3c]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-82d40625-7b08-49a7-b815-923a5065c033 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-82d40625-7b08-49a7-b815-923a5065c033 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] SCSI volumes sdc have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d40625-7b08-49a7-b815-923a5065c033 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:27 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Instance spawned successfully.
Aug 03 04:49:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[721a61a9-b100-45f4-bf24-518e13c7dd32]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d40625-7b08-49a7-b815-923a5065c033 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251 -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:49:27 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:49:27 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038167.4512806, c77e96da-6411-4ae9-af05-8e9bb3c432c6 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:49:27 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] VM Started (Lifecycle Event)
Aug 03 04:49:27 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a973778-0c6a-424f-b9eb-40c7a650b8ec]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d40625-7b08-49a7-b815-923a5065c033 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251, portal: 172.16.0.220,3260]
Aug 03 04:49:27 user nova-compute[72444]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251, portal: 172.16.0.220,3260] successful.
Aug 03 04:49:27 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251 -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:27 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:49:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff6e747f-fc94-4211-aebb-5dafaff8d251 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2009cad2-57da-4dd5-a200-5b24d7d0226a]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d40625-7b08-49a7-b815-923a5065c033 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-82d40625-7b08-49a7-b815-923a5065c033 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d40625-7b08-49a7-b815-923a5065c033 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] <== disconnect_volume: return (342ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:49:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82d40625-7b08-49a7-b815-923a5065c033 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:49:27 user nova-compute[72444]: INFO nova.compute.manager [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Took 7.17 seconds to spawn the instance on the hypervisor.
Aug 03 04:49:27 user nova-compute[72444]: DEBUG nova.compute.manager [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:49:27 user nova-compute[72444]: INFO nova.compute.manager [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Took 8.09 seconds to build instance.
Aug 03 04:49:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e1cde5c6-2690-4ac0-a87d-7ad30d27c74f tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.200s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:28 user nova-compute[72444]: DEBUG nova.network.neutron [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Updating instance_info_cache with network_info: [{"id": "0b5e2297-6ab0-4965-a202-3f36a81e5646", "address": "fa:16:3e:2f:06:86", "network": {"id": "68729275-1a5f-4087-a6ca-34c6b674ecfd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-45954298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b5e2297-6a", "ovs_interfaceid": "0b5e2297-6ab0-4965-a202-3f36a81e5646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0819cee-25ca-4271-aca3-47125f12360b", "address": "fa:16:3e:87:4b:ea", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0819cee-25", "ovs_interfaceid": "a0819cee-25ca-4271-aca3-47125f12360b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "36cd0894-4081-4d21-870e-3d635e0ed9c4", "address": "fa:16:3e:24:83:27", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36cd0894-40", "ovs_interfaceid": "36cd0894-4081-4d21-870e-3d635e0ed9c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "88715119-aa32-4ad2-8c22-8188ee7a1a1f", "address": "fa:16:3e:3d:c8:82", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88715119-aa", "ovs_interfaceid": "88715119-aa32-4ad2-8c22-8188ee7a1a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab45da29-a935-4aa8-9a10-1793ddbc7ab1", "address": "fa:16:3e:e2:8b:4d", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab45da29-a9", "ovs_interfaceid": "ab45da29-a935-4aa8-9a10-1793ddbc7ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b540799-a36a-4b46-a678-53a6db44477a", "address": "fa:16:3e:f0:75:b6", "network": {"id": "0f0a5fa7-1d9d-47a5-9dac-416467b65d29", "bridge": "br-int", "label": "tempest-device-tagging-net2-1543847764", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b540799-a3", "ovs_interfaceid": "4b540799-a36a-4b46-a678-53a6db44477a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0290730e-648d-44ba-b03b-53918307a717", "address": "fa:16:3e:9a:c6:30", "network": {"id": "0f0a5fa7-1d9d-47a5-9dac-416467b65d29", "bridge": "br-int", "label": "tempest-device-tagging-net2-1543847764", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0290730e-64", "ovs_interfaceid": "0290730e-648d-44ba-b03b-53918307a717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:49:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Releasing lock "refresh_cache-6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:49:28 user nova-compute[72444]: DEBUG nova.compute.manager [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Instance network_info: |[{"id": "0b5e2297-6ab0-4965-a202-3f36a81e5646", "address": "fa:16:3e:2f:06:86", "network": {"id": "68729275-1a5f-4087-a6ca-34c6b674ecfd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-45954298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b5e2297-6a", "ovs_interfaceid": "0b5e2297-6ab0-4965-a202-3f36a81e5646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0819cee-25ca-4271-aca3-47125f12360b", "address": "fa:16:3e:87:4b:ea", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0819cee-25", "ovs_interfaceid": "a0819cee-25ca-4271-aca3-47125f12360b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "36cd0894-4081-4d21-870e-3d635e0ed9c4", "address": "fa:16:3e:24:83:27", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36cd0894-40", "ovs_interfaceid": "36cd0894-4081-4d21-870e-3d635e0ed9c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "88715119-aa32-4ad2-8c22-8188ee7a1a1f", "address": "fa:16:3e:3d:c8:82", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88715119-aa", "ovs_interfaceid": "88715119-aa32-4ad2-8c22-8188ee7a1a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab45da29-a935-4aa8-9a10-1793ddbc7ab1", "address": "fa:16:3e:e2:8b:4d", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab45da29-a9", "ovs_interfaceid": "ab45da29-a935-4aa8-9a10-1793ddbc7ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b540799-a36a-4b46-a678-53a6db44477a", "address": "fa:16:3e:f0:75:b6", "network": {"id": "0f0a5fa7-1d9d-47a5-9dac-416467b65d29", "bridge": "br-int", "label": "tempest-device-tagging-net2-1543847764", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b540799-a3", "ovs_interfaceid": "4b540799-a36a-4b46-a678-53a6db44477a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0290730e-648d-44ba-b03b-53918307a717", "address": "fa:16:3e:9a:c6:30", "network": {"id": "0f0a5fa7-1d9d-47a5-9dac-416467b65d29", "bridge": "br-int", "label": "tempest-device-tagging-net2-1543847764", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0290730e-64", "ovs_interfaceid": "0290730e-648d-44ba-b03b-53918307a717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 04:49:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6eb270fc-d460-49c4-bad0-82273e65c368 req-7d5789fb-d7c9-4ba7-91aa-ca3ba4bfe0ee service nova] Acquired lock "refresh_cache-6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:49:28 user nova-compute[72444]: DEBUG nova.network.neutron [req-6eb270fc-d460-49c4-bad0-82273e65c368 req-7d5789fb-d7c9-4ba7-91aa-ca3ba4bfe0ee service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Refreshing network info cache for port 4b540799-a36a-4b46-a678-53a6db44477a {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:49:29 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:29 user nova-compute[72444]: DEBUG nova.network.neutron [req-6eb270fc-d460-49c4-bad0-82273e65c368 req-7d5789fb-d7c9-4ba7-91aa-ca3ba4bfe0ee service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Updated VIF entry in instance network info cache for port 4b540799-a36a-4b46-a678-53a6db44477a. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:49:29 user nova-compute[72444]: DEBUG nova.network.neutron [req-6eb270fc-d460-49c4-bad0-82273e65c368 req-7d5789fb-d7c9-4ba7-91aa-ca3ba4bfe0ee service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Updating instance_info_cache with network_info: [{"id": "0b5e2297-6ab0-4965-a202-3f36a81e5646", "address": "fa:16:3e:2f:06:86", "network": {"id": "68729275-1a5f-4087-a6ca-34c6b674ecfd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-45954298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b5e2297-6a", "ovs_interfaceid": "0b5e2297-6ab0-4965-a202-3f36a81e5646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0819cee-25ca-4271-aca3-47125f12360b", "address": "fa:16:3e:87:4b:ea", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0819cee-25", "ovs_interfaceid": "a0819cee-25ca-4271-aca3-47125f12360b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "36cd0894-4081-4d21-870e-3d635e0ed9c4", "address": "fa:16:3e:24:83:27", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36cd0894-40", "ovs_interfaceid": "36cd0894-4081-4d21-870e-3d635e0ed9c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "88715119-aa32-4ad2-8c22-8188ee7a1a1f", "address": "fa:16:3e:3d:c8:82", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88715119-aa", "ovs_interfaceid": "88715119-aa32-4ad2-8c22-8188ee7a1a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab45da29-a935-4aa8-9a10-1793ddbc7ab1", "address": "fa:16:3e:e2:8b:4d", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab45da29-a9", "ovs_interfaceid": "ab45da29-a935-4aa8-9a10-1793ddbc7ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b540799-a36a-4b46-a678-53a6db44477a", "address": "fa:16:3e:f0:75:b6", "network": {"id": "0f0a5fa7-1d9d-47a5-9dac-416467b65d29", "bridge": "br-int", "label": "tempest-device-tagging-net2-1543847764", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b540799-a3", "ovs_interfaceid": "4b540799-a36a-4b46-a678-53a6db44477a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0290730e-648d-44ba-b03b-53918307a717", "address": "fa:16:3e:9a:c6:30", "network": {"id": "0f0a5fa7-1d9d-47a5-9dac-416467b65d29", "bridge": "br-int", "label": "tempest-device-tagging-net2-1543847764", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0290730e-64", "ovs_interfaceid": "0290730e-648d-44ba-b03b-53918307a717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:49:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6eb270fc-d460-49c4-bad0-82273e65c368 req-7d5789fb-d7c9-4ba7-91aa-ca3ba4bfe0ee service nova] Releasing lock "refresh_cache-6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:49:29 user nova-compute[72444]: DEBUG nova.compute.manager [req-6eb270fc-d460-49c4-bad0-82273e65c368 req-7d5789fb-d7c9-4ba7-91aa-ca3ba4bfe0ee service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-changed-0290730e-648d-44ba-b03b-53918307a717 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:49:29 user nova-compute[72444]: DEBUG nova.compute.manager [req-6eb270fc-d460-49c4-bad0-82273e65c368 req-7d5789fb-d7c9-4ba7-91aa-ca3ba4bfe0ee service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Refreshing instance network info cache due to event network-changed-0290730e-648d-44ba-b03b-53918307a717. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:49:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6eb270fc-d460-49c4-bad0-82273e65c368 req-7d5789fb-d7c9-4ba7-91aa-ca3ba4bfe0ee service nova] Acquiring lock "refresh_cache-6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:49:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6eb270fc-d460-49c4-bad0-82273e65c368 req-7d5789fb-d7c9-4ba7-91aa-ca3ba4bfe0ee service nova] Acquired lock "refresh_cache-6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:49:29 user nova-compute[72444]: DEBUG nova.network.neutron [req-6eb270fc-d460-49c4-bad0-82273e65c368 req-7d5789fb-d7c9-4ba7-91aa-ca3ba4bfe0ee service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Refreshing network info cache for port 0290730e-648d-44ba-b03b-53918307a717 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:49:29 user nova-compute[72444]: DEBUG nova.objects.instance [None req-82d40625-7b08-49a7-b815-923a5065c033 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lazy-loading 'flavor' on Instance uuid 1baadfd2-6f00-436b-b3a0-c850cd8cb50e {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:49:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-82d40625-7b08-49a7-b815-923a5065c033 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.156s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:29 user nova-compute[72444]: DEBUG nova.network.neutron [req-6eb270fc-d460-49c4-bad0-82273e65c368 req-7d5789fb-d7c9-4ba7-91aa-ca3ba4bfe0ee service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Updated VIF entry in instance network info cache for port 0290730e-648d-44ba-b03b-53918307a717. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:49:29 user nova-compute[72444]: DEBUG nova.network.neutron [req-6eb270fc-d460-49c4-bad0-82273e65c368 req-7d5789fb-d7c9-4ba7-91aa-ca3ba4bfe0ee service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Updating instance_info_cache with network_info: [{"id": "0b5e2297-6ab0-4965-a202-3f36a81e5646", "address": "fa:16:3e:2f:06:86", "network": {"id": "68729275-1a5f-4087-a6ca-34c6b674ecfd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-45954298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b5e2297-6a", "ovs_interfaceid": "0b5e2297-6ab0-4965-a202-3f36a81e5646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0819cee-25ca-4271-aca3-47125f12360b", "address": "fa:16:3e:87:4b:ea", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0819cee-25", "ovs_interfaceid": "a0819cee-25ca-4271-aca3-47125f12360b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "36cd0894-4081-4d21-870e-3d635e0ed9c4", "address": "fa:16:3e:24:83:27", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36cd0894-40", "ovs_interfaceid": "36cd0894-4081-4d21-870e-3d635e0ed9c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "88715119-aa32-4ad2-8c22-8188ee7a1a1f", "address": "fa:16:3e:3d:c8:82", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88715119-aa", "ovs_interfaceid": "88715119-aa32-4ad2-8c22-8188ee7a1a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab45da29-a935-4aa8-9a10-1793ddbc7ab1", "address": "fa:16:3e:e2:8b:4d", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab45da29-a9", "ovs_interfaceid": "ab45da29-a935-4aa8-9a10-1793ddbc7ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b540799-a36a-4b46-a678-53a6db44477a", "address": "fa:16:3e:f0:75:b6", "network": {"id": "0f0a5fa7-1d9d-47a5-9dac-416467b65d29", "bridge": "br-int", "label": "tempest-device-tagging-net2-1543847764", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b540799-a3", "ovs_interfaceid": "4b540799-a36a-4b46-a678-53a6db44477a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0290730e-648d-44ba-b03b-53918307a717", "address": "fa:16:3e:9a:c6:30", "network": {"id": "0f0a5fa7-1d9d-47a5-9dac-416467b65d29", "bridge": "br-int", "label": "tempest-device-tagging-net2-1543847764", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0290730e-64", "ovs_interfaceid": "0290730e-648d-44ba-b03b-53918307a717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:49:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6eb270fc-d460-49c4-bad0-82273e65c368 req-7d5789fb-d7c9-4ba7-91aa-ca3ba4bfe0ee service nova] Releasing lock "refresh_cache-6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:49:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:33 user nova-compute[72444]: INFO nova.virt.block_device [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Booting with volume 6c6e85ec-1d45-4c13-a173-78e9a9373d39 at /dev/vdc
Aug 03 04:49:34 user nova-compute[72444]: DEBUG os_brick.utils [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:49:34 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:34 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:34 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddeba047-4db8-4931-8588-79e3bd78684a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:34 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:34 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:34 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27f72b4-4442-4c57-9dcd-6c9856593d6a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:34 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:34 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:34 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[50759ca0-da88-4d3d-9adf-0d85823152c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:34 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[002e2540-8b93-4e52-a58c-c2a833242b5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:34 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:34 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:49:34 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 04:49:34 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:34 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:49:34 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 04:49:34 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc15d23-ff7e-4b4f-a461-7aa769055900]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:34 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 04:49:34 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 04:49:34 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 04:49:34 user nova-compute[72444]: DEBUG os_brick.utils [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:49:34 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Updating existing volume attachment record: d1f66bd7-e275-404e-a8c9-403525e2e650 {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 04:49:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:41 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:49:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-83d7aa34-9d1b-4cee-a24c-3b0c09606a9d tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Acquiring lock "e3089887-56df-42de-bc62-88e6db28daf0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-83d7aa34-9d1b-4cee-a24c-3b0c09606a9d tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Lock "e3089887-56df-42de-bc62-88e6db28daf0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-83d7aa34-9d1b-4cee-a24c-3b0c09606a9d tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Acquiring lock "e3089887-56df-42de-bc62-88e6db28daf0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-83d7aa34-9d1b-4cee-a24c-3b0c09606a9d tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Lock "e3089887-56df-42de-bc62-88e6db28daf0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-83d7aa34-9d1b-4cee-a24c-3b0c09606a9d tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Lock "e3089887-56df-42de-bc62-88e6db28daf0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:42 user nova-compute[72444]: INFO nova.compute.manager [None req-83d7aa34-9d1b-4cee-a24c-3b0c09606a9d tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Terminating instance
Aug 03 04:49:42 user nova-compute[72444]: DEBUG nova.compute.manager [None req-83d7aa34-9d1b-4cee-a24c-3b0c09606a9d tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 04:49:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:42 user nova-compute[72444]: DEBUG nova.compute.manager [req-5b73032a-b5d2-4143-9cb0-58edff206ec7 req-3f314511-d312-4ba9-a259-2e772eba5d97 service nova] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Received event network-vif-unplugged-6eadddef-1b9b-4a34-8217-dc485697332f {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:49:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5b73032a-b5d2-4143-9cb0-58edff206ec7 req-3f314511-d312-4ba9-a259-2e772eba5d97 service nova] Acquiring lock "e3089887-56df-42de-bc62-88e6db28daf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5b73032a-b5d2-4143-9cb0-58edff206ec7 req-3f314511-d312-4ba9-a259-2e772eba5d97 service nova] Lock "e3089887-56df-42de-bc62-88e6db28daf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5b73032a-b5d2-4143-9cb0-58edff206ec7 req-3f314511-d312-4ba9-a259-2e772eba5d97 service nova] Lock "e3089887-56df-42de-bc62-88e6db28daf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:42 user nova-compute[72444]: DEBUG nova.compute.manager [req-5b73032a-b5d2-4143-9cb0-58edff206ec7 req-3f314511-d312-4ba9-a259-2e772eba5d97 service nova] [instance: e3089887-56df-42de-bc62-88e6db28daf0] No waiting events found dispatching network-vif-unplugged-6eadddef-1b9b-4a34-8217-dc485697332f {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:49:42 user nova-compute[72444]: DEBUG nova.compute.manager [req-5b73032a-b5d2-4143-9cb0-58edff206ec7 req-3f314511-d312-4ba9-a259-2e772eba5d97 service nova] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Received event network-vif-unplugged-6eadddef-1b9b-4a34-8217-dc485697332f for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:49:42 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Instance destroyed successfully.
Aug 03 04:49:42 user nova-compute[72444]: DEBUG nova.objects.instance [None req-83d7aa34-9d1b-4cee-a24c-3b0c09606a9d tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Lazy-loading 'resources' on Instance uuid e3089887-56df-42de-bc62-88e6db28daf0 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:49:42 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-83d7aa34-9d1b-4cee-a24c-3b0c09606a9d tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:40:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1332468531',display_name='tempest-ServersNegativeTestJSON-server-1332468531',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1332468531',id=5,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:41:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81df940dade241e1a3560045086f8699',ramdisk_id='',reservation_id='r-no5u06su',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-2144635638',owner_user_name='tempest-ServersNegativeTestJSON-2144635638-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:41:06Z,user_data=None,user_id='f3d18e55922c4d41bea8cc96c6c7cae3',uuid=e3089887-56df-42de-bc62-88e6db28daf0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6eadddef-1b9b-4a34-8217-dc485697332f", "address": "fa:16:3e:d5:f4:36", "network": {"id": "6ec6c203-3446-4671-84b4-9d6a55757afb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1998429186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81df940dade241e1a3560045086f8699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eadddef-1b", "ovs_interfaceid": "6eadddef-1b9b-4a34-8217-dc485697332f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:49:42 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-83d7aa34-9d1b-4cee-a24c-3b0c09606a9d tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Converting VIF {"id": "6eadddef-1b9b-4a34-8217-dc485697332f", "address": "fa:16:3e:d5:f4:36", "network": {"id": "6ec6c203-3446-4671-84b4-9d6a55757afb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1998429186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81df940dade241e1a3560045086f8699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eadddef-1b", "ovs_interfaceid": "6eadddef-1b9b-4a34-8217-dc485697332f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:49:42 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-83d7aa34-9d1b-4cee-a24c-3b0c09606a9d tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:f4:36,bridge_name='br-int',has_traffic_filtering=True,id=6eadddef-1b9b-4a34-8217-dc485697332f,network=Network(6ec6c203-3446-4671-84b4-9d6a55757afb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eadddef-1b') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:49:42 user nova-compute[72444]: DEBUG os_vif [None req-83d7aa34-9d1b-4cee-a24c-3b0c09606a9d tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:f4:36,bridge_name='br-int',has_traffic_filtering=True,id=6eadddef-1b9b-4a34-8217-dc485697332f,network=Network(6ec6c203-3446-4671-84b4-9d6a55757afb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eadddef-1b') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:49:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6eadddef-1b, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:49:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:49:42 user nova-compute[72444]: INFO os_vif [None req-83d7aa34-9d1b-4cee-a24c-3b0c09606a9d tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:f4:36,bridge_name='br-int',has_traffic_filtering=True,id=6eadddef-1b9b-4a34-8217-dc485697332f,network=Network(6ec6c203-3446-4671-84b4-9d6a55757afb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eadddef-1b')
Aug 03 04:49:42 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-83d7aa34-9d1b-4cee-a24c-3b0c09606a9d tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Deleting instance files /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0_del
Aug 03 04:49:42 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-83d7aa34-9d1b-4cee-a24c-3b0c09606a9d tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Deletion of /opt/stack/data/nova/instances/e3089887-56df-42de-bc62-88e6db28daf0_del complete
Aug 03 04:49:42 user nova-compute[72444]: INFO nova.compute.manager [None req-83d7aa34-9d1b-4cee-a24c-3b0c09606a9d tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 03 04:49:42 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-83d7aa34-9d1b-4cee-a24c-3b0c09606a9d tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 04:49:42 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 04:49:42 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: e3089887-56df-42de-bc62-88e6db28daf0] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG nova.compute.manager [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 04:49:43 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Creating image(s)
Aug 03 04:49:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Did not create local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Ensure instance console log exists: /opt/stack/data/nova/instances/6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Start _get_guest_xml network_info=[{"id": "0b5e2297-6ab0-4965-a202-3f36a81e5646", "address": "fa:16:3e:2f:06:86", "network": {"id": "68729275-1a5f-4087-a6ca-34c6b674ecfd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-45954298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b5e2297-6a", "ovs_interfaceid": "0b5e2297-6ab0-4965-a202-3f36a81e5646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0819cee-25ca-4271-aca3-47125f12360b", "address": "fa:16:3e:87:4b:ea", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0819cee-25", "ovs_interfaceid": "a0819cee-25ca-4271-aca3-47125f12360b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "36cd0894-4081-4d21-870e-3d635e0ed9c4", "address": "fa:16:3e:24:83:27", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36cd0894-40", "ovs_interfaceid": "36cd0894-4081-4d21-870e-3d635e0ed9c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "88715119-aa32-4ad2-8c22-8188ee7a1a1f", "address": "fa:16:3e:3d:c8:82", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88715119-aa", "ovs_interfaceid": "88715119-aa32-4ad2-8c22-8188ee7a1a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab45da29-a935-4aa8-9a10-1793ddbc7ab1", "address": "fa:16:3e:e2:8b:4d", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab45da29-a9", "ovs_interfaceid": "ab45da29-a935-4aa8-9a10-1793ddbc7ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b540799-a36a-4b46-a678-53a6db44477a", "address": "fa:16:3e:f0:75:b6", "network": {"id": "0f0a5fa7-1d9d-47a5-9dac-416467b65d29", "bridge": "br-int", "label": "tempest-device-tagging-net2-1543847764", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b540799-a3", "ovs_interfaceid": "4b540799-a36a-4b46-a678-53a6db44477a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0290730e-648d-44ba-b03b-53918307a717", "address": "fa:16:3e:9a:c6:30", "network": {"id": "0f0a5fa7-1d9d-47a5-9dac-416467b65d29", "bridge": "br-int", "label": "tempest-device-tagging-net2-1543847764", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0290730e-64", "ovs_interfaceid": "0290730e-648d-44ba-b03b-53918307a717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ySfAObUj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16', 'attached_at': '', 'detached_at': '', 'volume_id': '4a7eeea2-85c7-436b-8003-948ca1dbbcab', 'serial': '4a7eeea2-85c7-436b-8003-948ca1dbbcab'}, 'disk_bus': 'virtio', 'attachment_id': '45739afe-7068-4e13-ac00-641253077d85', 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None}, {'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IZgUWojX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16', 'attached_at': '', 'detached_at': '', 'volume_id': '066c7beb-14e3-4f6e-aa2e-90e8f82590f2', 'serial': '066c7beb-14e3-4f6e-aa2e-90e8f82590f2'}, 'disk_bus': 'virtio', 'attachment_id': '988d0165-da49-45a6-a23d-75413d26cdad', 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None}, {'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KtvVOgei', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16', 'attached_at': '', 'detached_at': '', 'volume_id': '6c6e85ec-1d45-4c13-a173-78e9a9373d39', 'serial': '6c6e85ec-1d45-4c13-a173-78e9a9373d39'}, 'disk_bus': 'virtio', 'attachment_id': 'd1f66bd7-e275-404e-a8c9-403525e2e650', 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:49:43 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:49:43 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:49:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ySfAObUj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:49:43 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:49:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:49:43 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:49:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:49:43 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:49:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c18eee-252c-4736-a115-1691611480d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 04:49:43 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7414dcea-3dd7-4963-ab84-09d4e90568af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab] added
Aug 03 04:49:43 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b27528-9878-4d63-b00c-54ea8bfda47b]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0badcebf-a956-4bec-aa33-1ae663235cbe]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ySfAObUj {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ySfAObUj" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[897cdd8a-1e77-4649-8ea3-4784ecb81f7f]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ySfAObUj'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e90566-51a1-4728-8984-8b0e1a78e367]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[731966c0-b87f-4762-b2cf-9f565a2e9989]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 (non-flash)
Aug 03 04:49:43 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:49:43 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 (non-flash)
Aug 03 04:49:43 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:49:43 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[feac855d-0b5d-4158-a049-7f563d490eea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab, portal: 172.16.0.220,3260]
Aug 03 04:49:43 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab, portal: 172.16.0.220,3260] successful.
Aug 03 04:49:43 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05d62f7-f5c6-490a-9520-71b91d18d674]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[126098b4-7353-4215-a1d9-a4c03a420626]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 (non-flash)
Aug 03 04:49:43 user nova-compute[72444]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab (non-flash)
Aug 03 04:49:43 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:49:43 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 (non-flash)
Aug 03 04:49:43 user nova-compute[72444]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab (non-flash)
Aug 03 04:49:43 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:49:43 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2abbb2d-3215-4785-bfd3-65d7647e6538]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ySfAObUj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG nova.compute.manager [req-35a5dc75-f7f3-4c60-9ea9-6b2d10d67143 req-be937b17-5f54-4ebd-8723-a2fcc6942a33 service nova] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Received event network-vif-deleted-6eadddef-1b9b-4a34-8217-dc485697332f {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:49:43 user nova-compute[72444]: INFO nova.compute.manager [req-35a5dc75-f7f3-4c60-9ea9-6b2d10d67143 req-be937b17-5f54-4ebd-8723-a2fcc6942a33 service nova] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Neutron deleted interface 6eadddef-1b9b-4a34-8217-dc485697332f; detaching it from the instance and deleting it from the info cache
Aug 03 04:49:43 user nova-compute[72444]: DEBUG nova.network.neutron [req-35a5dc75-f7f3-4c60-9ea9-6b2d10d67143 req-be937b17-5f54-4ebd-8723-a2fcc6942a33 service nova] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:49:43 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Took 0.53 seconds to deallocate network for instance.
Aug 03 04:49:43 user nova-compute[72444]: DEBUG nova.compute.manager [req-35a5dc75-f7f3-4c60-9ea9-6b2d10d67143 req-be937b17-5f54-4ebd-8723-a2fcc6942a33 service nova] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Detach interface failed, port_id=6eadddef-1b9b-4a34-8217-dc485697332f, reason: Instance e3089887-56df-42de-bc62-88e6db28daf0 could not be found. {{(pid=72444) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-83d7aa34-9d1b-4cee-a24c-3b0c09606a9d tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-83d7aa34-9d1b-4cee-a24c-3b0c09606a9d tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-83d7aa34-9d1b-4cee-a24c-3b0c09606a9d tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-83d7aa34-9d1b-4cee-a24c-3b0c09606a9d tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:49:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-83d7aa34-9d1b-4cee-a24c-3b0c09606a9d tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.434s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:44 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-83d7aa34-9d1b-4cee-a24c-3b0c09606a9d tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Deleted allocations for instance e3089887-56df-42de-bc62-88e6db28daf0
Aug 03 04:49:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-83d7aa34-9d1b-4cee-a24c-3b0c09606a9d tempest-ServersNegativeTestJSON-2144635638 tempest-ServersNegativeTestJSON-2144635638-project-member] Lock "e3089887-56df-42de-bc62-88e6db28daf0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.998s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23033396132373431', 'path': '/dev/sdc'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033396132373431', 'path': '/dev/sdc'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IZgUWojX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:49:44 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:49:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:49:44 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:49:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:49:44 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:49:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG nova.compute.manager [req-650c0b29-7312-41f9-b599-84ee82c54490 req-171dff17-8c6c-4b29-9d80-97af4ffe1206 service nova] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Received event network-vif-plugged-6eadddef-1b9b-4a34-8217-dc485697332f {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-650c0b29-7312-41f9-b599-84ee82c54490 req-171dff17-8c6c-4b29-9d80-97af4ffe1206 service nova] Acquiring lock "e3089887-56df-42de-bc62-88e6db28daf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-650c0b29-7312-41f9-b599-84ee82c54490 req-171dff17-8c6c-4b29-9d80-97af4ffe1206 service nova] Lock "e3089887-56df-42de-bc62-88e6db28daf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-650c0b29-7312-41f9-b599-84ee82c54490 req-171dff17-8c6c-4b29-9d80-97af4ffe1206 service nova] Lock "e3089887-56df-42de-bc62-88e6db28daf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG nova.compute.manager [req-650c0b29-7312-41f9-b599-84ee82c54490 req-171dff17-8c6c-4b29-9d80-97af4ffe1206 service nova] [instance: e3089887-56df-42de-bc62-88e6db28daf0] No waiting events found dispatching network-vif-plugged-6eadddef-1b9b-4a34-8217-dc485697332f {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:49:44 user nova-compute[72444]: WARNING nova.compute.manager [req-650c0b29-7312-41f9-b599-84ee82c54490 req-171dff17-8c6c-4b29-9d80-97af4ffe1206 service nova] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Received unexpected event network-vif-plugged-6eadddef-1b9b-4a34-8217-dc485697332f for instance with vm_state deleted and task_state None.
Aug 03 04:49:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef2cfbf-ea68-45b2-85e0-791f4f061e7e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 04:49:44 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a2e8a7-7141-4ee0-b9b5-34973b63a5d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2] added
Aug 03 04:49:44 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afdf7c9-28a7-4b94-aa68-9f7b1618d2bb]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ddd810-2ce2-43d7-8df6-64457b13c20e]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IZgUWojX {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IZgUWojX" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac714679-6f74-4f29-a3ed-76395a6994a6]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IZgUWojX'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a9bf23-faf5-4a75-b44b-7a08ab03df62]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe5812f-583b-43cc-ab3a-2ee96e3d4a4a]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 (non-flash)
Aug 03 04:49:44 user nova-compute[72444]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab (non-flash)
Aug 03 04:49:44 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:49:44 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 (non-flash)
Aug 03 04:49:44 user nova-compute[72444]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab (non-flash)
Aug 03 04:49:44 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:49:44 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5e6be4-76f2-4848-bc9f-88e709f77072]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2, portal: 172.16.0.220,3260]
Aug 03 04:49:44 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2, portal: 172.16.0.220,3260] successful.
Aug 03 04:49:44 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0ec360-1b8a-449b-a893-8a4ec02e9153]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bcbb12-ee18-408e-a3eb-0341001039e6]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 (non-flash)
Aug 03 04:49:44 user nova-compute[72444]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab (non-flash)
Aug 03 04:49:44 user nova-compute[72444]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 (non-flash)
Aug 03 04:49:44 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:49:44 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 (non-flash)
Aug 03 04:49:44 user nova-compute[72444]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab (non-flash)
Aug 03 04:49:44 user nova-compute[72444]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 (non-flash)
Aug 03 04:49:44 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:49:44 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14c78dc-e39b-4f55-81eb-c9d80bd9aa67]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:44 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: None {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:49:45 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:49:45 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:49:45 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:49:45 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:49:45 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 04:49:45 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:49:45 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IZgUWojX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:49:45 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:49:45 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '26338316263333831', 'path': '/dev/sdd'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:49:45 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338316263333831', 'path': '/dev/sdd'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:49:45 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:49:45 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KtvVOgei', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:49:45 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:49:45 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:49:45 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:49:45 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:49:45 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:49:45 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:49:45 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:49:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:45 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2eb5c3e-e62e-444d-a4b4-b1fdc73b9335]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:45 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 04:49:45 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e437b4f9-213d-48cb-a4cc-95f0fd0ef28f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39] added
Aug 03 04:49:46 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3baf951-c976-4386-8d8f-ac07ca7181d6]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0900b6e-84a7-4f26-858e-616bb51335cf]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KtvVOgei {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KtvVOgei" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9553d3e8-b731-4978-b5e8-d66a81f32211]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KtvVOgei'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9ad605-5506-4aa9-8579-4f9f721ba6f6]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7576f7f3-560d-46e7-9730-4de79c62bc2e]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 (non-flash)
Aug 03 04:49:46 user nova-compute[72444]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab (non-flash)
Aug 03 04:49:46 user nova-compute[72444]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 (non-flash)
Aug 03 04:49:46 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:49:46 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 (non-flash)
Aug 03 04:49:46 user nova-compute[72444]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab (non-flash)
Aug 03 04:49:46 user nova-compute[72444]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 (non-flash)
Aug 03 04:49:46 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:49:46 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[741d726b-aa8f-4286-bd1a-2ae2ca6040bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39, portal: 172.16.0.220,3260]
Aug 03 04:49:46 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39, portal: 172.16.0.220,3260] successful.
Aug 03 04:49:46 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d37ec8-51ef-4612-a4b7-39b31d5b40ce]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af7ddb1-fb3e-4357-8c91-b4d784c9bfbd]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 (non-flash)
Aug 03 04:49:46 user nova-compute[72444]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab (non-flash)
Aug 03 04:49:46 user nova-compute[72444]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 (non-flash)
Aug 03 04:49:46 user nova-compute[72444]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 (non-flash)
Aug 03 04:49:46 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:49:46 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 (non-flash)
Aug 03 04:49:46 user nova-compute[72444]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab (non-flash)
Aug 03 04:49:46 user nova-compute[72444]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 (non-flash)
Aug 03 04:49:46 user nova-compute[72444]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 (non-flash)
Aug 03 04:49:46 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:49:46 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b611fe-5766-427c-95fb-e789554da9e6]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:49:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KtvVOgei', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23239613831313733', 'path': '/dev/sde'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239613831313733', 'path': '/dev/sde'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:49:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236579212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236579212',id=22,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGMQcHG8oBit3ZUG9qTovtEpNiUBS2ZhjNnojHDQeFgdbWAPBuSR0LSZUYTSmF0zzTn7tLY0Fsf0QF8KnuY50DVRY4YVIZckuRFGNQHAugbtlsN9Zb4BFepLTdj/uAGHQ==',key_name='tempest-keypair-1563763870',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1996f0a97dc84be4906a638ee6e19b19',ramdisk_id='',reservation_id='r-w4whabm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1365843340',owner_user_name='tempest-TaggedBootDevicesTest-1365843340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:49:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d24fc36445c245ff83f65f2a86f4f393',uuid=6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b5e2297-6ab0-4965-a202-3f36a81e5646", "address": "fa:16:3e:2f:06:86", "network": {"id": "68729275-1a5f-4087-a6ca-34c6b674ecfd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-45954298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b5e2297-6a", "ovs_interfaceid": "0b5e2297-6ab0-4965-a202-3f36a81e5646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converting VIF {"id": "0b5e2297-6ab0-4965-a202-3f36a81e5646", "address": "fa:16:3e:2f:06:86", "network": {"id": "68729275-1a5f-4087-a6ca-34c6b674ecfd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-45954298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b5e2297-6a", "ovs_interfaceid": "0b5e2297-6ab0-4965-a202-3f36a81e5646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:06:86,bridge_name='br-int',has_traffic_filtering=True,id=0b5e2297-6ab0-4965-a202-3f36a81e5646,network=Network(68729275-1a5f-4087-a6ca-34c6b674ecfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b5e2297-6a') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:49:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236579212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236579212',id=22,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGMQcHG8oBit3ZUG9qTovtEpNiUBS2ZhjNnojHDQeFgdbWAPBuSR0LSZUYTSmF0zzTn7tLY0Fsf0QF8KnuY50DVRY4YVIZckuRFGNQHAugbtlsN9Zb4BFepLTdj/uAGHQ==',key_name='tempest-keypair-1563763870',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1996f0a97dc84be4906a638ee6e19b19',ramdisk_id='',reservation_id='r-w4whabm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1365843340',owner_user_name='tempest-TaggedBootDevicesTest-1365843340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:49:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d24fc36445c245ff83f65f2a86f4f393',uuid=6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0819cee-25ca-4271-aca3-47125f12360b", "address": "fa:16:3e:87:4b:ea", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0819cee-25", "ovs_interfaceid": "a0819cee-25ca-4271-aca3-47125f12360b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converting VIF {"id": "a0819cee-25ca-4271-aca3-47125f12360b", "address": "fa:16:3e:87:4b:ea", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0819cee-25", "ovs_interfaceid": "a0819cee-25ca-4271-aca3-47125f12360b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:4b:ea,bridge_name='br-int',has_traffic_filtering=True,id=a0819cee-25ca-4271-aca3-47125f12360b,network=Network(cb9f2274-bc37-4057-8256-c812cdb4b262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa0819cee-25') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:49:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236579212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236579212',id=22,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGMQcHG8oBit3ZUG9qTovtEpNiUBS2ZhjNnojHDQeFgdbWAPBuSR0LSZUYTSmF0zzTn7tLY0Fsf0QF8KnuY50DVRY4YVIZckuRFGNQHAugbtlsN9Zb4BFepLTdj/uAGHQ==',key_name='tempest-keypair-1563763870',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1996f0a97dc84be4906a638ee6e19b19',ramdisk_id='',reservation_id='r-w4whabm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1365843340',owner_user_name='tempest-TaggedBootDevicesTest-1365843340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:49:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d24fc36445c245ff83f65f2a86f4f393',uuid=6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36cd0894-4081-4d21-870e-3d635e0ed9c4", "address": "fa:16:3e:24:83:27", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36cd0894-40", "ovs_interfaceid": "36cd0894-4081-4d21-870e-3d635e0ed9c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converting VIF {"id": "36cd0894-4081-4d21-870e-3d635e0ed9c4", "address": "fa:16:3e:24:83:27", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36cd0894-40", "ovs_interfaceid": "36cd0894-4081-4d21-870e-3d635e0ed9c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:83:27,bridge_name='br-int',has_traffic_filtering=True,id=36cd0894-4081-4d21-870e-3d635e0ed9c4,network=Network(cb9f2274-bc37-4057-8256-c812cdb4b262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap36cd0894-40') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:49:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236579212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236579212',id=22,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGMQcHG8oBit3ZUG9qTovtEpNiUBS2ZhjNnojHDQeFgdbWAPBuSR0LSZUYTSmF0zzTn7tLY0Fsf0QF8KnuY50DVRY4YVIZckuRFGNQHAugbtlsN9Zb4BFepLTdj/uAGHQ==',key_name='tempest-keypair-1563763870',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1996f0a97dc84be4906a638ee6e19b19',ramdisk_id='',reservation_id='r-w4whabm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1365843340',owner_user_name='tempest-TaggedBootDevicesTest-1365843340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:49:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d24fc36445c245ff83f65f2a86f4f393',uuid=6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88715119-aa32-4ad2-8c22-8188ee7a1a1f", "address": "fa:16:3e:3d:c8:82", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88715119-aa", "ovs_interfaceid": "88715119-aa32-4ad2-8c22-8188ee7a1a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converting VIF {"id": "88715119-aa32-4ad2-8c22-8188ee7a1a1f", "address": "fa:16:3e:3d:c8:82", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88715119-aa", "ovs_interfaceid": "88715119-aa32-4ad2-8c22-8188ee7a1a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:c8:82,bridge_name='br-int',has_traffic_filtering=True,id=88715119-aa32-4ad2-8c22-8188ee7a1a1f,network=Network(cb9f2274-bc37-4057-8256-c812cdb4b262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88715119-aa') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:49:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236579212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236579212',id=22,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGMQcHG8oBit3ZUG9qTovtEpNiUBS2ZhjNnojHDQeFgdbWAPBuSR0LSZUYTSmF0zzTn7tLY0Fsf0QF8KnuY50DVRY4YVIZckuRFGNQHAugbtlsN9Zb4BFepLTdj/uAGHQ==',key_name='tempest-keypair-1563763870',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1996f0a97dc84be4906a638ee6e19b19',ramdisk_id='',reservation_id='r-w4whabm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1365843340',owner_user_name='tempest-TaggedBootDevicesTest-1365843340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:49:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d24fc36445c245ff83f65f2a86f4f393',uuid=6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab45da29-a935-4aa8-9a10-1793ddbc7ab1", "address": "fa:16:3e:e2:8b:4d", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab45da29-a9", "ovs_interfaceid": "ab45da29-a935-4aa8-9a10-1793ddbc7ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converting VIF {"id": "ab45da29-a935-4aa8-9a10-1793ddbc7ab1", "address": "fa:16:3e:e2:8b:4d", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab45da29-a9", "ovs_interfaceid": "ab45da29-a935-4aa8-9a10-1793ddbc7ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:8b:4d,bridge_name='br-int',has_traffic_filtering=True,id=ab45da29-a935-4aa8-9a10-1793ddbc7ab1,network=Network(cb9f2274-bc37-4057-8256-c812cdb4b262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab45da29-a9') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:49:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236579212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236579212',id=22,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGMQcHG8oBit3ZUG9qTovtEpNiUBS2ZhjNnojHDQeFgdbWAPBuSR0LSZUYTSmF0zzTn7tLY0Fsf0QF8KnuY50DVRY4YVIZckuRFGNQHAugbtlsN9Zb4BFepLTdj/uAGHQ==',key_name='tempest-keypair-1563763870',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1996f0a97dc84be4906a638ee6e19b19',ramdisk_id='',reservation_id='r-w4whabm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1365843340',owner_user_name='tempest-TaggedBootDevicesTest-1365843340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:49:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d24fc36445c245ff83f65f2a86f4f393',uuid=6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b540799-a36a-4b46-a678-53a6db44477a", "address": "fa:16:3e:f0:75:b6", "network": {"id": "0f0a5fa7-1d9d-47a5-9dac-416467b65d29", "bridge": "br-int", "label": "tempest-device-tagging-net2-1543847764", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b540799-a3", "ovs_interfaceid": "4b540799-a36a-4b46-a678-53a6db44477a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converting VIF {"id": "4b540799-a36a-4b46-a678-53a6db44477a", "address": "fa:16:3e:f0:75:b6", "network": {"id": "0f0a5fa7-1d9d-47a5-9dac-416467b65d29", "bridge": "br-int", "label": "tempest-device-tagging-net2-1543847764", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b540799-a3", "ovs_interfaceid": "4b540799-a36a-4b46-a678-53a6db44477a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:75:b6,bridge_name='br-int',has_traffic_filtering=True,id=4b540799-a36a-4b46-a678-53a6db44477a,network=Network(0f0a5fa7-1d9d-47a5-9dac-416467b65d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b540799-a3') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:49:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236579212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236579212',id=22,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGMQcHG8oBit3ZUG9qTovtEpNiUBS2ZhjNnojHDQeFgdbWAPBuSR0LSZUYTSmF0zzTn7tLY0Fsf0QF8KnuY50DVRY4YVIZckuRFGNQHAugbtlsN9Zb4BFepLTdj/uAGHQ==',key_name='tempest-keypair-1563763870',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1996f0a97dc84be4906a638ee6e19b19',ramdisk_id='',reservation_id='r-w4whabm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1365843340',owner_user_name='tempest-TaggedBootDevicesTest-1365843340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:49:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d24fc36445c245ff83f65f2a86f4f393',uuid=6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0290730e-648d-44ba-b03b-53918307a717", "address": "fa:16:3e:9a:c6:30", "network": {"id": "0f0a5fa7-1d9d-47a5-9dac-416467b65d29", "bridge": "br-int", "label": "tempest-device-tagging-net2-1543847764", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0290730e-64", "ovs_interfaceid": "0290730e-648d-44ba-b03b-53918307a717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converting VIF {"id": "0290730e-648d-44ba-b03b-53918307a717", "address": "fa:16:3e:9a:c6:30", "network": {"id": "0f0a5fa7-1d9d-47a5-9dac-416467b65d29", "bridge": "br-int", "label": "tempest-device-tagging-net2-1543847764", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0290730e-64", "ovs_interfaceid": "0290730e-648d-44ba-b03b-53918307a717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:c6:30,bridge_name='br-int',has_traffic_filtering=True,id=0290730e-648d-44ba-b03b-53918307a717,network=Network(0f0a5fa7-1d9d-47a5-9dac-416467b65d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0290730e-64') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.objects.instance [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:49:47 user nova-compute[72444]:   <uuid>6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16</uuid>
Aug 03 04:49:47 user nova-compute[72444]:   <name>instance-00000016</name>
Aug 03 04:49:47 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:49:47 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:49:47 user nova-compute[72444]:   <metadata>
Aug 03 04:49:47 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:49:47 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:49:47 user nova-compute[72444]:       <nova:name>tempest-device-tagging-server-236579212</nova:name>
Aug 03 04:49:47 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:49:43</nova:creationTime>
Aug 03 04:49:47 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:49:47 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:49:47 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:49:47 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:49:47 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:49:47 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:49:47 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:49:47 user nova-compute[72444]:       <nova:owner>
Aug 03 04:49:47 user nova-compute[72444]:         <nova:user uuid="d24fc36445c245ff83f65f2a86f4f393">tempest-TaggedBootDevicesTest-1365843340-project-member</nova:user>
Aug 03 04:49:47 user nova-compute[72444]:         <nova:project uuid="1996f0a97dc84be4906a638ee6e19b19">tempest-TaggedBootDevicesTest-1365843340</nova:project>
Aug 03 04:49:47 user nova-compute[72444]:       </nova:owner>
Aug 03 04:49:47 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:49:47 user nova-compute[72444]:       <nova:ports>
Aug 03 04:49:47 user nova-compute[72444]:         <nova:port uuid="0b5e2297-6ab0-4965-a202-3f36a81e5646">
Aug 03 04:49:47 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 03 04:49:47 user nova-compute[72444]:         </nova:port>
Aug 03 04:49:47 user nova-compute[72444]:         <nova:port uuid="a0819cee-25ca-4271-aca3-47125f12360b">
Aug 03 04:49:47 user nova-compute[72444]:           <nova:ip type="fixed" address="10.1.1.17" ipVersion="4"/>
Aug 03 04:49:47 user nova-compute[72444]:         </nova:port>
Aug 03 04:49:47 user nova-compute[72444]:         <nova:port uuid="36cd0894-4081-4d21-870e-3d635e0ed9c4">
Aug 03 04:49:47 user nova-compute[72444]:           <nova:ip type="fixed" address="10.1.1.177" ipVersion="4"/>
Aug 03 04:49:47 user nova-compute[72444]:         </nova:port>
Aug 03 04:49:47 user nova-compute[72444]:         <nova:port uuid="88715119-aa32-4ad2-8c22-8188ee7a1a1f">
Aug 03 04:49:47 user nova-compute[72444]:           <nova:ip type="fixed" address="10.1.1.62" ipVersion="4"/>
Aug 03 04:49:47 user nova-compute[72444]:         </nova:port>
Aug 03 04:49:47 user nova-compute[72444]:         <nova:port uuid="ab45da29-a935-4aa8-9a10-1793ddbc7ab1">
Aug 03 04:49:47 user nova-compute[72444]:           <nova:ip type="fixed" address="10.1.1.176" ipVersion="4"/>
Aug 03 04:49:47 user nova-compute[72444]:         </nova:port>
Aug 03 04:49:47 user nova-compute[72444]:         <nova:port uuid="4b540799-a36a-4b46-a678-53a6db44477a">
Aug 03 04:49:47 user nova-compute[72444]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 03 04:49:47 user nova-compute[72444]:         </nova:port>
Aug 03 04:49:47 user nova-compute[72444]:         <nova:port uuid="0290730e-648d-44ba-b03b-53918307a717">
Aug 03 04:49:47 user nova-compute[72444]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 03 04:49:47 user nova-compute[72444]:         </nova:port>
Aug 03 04:49:47 user nova-compute[72444]:       </nova:ports>
Aug 03 04:49:47 user nova-compute[72444]:     </nova:instance>
Aug 03 04:49:47 user nova-compute[72444]:   </metadata>
Aug 03 04:49:47 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:49:47 user nova-compute[72444]:     <system>
Aug 03 04:49:47 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:49:47 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:49:47 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:49:47 user nova-compute[72444]:       <entry name="serial">6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16</entry>
Aug 03 04:49:47 user nova-compute[72444]:       <entry name="uuid">6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16</entry>
Aug 03 04:49:47 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:49:47 user nova-compute[72444]:     </system>
Aug 03 04:49:47 user nova-compute[72444]:   </sysinfo>
Aug 03 04:49:47 user nova-compute[72444]:   <os>
Aug 03 04:49:47 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:49:47 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:49:47 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:49:47 user nova-compute[72444]:   </os>
Aug 03 04:49:47 user nova-compute[72444]:   <features>
Aug 03 04:49:47 user nova-compute[72444]:     <acpi/>
Aug 03 04:49:47 user nova-compute[72444]:     <apic/>
Aug 03 04:49:47 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:49:47 user nova-compute[72444]:   </features>
Aug 03 04:49:47 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:49:47 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:49:47 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:49:47 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:49:47 user nova-compute[72444]:   </clock>
Aug 03 04:49:47 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:49:47 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:49:47 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:49:47 user nova-compute[72444]:   </cpu>
Aug 03 04:49:47 user nova-compute[72444]:   <devices>
Aug 03 04:49:47 user nova-compute[72444]:     <disk type="file" device="cdrom">
Aug 03 04:49:47 user nova-compute[72444]:       <driver name="qemu" type="raw" cache="none"/>
Aug 03 04:49:47 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16/disk.config"/>
Aug 03 04:49:47 user nova-compute[72444]:       <target dev="hda" bus="ide"/>
Aug 03 04:49:47 user nova-compute[72444]:     </disk>
Aug 03 04:49:47 user nova-compute[72444]:     <disk type="block" device="disk">
Aug 03 04:49:47 user nova-compute[72444]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:49:47 user nova-compute[72444]:       <source dev="/dev/sdc"/>
Aug 03 04:49:47 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:49:47 user nova-compute[72444]:       <serial>4a7eeea2-85c7-436b-8003-948ca1dbbcab</serial>
Aug 03 04:49:47 user nova-compute[72444]:     </disk>
Aug 03 04:49:47 user nova-compute[72444]:     <disk type="block" device="disk">
Aug 03 04:49:47 user nova-compute[72444]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:49:47 user nova-compute[72444]:       <source dev="/dev/sdd"/>
Aug 03 04:49:47 user nova-compute[72444]:       <target dev="vdb" bus="virtio"/>
Aug 03 04:49:47 user nova-compute[72444]:       <serial>066c7beb-14e3-4f6e-aa2e-90e8f82590f2</serial>
Aug 03 04:49:47 user nova-compute[72444]:     </disk>
Aug 03 04:49:47 user nova-compute[72444]:     <disk type="block" device="disk">
Aug 03 04:49:47 user nova-compute[72444]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:49:47 user nova-compute[72444]:       <source dev="/dev/sde"/>
Aug 03 04:49:47 user nova-compute[72444]:       <target dev="vdc" bus="virtio"/>
Aug 03 04:49:47 user nova-compute[72444]:       <serial>6c6e85ec-1d45-4c13-a173-78e9a9373d39</serial>
Aug 03 04:49:47 user nova-compute[72444]:     </disk>
Aug 03 04:49:47 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:49:47 user nova-compute[72444]:       <mac address="fa:16:3e:2f:06:86"/>
Aug 03 04:49:47 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:49:47 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:49:47 user nova-compute[72444]:       <target dev="tap0b5e2297-6a"/>
Aug 03 04:49:47 user nova-compute[72444]:     </interface>
Aug 03 04:49:47 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:49:47 user nova-compute[72444]:       <mac address="fa:16:3e:87:4b:ea"/>
Aug 03 04:49:47 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:49:47 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:49:47 user nova-compute[72444]:       <target dev="tapa0819cee-25"/>
Aug 03 04:49:47 user nova-compute[72444]:     </interface>
Aug 03 04:49:47 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:49:47 user nova-compute[72444]:       <mac address="fa:16:3e:24:83:27"/>
Aug 03 04:49:47 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:49:47 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:49:47 user nova-compute[72444]:       <target dev="tap36cd0894-40"/>
Aug 03 04:49:47 user nova-compute[72444]:     </interface>
Aug 03 04:49:47 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:49:47 user nova-compute[72444]:       <mac address="fa:16:3e:3d:c8:82"/>
Aug 03 04:49:47 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:49:47 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:49:47 user nova-compute[72444]:       <target dev="tap88715119-aa"/>
Aug 03 04:49:47 user nova-compute[72444]:     </interface>
Aug 03 04:49:47 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:49:47 user nova-compute[72444]:       <mac address="fa:16:3e:e2:8b:4d"/>
Aug 03 04:49:47 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:49:47 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:49:47 user nova-compute[72444]:       <target dev="tapab45da29-a9"/>
Aug 03 04:49:47 user nova-compute[72444]:     </interface>
Aug 03 04:49:47 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:49:47 user nova-compute[72444]:       <mac address="fa:16:3e:f0:75:b6"/>
Aug 03 04:49:47 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:49:47 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:49:47 user nova-compute[72444]:       <target dev="tap4b540799-a3"/>
Aug 03 04:49:47 user nova-compute[72444]:     </interface>
Aug 03 04:49:47 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:49:47 user nova-compute[72444]:       <mac address="fa:16:3e:9a:c6:30"/>
Aug 03 04:49:47 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:49:47 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:49:47 user nova-compute[72444]:       <target dev="tap0290730e-64"/>
Aug 03 04:49:47 user nova-compute[72444]:     </interface>
Aug 03 04:49:47 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:49:47 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16/console.log" append="off"/>
Aug 03 04:49:47 user nova-compute[72444]:     </serial>
Aug 03 04:49:47 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:49:47 user nova-compute[72444]:     <video>
Aug 03 04:49:47 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:49:47 user nova-compute[72444]:     </video>
Aug 03 04:49:47 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:49:47 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:49:47 user nova-compute[72444]:     </rng>
Aug 03 04:49:47 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:49:47 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:49:47 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:49:47 user nova-compute[72444]:     </memballoon>
Aug 03 04:49:47 user nova-compute[72444]:   </devices>
Aug 03 04:49:47 user nova-compute[72444]: </domain>
Aug 03 04:49:47 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:49:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236579212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236579212',id=22,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGMQcHG8oBit3ZUG9qTovtEpNiUBS2ZhjNnojHDQeFgdbWAPBuSR0LSZUYTSmF0zzTn7tLY0Fsf0QF8KnuY50DVRY4YVIZckuRFGNQHAugbtlsN9Zb4BFepLTdj/uAGHQ==',key_name='tempest-keypair-1563763870',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1996f0a97dc84be4906a638ee6e19b19',ramdisk_id='',reservation_id='r-w4whabm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1365843340',owner_user_name='tempest-TaggedBootDevicesTest-1365843340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:49:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d24fc36445c245ff83f65f2a86f4f393',uuid=6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b5e2297-6ab0-4965-a202-3f36a81e5646", "address": "fa:16:3e:2f:06:86", "network": {"id": "68729275-1a5f-4087-a6ca-34c6b674ecfd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-45954298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b5e2297-6a", "ovs_interfaceid": "0b5e2297-6ab0-4965-a202-3f36a81e5646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converting VIF {"id": "0b5e2297-6ab0-4965-a202-3f36a81e5646", "address": "fa:16:3e:2f:06:86", "network": {"id": "68729275-1a5f-4087-a6ca-34c6b674ecfd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-45954298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b5e2297-6a", "ovs_interfaceid": "0b5e2297-6ab0-4965-a202-3f36a81e5646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:06:86,bridge_name='br-int',has_traffic_filtering=True,id=0b5e2297-6ab0-4965-a202-3f36a81e5646,network=Network(68729275-1a5f-4087-a6ca-34c6b674ecfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b5e2297-6a') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG os_vif [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:06:86,bridge_name='br-int',has_traffic_filtering=True,id=0b5e2297-6ab0-4965-a202-3f36a81e5646,network=Network(68729275-1a5f-4087-a6ca-34c6b674ecfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b5e2297-6a') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b5e2297-6a, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0b5e2297-6a, col_values=(('external_ids', {'iface-id': '0b5e2297-6ab0-4965-a202-3f36a81e5646', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:06:86', 'vm-uuid': '6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:47 user nova-compute[72444]: INFO os_vif [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:06:86,bridge_name='br-int',has_traffic_filtering=True,id=0b5e2297-6ab0-4965-a202-3f36a81e5646,network=Network(68729275-1a5f-4087-a6ca-34c6b674ecfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b5e2297-6a')
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:49:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236579212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236579212',id=22,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGMQcHG8oBit3ZUG9qTovtEpNiUBS2ZhjNnojHDQeFgdbWAPBuSR0LSZUYTSmF0zzTn7tLY0Fsf0QF8KnuY50DVRY4YVIZckuRFGNQHAugbtlsN9Zb4BFepLTdj/uAGHQ==',key_name='tempest-keypair-1563763870',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1996f0a97dc84be4906a638ee6e19b19',ramdisk_id='',reservation_id='r-w4whabm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1365843340',owner_user_name='tempest-TaggedBootDevicesTest-1365843340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:49:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d24fc36445c245ff83f65f2a86f4f393',uuid=6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0819cee-25ca-4271-aca3-47125f12360b", "address": "fa:16:3e:87:4b:ea", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0819cee-25", "ovs_interfaceid": "a0819cee-25ca-4271-aca3-47125f12360b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converting VIF {"id": "a0819cee-25ca-4271-aca3-47125f12360b", "address": "fa:16:3e:87:4b:ea", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0819cee-25", "ovs_interfaceid": "a0819cee-25ca-4271-aca3-47125f12360b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:4b:ea,bridge_name='br-int',has_traffic_filtering=True,id=a0819cee-25ca-4271-aca3-47125f12360b,network=Network(cb9f2274-bc37-4057-8256-c812cdb4b262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa0819cee-25') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG os_vif [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:4b:ea,bridge_name='br-int',has_traffic_filtering=True,id=a0819cee-25ca-4271-aca3-47125f12360b,network=Network(cb9f2274-bc37-4057-8256-c812cdb4b262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa0819cee-25') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0819cee-25, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa0819cee-25, col_values=(('external_ids', {'iface-id': 'a0819cee-25ca-4271-aca3-47125f12360b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:4b:ea', 'vm-uuid': '6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:47 user nova-compute[72444]: INFO os_vif [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:4b:ea,bridge_name='br-int',has_traffic_filtering=True,id=a0819cee-25ca-4271-aca3-47125f12360b,network=Network(cb9f2274-bc37-4057-8256-c812cdb4b262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa0819cee-25')
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:49:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236579212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236579212',id=22,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGMQcHG8oBit3ZUG9qTovtEpNiUBS2ZhjNnojHDQeFgdbWAPBuSR0LSZUYTSmF0zzTn7tLY0Fsf0QF8KnuY50DVRY4YVIZckuRFGNQHAugbtlsN9Zb4BFepLTdj/uAGHQ==',key_name='tempest-keypair-1563763870',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1996f0a97dc84be4906a638ee6e19b19',ramdisk_id='',reservation_id='r-w4whabm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1365843340',owner_user_name='tempest-TaggedBootDevicesTest-1365843340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:49:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d24fc36445c245ff83f65f2a86f4f393',uuid=6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36cd0894-4081-4d21-870e-3d635e0ed9c4", "address": "fa:16:3e:24:83:27", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36cd0894-40", "ovs_interfaceid": "36cd0894-4081-4d21-870e-3d635e0ed9c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converting VIF {"id": "36cd0894-4081-4d21-870e-3d635e0ed9c4", "address": "fa:16:3e:24:83:27", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36cd0894-40", "ovs_interfaceid": "36cd0894-4081-4d21-870e-3d635e0ed9c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:83:27,bridge_name='br-int',has_traffic_filtering=True,id=36cd0894-4081-4d21-870e-3d635e0ed9c4,network=Network(cb9f2274-bc37-4057-8256-c812cdb4b262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap36cd0894-40') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG os_vif [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:83:27,bridge_name='br-int',has_traffic_filtering=True,id=36cd0894-4081-4d21-870e-3d635e0ed9c4,network=Network(cb9f2274-bc37-4057-8256-c812cdb4b262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap36cd0894-40') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36cd0894-40, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap36cd0894-40, col_values=(('external_ids', {'iface-id': '36cd0894-4081-4d21-870e-3d635e0ed9c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:83:27', 'vm-uuid': '6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:47 user nova-compute[72444]: INFO os_vif [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:83:27,bridge_name='br-int',has_traffic_filtering=True,id=36cd0894-4081-4d21-870e-3d635e0ed9c4,network=Network(cb9f2274-bc37-4057-8256-c812cdb4b262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap36cd0894-40')
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:49:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236579212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236579212',id=22,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGMQcHG8oBit3ZUG9qTovtEpNiUBS2ZhjNnojHDQeFgdbWAPBuSR0LSZUYTSmF0zzTn7tLY0Fsf0QF8KnuY50DVRY4YVIZckuRFGNQHAugbtlsN9Zb4BFepLTdj/uAGHQ==',key_name='tempest-keypair-1563763870',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1996f0a97dc84be4906a638ee6e19b19',ramdisk_id='',reservation_id='r-w4whabm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1365843340',owner_user_name='tempest-TaggedBootDevicesTest-1365843340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:49:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d24fc36445c245ff83f65f2a86f4f393',uuid=6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88715119-aa32-4ad2-8c22-8188ee7a1a1f", "address": "fa:16:3e:3d:c8:82", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88715119-aa", "ovs_interfaceid": "88715119-aa32-4ad2-8c22-8188ee7a1a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converting VIF {"id": "88715119-aa32-4ad2-8c22-8188ee7a1a1f", "address": "fa:16:3e:3d:c8:82", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88715119-aa", "ovs_interfaceid": "88715119-aa32-4ad2-8c22-8188ee7a1a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:c8:82,bridge_name='br-int',has_traffic_filtering=True,id=88715119-aa32-4ad2-8c22-8188ee7a1a1f,network=Network(cb9f2274-bc37-4057-8256-c812cdb4b262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88715119-aa') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG os_vif [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:c8:82,bridge_name='br-int',has_traffic_filtering=True,id=88715119-aa32-4ad2-8c22-8188ee7a1a1f,network=Network(cb9f2274-bc37-4057-8256-c812cdb4b262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88715119-aa') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88715119-aa, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap88715119-aa, col_values=(('external_ids', {'iface-id': '88715119-aa32-4ad2-8c22-8188ee7a1a1f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:c8:82', 'vm-uuid': '6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:47 user nova-compute[72444]: INFO os_vif [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:c8:82,bridge_name='br-int',has_traffic_filtering=True,id=88715119-aa32-4ad2-8c22-8188ee7a1a1f,network=Network(cb9f2274-bc37-4057-8256-c812cdb4b262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88715119-aa')
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:49:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236579212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236579212',id=22,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGMQcHG8oBit3ZUG9qTovtEpNiUBS2ZhjNnojHDQeFgdbWAPBuSR0LSZUYTSmF0zzTn7tLY0Fsf0QF8KnuY50DVRY4YVIZckuRFGNQHAugbtlsN9Zb4BFepLTdj/uAGHQ==',key_name='tempest-keypair-1563763870',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1996f0a97dc84be4906a638ee6e19b19',ramdisk_id='',reservation_id='r-w4whabm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1365843340',owner_user_name='tempest-TaggedBootDevicesTest-1365843340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:49:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d24fc36445c245ff83f65f2a86f4f393',uuid=6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab45da29-a935-4aa8-9a10-1793ddbc7ab1", "address": "fa:16:3e:e2:8b:4d", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab45da29-a9", "ovs_interfaceid": "ab45da29-a935-4aa8-9a10-1793ddbc7ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converting VIF {"id": "ab45da29-a935-4aa8-9a10-1793ddbc7ab1", "address": "fa:16:3e:e2:8b:4d", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab45da29-a9", "ovs_interfaceid": "ab45da29-a935-4aa8-9a10-1793ddbc7ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:8b:4d,bridge_name='br-int',has_traffic_filtering=True,id=ab45da29-a935-4aa8-9a10-1793ddbc7ab1,network=Network(cb9f2274-bc37-4057-8256-c812cdb4b262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab45da29-a9') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG os_vif [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:8b:4d,bridge_name='br-int',has_traffic_filtering=True,id=ab45da29-a935-4aa8-9a10-1793ddbc7ab1,network=Network(cb9f2274-bc37-4057-8256-c812cdb4b262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab45da29-a9') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab45da29-a9, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapab45da29-a9, col_values=(('external_ids', {'iface-id': 'ab45da29-a935-4aa8-9a10-1793ddbc7ab1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:8b:4d', 'vm-uuid': '6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:47 user nova-compute[72444]: INFO os_vif [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:8b:4d,bridge_name='br-int',has_traffic_filtering=True,id=ab45da29-a935-4aa8-9a10-1793ddbc7ab1,network=Network(cb9f2274-bc37-4057-8256-c812cdb4b262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab45da29-a9')
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:49:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236579212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236579212',id=22,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGMQcHG8oBit3ZUG9qTovtEpNiUBS2ZhjNnojHDQeFgdbWAPBuSR0LSZUYTSmF0zzTn7tLY0Fsf0QF8KnuY50DVRY4YVIZckuRFGNQHAugbtlsN9Zb4BFepLTdj/uAGHQ==',key_name='tempest-keypair-1563763870',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1996f0a97dc84be4906a638ee6e19b19',ramdisk_id='',reservation_id='r-w4whabm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1365843340',owner_user_name='tempest-TaggedBootDevicesTest-1365843340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:49:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d24fc36445c245ff83f65f2a86f4f393',uuid=6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b540799-a36a-4b46-a678-53a6db44477a", "address": "fa:16:3e:f0:75:b6", "network": {"id": "0f0a5fa7-1d9d-47a5-9dac-416467b65d29", "bridge": "br-int", "label": "tempest-device-tagging-net2-1543847764", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b540799-a3", "ovs_interfaceid": "4b540799-a36a-4b46-a678-53a6db44477a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converting VIF {"id": "4b540799-a36a-4b46-a678-53a6db44477a", "address": "fa:16:3e:f0:75:b6", "network": {"id": "0f0a5fa7-1d9d-47a5-9dac-416467b65d29", "bridge": "br-int", "label": "tempest-device-tagging-net2-1543847764", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b540799-a3", "ovs_interfaceid": "4b540799-a36a-4b46-a678-53a6db44477a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:75:b6,bridge_name='br-int',has_traffic_filtering=True,id=4b540799-a36a-4b46-a678-53a6db44477a,network=Network(0f0a5fa7-1d9d-47a5-9dac-416467b65d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b540799-a3') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG os_vif [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:75:b6,bridge_name='br-int',has_traffic_filtering=True,id=4b540799-a36a-4b46-a678-53a6db44477a,network=Network(0f0a5fa7-1d9d-47a5-9dac-416467b65d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b540799-a3') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b540799-a3, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4b540799-a3, col_values=(('external_ids', {'iface-id': '4b540799-a36a-4b46-a678-53a6db44477a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:75:b6', 'vm-uuid': '6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:47 user nova-compute[72444]: INFO os_vif [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:75:b6,bridge_name='br-int',has_traffic_filtering=True,id=4b540799-a36a-4b46-a678-53a6db44477a,network=Network(0f0a5fa7-1d9d-47a5-9dac-416467b65d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b540799-a3')
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:49:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236579212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236579212',id=22,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGMQcHG8oBit3ZUG9qTovtEpNiUBS2ZhjNnojHDQeFgdbWAPBuSR0LSZUYTSmF0zzTn7tLY0Fsf0QF8KnuY50DVRY4YVIZckuRFGNQHAugbtlsN9Zb4BFepLTdj/uAGHQ==',key_name='tempest-keypair-1563763870',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1996f0a97dc84be4906a638ee6e19b19',ramdisk_id='',reservation_id='r-w4whabm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1365843340',owner_user_name='tempest-TaggedBootDevicesTest-1365843340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:49:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d24fc36445c245ff83f65f2a86f4f393',uuid=6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0290730e-648d-44ba-b03b-53918307a717", "address": "fa:16:3e:9a:c6:30", "network": {"id": "0f0a5fa7-1d9d-47a5-9dac-416467b65d29", "bridge": "br-int", "label": "tempest-device-tagging-net2-1543847764", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0290730e-64", "ovs_interfaceid": "0290730e-648d-44ba-b03b-53918307a717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converting VIF {"id": "0290730e-648d-44ba-b03b-53918307a717", "address": "fa:16:3e:9a:c6:30", "network": {"id": "0f0a5fa7-1d9d-47a5-9dac-416467b65d29", "bridge": "br-int", "label": "tempest-device-tagging-net2-1543847764", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0290730e-64", "ovs_interfaceid": "0290730e-648d-44ba-b03b-53918307a717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:c6:30,bridge_name='br-int',has_traffic_filtering=True,id=0290730e-648d-44ba-b03b-53918307a717,network=Network(0f0a5fa7-1d9d-47a5-9dac-416467b65d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0290730e-64') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG os_vif [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:c6:30,bridge_name='br-int',has_traffic_filtering=True,id=0290730e-648d-44ba-b03b-53918307a717,network=Network(0f0a5fa7-1d9d-47a5-9dac-416467b65d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0290730e-64') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0290730e-64, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0290730e-64, col_values=(('external_ids', {'iface-id': '0290730e-648d-44ba-b03b-53918307a717', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:c6:30', 'vm-uuid': '6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:47 user nova-compute[72444]: INFO os_vif [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:c6:30,bridge_name='br-int',has_traffic_filtering=True,id=0290730e-648d-44ba-b03b-53918307a717,network=Network(0f0a5fa7-1d9d-47a5-9dac-416467b65d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0290730e-64')
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] No BDM found with device name hda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] No VIF found with MAC fa:16:3e:2f:06:86, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] No VIF found with MAC fa:16:3e:e2:8b:4d, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:49:47 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Using config drive
Aug 03 04:49:47 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:47 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 04:49:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:48 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Creating config drive at /opt/stack/data/nova/instances/6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16/disk.config
Aug 03 04:49:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp0_vqb1_4 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp0_vqb1_4" returned: 0 in 0.089s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:49 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:49:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d74a02f-7180-4a2b-ac27-14c28d0b1d27/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d74a02f-7180-4a2b-ac27-14c28d0b1d27/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d74a02f-7180-4a2b-ac27-14c28d0b1d27/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d74a02f-7180-4a2b-ac27-14c28d0b1d27/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1baadfd2-6f00-436b-b3a0-c850cd8cb50e/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1baadfd2-6f00-436b-b3a0-c850cd8cb50e/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1baadfd2-6f00-436b-b3a0-c850cd8cb50e/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:50 user nova-compute[72444]: DEBUG nova.compute.manager [req-29bf616e-8bfc-4230-b1ca-c1820e32285c req-8b731207-7ed1-450f-ae99-4585b1881cf9 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-plugged-0b5e2297-6ab0-4965-a202-3f36a81e5646 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:49:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-29bf616e-8bfc-4230-b1ca-c1820e32285c req-8b731207-7ed1-450f-ae99-4585b1881cf9 service nova] Acquiring lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-29bf616e-8bfc-4230-b1ca-c1820e32285c req-8b731207-7ed1-450f-ae99-4585b1881cf9 service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-29bf616e-8bfc-4230-b1ca-c1820e32285c req-8b731207-7ed1-450f-ae99-4585b1881cf9 service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:50 user nova-compute[72444]: DEBUG nova.compute.manager [req-29bf616e-8bfc-4230-b1ca-c1820e32285c req-8b731207-7ed1-450f-ae99-4585b1881cf9 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] No waiting events found dispatching network-vif-plugged-0b5e2297-6ab0-4965-a202-3f36a81e5646 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:49:50 user nova-compute[72444]: WARNING nova.compute.manager [req-29bf616e-8bfc-4230-b1ca-c1820e32285c req-8b731207-7ed1-450f-ae99-4585b1881cf9 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received unexpected event network-vif-plugged-0b5e2297-6ab0-4965-a202-3f36a81e5646 for instance with vm_state building and task_state spawning.
Aug 03 04:49:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1baadfd2-6f00-436b-b3a0-c850cd8cb50e/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:50 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:49:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:50 user nova-compute[72444]: DEBUG nova.compute.manager [req-30d43db8-b797-4689-9900-69fafd099d51 req-aba79f42-ca1b-4260-875f-669bb2c6eff1 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-plugged-36cd0894-4081-4d21-870e-3d635e0ed9c4 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:49:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-30d43db8-b797-4689-9900-69fafd099d51 req-aba79f42-ca1b-4260-875f-669bb2c6eff1 service nova] Acquiring lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-30d43db8-b797-4689-9900-69fafd099d51 req-aba79f42-ca1b-4260-875f-669bb2c6eff1 service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-30d43db8-b797-4689-9900-69fafd099d51 req-aba79f42-ca1b-4260-875f-669bb2c6eff1 service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:50 user nova-compute[72444]: DEBUG nova.compute.manager [req-30d43db8-b797-4689-9900-69fafd099d51 req-aba79f42-ca1b-4260-875f-669bb2c6eff1 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] No waiting events found dispatching network-vif-plugged-36cd0894-4081-4d21-870e-3d635e0ed9c4 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:49:50 user nova-compute[72444]: WARNING nova.compute.manager [req-30d43db8-b797-4689-9900-69fafd099d51 req-aba79f42-ca1b-4260-875f-669bb2c6eff1 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received unexpected event network-vif-plugged-36cd0894-4081-4d21-870e-3d635e0ed9c4 for instance with vm_state building and task_state spawning.
Aug 03 04:49:51 user nova-compute[72444]: DEBUG nova.compute.manager [req-fda1d1a0-60d4-40e5-9f66-ac737a90abf7 req-ad13d83a-dee6-40f5-b305-2b5dd8128bac service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-plugged-88715119-aa32-4ad2-8c22-8188ee7a1a1f {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:49:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-fda1d1a0-60d4-40e5-9f66-ac737a90abf7 req-ad13d83a-dee6-40f5-b305-2b5dd8128bac service nova] Acquiring lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-fda1d1a0-60d4-40e5-9f66-ac737a90abf7 req-ad13d83a-dee6-40f5-b305-2b5dd8128bac service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-fda1d1a0-60d4-40e5-9f66-ac737a90abf7 req-ad13d83a-dee6-40f5-b305-2b5dd8128bac service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:51 user nova-compute[72444]: DEBUG nova.compute.manager [req-fda1d1a0-60d4-40e5-9f66-ac737a90abf7 req-ad13d83a-dee6-40f5-b305-2b5dd8128bac service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] No waiting events found dispatching network-vif-plugged-88715119-aa32-4ad2-8c22-8188ee7a1a1f {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:49:51 user nova-compute[72444]: WARNING nova.compute.manager [req-fda1d1a0-60d4-40e5-9f66-ac737a90abf7 req-ad13d83a-dee6-40f5-b305-2b5dd8128bac service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received unexpected event network-vif-plugged-88715119-aa32-4ad2-8c22-8188ee7a1a1f for instance with vm_state building and task_state spawning.
Aug 03 04:49:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:52 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:49:52 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:49:52 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:49:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:52 user nova-compute[72444]: DEBUG nova.compute.manager [req-8a14994a-ed0f-427a-b47a-8c6d41aea0ed req-3c49338c-f5ad-496e-8036-c81400dcadac service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-plugged-0b5e2297-6ab0-4965-a202-3f36a81e5646 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:49:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8a14994a-ed0f-427a-b47a-8c6d41aea0ed req-3c49338c-f5ad-496e-8036-c81400dcadac service nova] Acquiring lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8a14994a-ed0f-427a-b47a-8c6d41aea0ed req-3c49338c-f5ad-496e-8036-c81400dcadac service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8a14994a-ed0f-427a-b47a-8c6d41aea0ed req-3c49338c-f5ad-496e-8036-c81400dcadac service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:52 user nova-compute[72444]: DEBUG nova.compute.manager [req-8a14994a-ed0f-427a-b47a-8c6d41aea0ed req-3c49338c-f5ad-496e-8036-c81400dcadac service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] No waiting events found dispatching network-vif-plugged-0b5e2297-6ab0-4965-a202-3f36a81e5646 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:49:52 user nova-compute[72444]: WARNING nova.compute.manager [req-8a14994a-ed0f-427a-b47a-8c6d41aea0ed req-3c49338c-f5ad-496e-8036-c81400dcadac service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received unexpected event network-vif-plugged-0b5e2297-6ab0-4965-a202-3f36a81e5646 for instance with vm_state building and task_state spawning.
Aug 03 04:49:52 user nova-compute[72444]: DEBUG nova.compute.manager [req-8a14994a-ed0f-427a-b47a-8c6d41aea0ed req-3c49338c-f5ad-496e-8036-c81400dcadac service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-plugged-a0819cee-25ca-4271-aca3-47125f12360b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:49:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8a14994a-ed0f-427a-b47a-8c6d41aea0ed req-3c49338c-f5ad-496e-8036-c81400dcadac service nova] Acquiring lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8a14994a-ed0f-427a-b47a-8c6d41aea0ed req-3c49338c-f5ad-496e-8036-c81400dcadac service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8a14994a-ed0f-427a-b47a-8c6d41aea0ed req-3c49338c-f5ad-496e-8036-c81400dcadac service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:52 user nova-compute[72444]: DEBUG nova.compute.manager [req-8a14994a-ed0f-427a-b47a-8c6d41aea0ed req-3c49338c-f5ad-496e-8036-c81400dcadac service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] No waiting events found dispatching network-vif-plugged-a0819cee-25ca-4271-aca3-47125f12360b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:49:52 user nova-compute[72444]: WARNING nova.compute.manager [req-8a14994a-ed0f-427a-b47a-8c6d41aea0ed req-3c49338c-f5ad-496e-8036-c81400dcadac service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received unexpected event network-vif-plugged-a0819cee-25ca-4271-aca3-47125f12360b for instance with vm_state building and task_state spawning.
Aug 03 04:49:52 user nova-compute[72444]: DEBUG nova.compute.manager [req-8a14994a-ed0f-427a-b47a-8c6d41aea0ed req-3c49338c-f5ad-496e-8036-c81400dcadac service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-plugged-a0819cee-25ca-4271-aca3-47125f12360b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:49:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8a14994a-ed0f-427a-b47a-8c6d41aea0ed req-3c49338c-f5ad-496e-8036-c81400dcadac service nova] Acquiring lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8a14994a-ed0f-427a-b47a-8c6d41aea0ed req-3c49338c-f5ad-496e-8036-c81400dcadac service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8a14994a-ed0f-427a-b47a-8c6d41aea0ed req-3c49338c-f5ad-496e-8036-c81400dcadac service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:52 user nova-compute[72444]: DEBUG nova.compute.manager [req-8a14994a-ed0f-427a-b47a-8c6d41aea0ed req-3c49338c-f5ad-496e-8036-c81400dcadac service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] No waiting events found dispatching network-vif-plugged-a0819cee-25ca-4271-aca3-47125f12360b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:49:52 user nova-compute[72444]: WARNING nova.compute.manager [req-8a14994a-ed0f-427a-b47a-8c6d41aea0ed req-3c49338c-f5ad-496e-8036-c81400dcadac service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received unexpected event network-vif-plugged-a0819cee-25ca-4271-aca3-47125f12360b for instance with vm_state building and task_state spawning.
Aug 03 04:49:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26922d3f-0a2d-48d1-b758-9c87e0621fef/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26922d3f-0a2d-48d1-b758-9c87e0621fef/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26922d3f-0a2d-48d1-b758-9c87e0621fef/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26922d3f-0a2d-48d1-b758-9c87e0621fef/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc1913f1-dc7d-40ef-9ab4-83e295135f30/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG nova.compute.manager [req-b9d26a39-4b0e-41fb-9a25-5e65f47654de req-3865cb94-28cf-4e4a-abf4-e87aaf7e6119 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-plugged-36cd0894-4081-4d21-870e-3d635e0ed9c4 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b9d26a39-4b0e-41fb-9a25-5e65f47654de req-3865cb94-28cf-4e4a-abf4-e87aaf7e6119 service nova] Acquiring lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b9d26a39-4b0e-41fb-9a25-5e65f47654de req-3865cb94-28cf-4e4a-abf4-e87aaf7e6119 service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b9d26a39-4b0e-41fb-9a25-5e65f47654de req-3865cb94-28cf-4e4a-abf4-e87aaf7e6119 service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG nova.compute.manager [req-b9d26a39-4b0e-41fb-9a25-5e65f47654de req-3865cb94-28cf-4e4a-abf4-e87aaf7e6119 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] No waiting events found dispatching network-vif-plugged-36cd0894-4081-4d21-870e-3d635e0ed9c4 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:49:53 user nova-compute[72444]: WARNING nova.compute.manager [req-b9d26a39-4b0e-41fb-9a25-5e65f47654de req-3865cb94-28cf-4e4a-abf4-e87aaf7e6119 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received unexpected event network-vif-plugged-36cd0894-4081-4d21-870e-3d635e0ed9c4 for instance with vm_state building and task_state spawning.
Aug 03 04:49:53 user nova-compute[72444]: DEBUG nova.compute.manager [req-b9d26a39-4b0e-41fb-9a25-5e65f47654de req-3865cb94-28cf-4e4a-abf4-e87aaf7e6119 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-plugged-4b540799-a36a-4b46-a678-53a6db44477a {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b9d26a39-4b0e-41fb-9a25-5e65f47654de req-3865cb94-28cf-4e4a-abf4-e87aaf7e6119 service nova] Acquiring lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b9d26a39-4b0e-41fb-9a25-5e65f47654de req-3865cb94-28cf-4e4a-abf4-e87aaf7e6119 service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b9d26a39-4b0e-41fb-9a25-5e65f47654de req-3865cb94-28cf-4e4a-abf4-e87aaf7e6119 service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG nova.compute.manager [req-b9d26a39-4b0e-41fb-9a25-5e65f47654de req-3865cb94-28cf-4e4a-abf4-e87aaf7e6119 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] No waiting events found dispatching network-vif-plugged-4b540799-a36a-4b46-a678-53a6db44477a {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:49:53 user nova-compute[72444]: WARNING nova.compute.manager [req-b9d26a39-4b0e-41fb-9a25-5e65f47654de req-3865cb94-28cf-4e4a-abf4-e87aaf7e6119 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received unexpected event network-vif-plugged-4b540799-a36a-4b46-a678-53a6db44477a for instance with vm_state building and task_state spawning.
Aug 03 04:49:53 user nova-compute[72444]: DEBUG nova.compute.manager [req-b9d26a39-4b0e-41fb-9a25-5e65f47654de req-3865cb94-28cf-4e4a-abf4-e87aaf7e6119 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-plugged-4b540799-a36a-4b46-a678-53a6db44477a {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b9d26a39-4b0e-41fb-9a25-5e65f47654de req-3865cb94-28cf-4e4a-abf4-e87aaf7e6119 service nova] Acquiring lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b9d26a39-4b0e-41fb-9a25-5e65f47654de req-3865cb94-28cf-4e4a-abf4-e87aaf7e6119 service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b9d26a39-4b0e-41fb-9a25-5e65f47654de req-3865cb94-28cf-4e4a-abf4-e87aaf7e6119 service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG nova.compute.manager [req-b9d26a39-4b0e-41fb-9a25-5e65f47654de req-3865cb94-28cf-4e4a-abf4-e87aaf7e6119 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] No waiting events found dispatching network-vif-plugged-4b540799-a36a-4b46-a678-53a6db44477a {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:49:53 user nova-compute[72444]: WARNING nova.compute.manager [req-b9d26a39-4b0e-41fb-9a25-5e65f47654de req-3865cb94-28cf-4e4a-abf4-e87aaf7e6119 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received unexpected event network-vif-plugged-4b540799-a36a-4b46-a678-53a6db44477a for instance with vm_state building and task_state spawning.
Aug 03 04:49:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc1913f1-dc7d-40ef-9ab4-83e295135f30/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc1913f1-dc7d-40ef-9ab4-83e295135f30/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG nova.compute.manager [req-0712ea1d-a80a-409b-a530-fff73fc7c0b3 req-4756af10-0924-4c8c-9c80-617abcc68a9b service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-plugged-88715119-aa32-4ad2-8c22-8188ee7a1a1f {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0712ea1d-a80a-409b-a530-fff73fc7c0b3 req-4756af10-0924-4c8c-9c80-617abcc68a9b service nova] Acquiring lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0712ea1d-a80a-409b-a530-fff73fc7c0b3 req-4756af10-0924-4c8c-9c80-617abcc68a9b service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0712ea1d-a80a-409b-a530-fff73fc7c0b3 req-4756af10-0924-4c8c-9c80-617abcc68a9b service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG nova.compute.manager [req-0712ea1d-a80a-409b-a530-fff73fc7c0b3 req-4756af10-0924-4c8c-9c80-617abcc68a9b service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] No waiting events found dispatching network-vif-plugged-88715119-aa32-4ad2-8c22-8188ee7a1a1f {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:49:53 user nova-compute[72444]: WARNING nova.compute.manager [req-0712ea1d-a80a-409b-a530-fff73fc7c0b3 req-4756af10-0924-4c8c-9c80-617abcc68a9b service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received unexpected event network-vif-plugged-88715119-aa32-4ad2-8c22-8188ee7a1a1f for instance with vm_state building and task_state spawning.
Aug 03 04:49:53 user nova-compute[72444]: DEBUG nova.compute.manager [req-0712ea1d-a80a-409b-a530-fff73fc7c0b3 req-4756af10-0924-4c8c-9c80-617abcc68a9b service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-plugged-ab45da29-a935-4aa8-9a10-1793ddbc7ab1 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0712ea1d-a80a-409b-a530-fff73fc7c0b3 req-4756af10-0924-4c8c-9c80-617abcc68a9b service nova] Acquiring lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0712ea1d-a80a-409b-a530-fff73fc7c0b3 req-4756af10-0924-4c8c-9c80-617abcc68a9b service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0712ea1d-a80a-409b-a530-fff73fc7c0b3 req-4756af10-0924-4c8c-9c80-617abcc68a9b service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG nova.compute.manager [req-0712ea1d-a80a-409b-a530-fff73fc7c0b3 req-4756af10-0924-4c8c-9c80-617abcc68a9b service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] No waiting events found dispatching network-vif-plugged-ab45da29-a935-4aa8-9a10-1793ddbc7ab1 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:49:53 user nova-compute[72444]: WARNING nova.compute.manager [req-0712ea1d-a80a-409b-a530-fff73fc7c0b3 req-4756af10-0924-4c8c-9c80-617abcc68a9b service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received unexpected event network-vif-plugged-ab45da29-a935-4aa8-9a10-1793ddbc7ab1 for instance with vm_state building and task_state spawning.
Aug 03 04:49:53 user nova-compute[72444]: DEBUG nova.compute.manager [req-0712ea1d-a80a-409b-a530-fff73fc7c0b3 req-4756af10-0924-4c8c-9c80-617abcc68a9b service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-plugged-ab45da29-a935-4aa8-9a10-1793ddbc7ab1 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0712ea1d-a80a-409b-a530-fff73fc7c0b3 req-4756af10-0924-4c8c-9c80-617abcc68a9b service nova] Acquiring lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0712ea1d-a80a-409b-a530-fff73fc7c0b3 req-4756af10-0924-4c8c-9c80-617abcc68a9b service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0712ea1d-a80a-409b-a530-fff73fc7c0b3 req-4756af10-0924-4c8c-9c80-617abcc68a9b service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG nova.compute.manager [req-0712ea1d-a80a-409b-a530-fff73fc7c0b3 req-4756af10-0924-4c8c-9c80-617abcc68a9b service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] No waiting events found dispatching network-vif-plugged-ab45da29-a935-4aa8-9a10-1793ddbc7ab1 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:49:53 user nova-compute[72444]: WARNING nova.compute.manager [req-0712ea1d-a80a-409b-a530-fff73fc7c0b3 req-4756af10-0924-4c8c-9c80-617abcc68a9b service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received unexpected event network-vif-plugged-ab45da29-a935-4aa8-9a10-1793ddbc7ab1 for instance with vm_state building and task_state spawning.
Aug 03 04:49:53 user nova-compute[72444]: DEBUG nova.compute.manager [req-0712ea1d-a80a-409b-a530-fff73fc7c0b3 req-4756af10-0924-4c8c-9c80-617abcc68a9b service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-plugged-0290730e-648d-44ba-b03b-53918307a717 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0712ea1d-a80a-409b-a530-fff73fc7c0b3 req-4756af10-0924-4c8c-9c80-617abcc68a9b service nova] Acquiring lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0712ea1d-a80a-409b-a530-fff73fc7c0b3 req-4756af10-0924-4c8c-9c80-617abcc68a9b service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0712ea1d-a80a-409b-a530-fff73fc7c0b3 req-4756af10-0924-4c8c-9c80-617abcc68a9b service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG nova.compute.manager [req-0712ea1d-a80a-409b-a530-fff73fc7c0b3 req-4756af10-0924-4c8c-9c80-617abcc68a9b service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] No waiting events found dispatching network-vif-plugged-0290730e-648d-44ba-b03b-53918307a717 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:49:53 user nova-compute[72444]: WARNING nova.compute.manager [req-0712ea1d-a80a-409b-a530-fff73fc7c0b3 req-4756af10-0924-4c8c-9c80-617abcc68a9b service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received unexpected event network-vif-plugged-0290730e-648d-44ba-b03b-53918307a717 for instance with vm_state building and task_state spawning.
Aug 03 04:49:53 user nova-compute[72444]: DEBUG nova.compute.manager [req-0712ea1d-a80a-409b-a530-fff73fc7c0b3 req-4756af10-0924-4c8c-9c80-617abcc68a9b service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-plugged-0290730e-648d-44ba-b03b-53918307a717 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0712ea1d-a80a-409b-a530-fff73fc7c0b3 req-4756af10-0924-4c8c-9c80-617abcc68a9b service nova] Acquiring lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0712ea1d-a80a-409b-a530-fff73fc7c0b3 req-4756af10-0924-4c8c-9c80-617abcc68a9b service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0712ea1d-a80a-409b-a530-fff73fc7c0b3 req-4756af10-0924-4c8c-9c80-617abcc68a9b service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG nova.compute.manager [req-0712ea1d-a80a-409b-a530-fff73fc7c0b3 req-4756af10-0924-4c8c-9c80-617abcc68a9b service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] No waiting events found dispatching network-vif-plugged-0290730e-648d-44ba-b03b-53918307a717 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:49:53 user nova-compute[72444]: WARNING nova.compute.manager [req-0712ea1d-a80a-409b-a530-fff73fc7c0b3 req-4756af10-0924-4c8c-9c80-617abcc68a9b service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received unexpected event network-vif-plugged-0290730e-648d-44ba-b03b-53918307a717 for instance with vm_state building and task_state spawning.
Aug 03 04:49:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc1913f1-dc7d-40ef-9ab4-83e295135f30/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:54 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038194.173177, 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:49:54 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] VM Resumed (Lifecycle Event)
Aug 03 04:49:54 user nova-compute[72444]: DEBUG nova.compute.manager [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:49:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 04:49:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:54 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:49:54 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:49:54 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=7071MB free_disk=25.514232635498047GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 04:49:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:54 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:49:54 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Instance spawned successfully.
Aug 03 04:49:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 04:49:54 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:49:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:49:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:49:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:49:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:49:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:49:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:49:54 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:49:54 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038194.174859, 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:49:54 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] VM Started (Lifecycle Event)
Aug 03 04:49:54 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:49:54 user nova-compute[72444]: INFO nova.compute.manager [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Took 11.30 seconds to spawn the instance on the hypervisor.
Aug 03 04:49:54 user nova-compute[72444]: DEBUG nova.compute.manager [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:49:54 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:49:54 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:49:54 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:49:54 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 81725845-6158-4e34-bedb-6e41219bc227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:49:54 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance b6ed9c42-fa6e-4a0d-8312-588471e157f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:49:54 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance e2859322-6f99-442d-bee1-65fe49ce6360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:49:54 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:49:54 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:49:54 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 26922d3f-0a2d-48d1-b758-9c87e0621fef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:49:54 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 1baadfd2-6f00-436b-b3a0-c850cd8cb50e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:49:54 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 2d74a02f-7180-4a2b-ac27-14c28d0b1d27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:49:54 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance bc1913f1-dc7d-40ef-9ab4-83e295135f30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:49:54 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:49:54 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 0b219bf3-a3b6-44b5-946e-c10e7498e1d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:49:54 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance c77e96da-6411-4ae9-af05-8e9bb3c432c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:49:54 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 04:49:54 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 04:49:54 user nova-compute[72444]: INFO nova.compute.manager [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Took 40.01 seconds to build instance.
Aug 03 04:49:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9dd98bd3-2ed2-4795-9a71-32de95f8beb5 tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 40.111s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:54 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:49:55 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:49:55 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 04:49:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.801s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-52dfcd37-1e38-4e4b-844b-e1d55d2d3e25 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Acquiring lock "2d74a02f-7180-4a2b-ac27-14c28d0b1d27" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-52dfcd37-1e38-4e4b-844b-e1d55d2d3e25 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "2d74a02f-7180-4a2b-ac27-14c28d0b1d27" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-52dfcd37-1e38-4e4b-844b-e1d55d2d3e25 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Acquiring lock "2d74a02f-7180-4a2b-ac27-14c28d0b1d27-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-52dfcd37-1e38-4e4b-844b-e1d55d2d3e25 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "2d74a02f-7180-4a2b-ac27-14c28d0b1d27-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-52dfcd37-1e38-4e4b-844b-e1d55d2d3e25 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "2d74a02f-7180-4a2b-ac27-14c28d0b1d27-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:55 user nova-compute[72444]: INFO nova.compute.manager [None req-52dfcd37-1e38-4e4b-844b-e1d55d2d3e25 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Terminating instance
Aug 03 04:49:55 user nova-compute[72444]: DEBUG nova.compute.manager [None req-52dfcd37-1e38-4e4b-844b-e1d55d2d3e25 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 04:49:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:55 user nova-compute[72444]: DEBUG nova.compute.manager [req-93558837-1bfc-4187-a5ab-e382ad15040a req-9ec67097-cf8e-4501-b4b9-573ab376ba98 service nova] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Received event network-vif-unplugged-12b5d245-d368-4a11-ad0f-29bb48dc743c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:49:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-93558837-1bfc-4187-a5ab-e382ad15040a req-9ec67097-cf8e-4501-b4b9-573ab376ba98 service nova] Acquiring lock "2d74a02f-7180-4a2b-ac27-14c28d0b1d27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-93558837-1bfc-4187-a5ab-e382ad15040a req-9ec67097-cf8e-4501-b4b9-573ab376ba98 service nova] Lock "2d74a02f-7180-4a2b-ac27-14c28d0b1d27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-93558837-1bfc-4187-a5ab-e382ad15040a req-9ec67097-cf8e-4501-b4b9-573ab376ba98 service nova] Lock "2d74a02f-7180-4a2b-ac27-14c28d0b1d27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:55 user nova-compute[72444]: DEBUG nova.compute.manager [req-93558837-1bfc-4187-a5ab-e382ad15040a req-9ec67097-cf8e-4501-b4b9-573ab376ba98 service nova] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] No waiting events found dispatching network-vif-unplugged-12b5d245-d368-4a11-ad0f-29bb48dc743c {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:49:55 user nova-compute[72444]: DEBUG nova.compute.manager [req-93558837-1bfc-4187-a5ab-e382ad15040a req-9ec67097-cf8e-4501-b4b9-573ab376ba98 service nova] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Received event network-vif-unplugged-12b5d245-d368-4a11-ad0f-29bb48dc743c for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:49:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:55 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Instance destroyed successfully.
Aug 03 04:49:55 user nova-compute[72444]: DEBUG nova.objects.instance [None req-52dfcd37-1e38-4e4b-844b-e1d55d2d3e25 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lazy-loading 'resources' on Instance uuid 2d74a02f-7180-4a2b-ac27-14c28d0b1d27 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:49:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-52dfcd37-1e38-4e4b-844b-e1d55d2d3e25 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:47:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1369067319',display_name='tempest-VolumesAdminNegativeTest-server-1369067319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1369067319',id=20,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:47:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ccbd62645f54327a2b8999dcd9736ce',ramdisk_id='',reservation_id='r-1utgk7kb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1069854833',owner_user_name='tempest-VolumesAdminNegativeTest-1069854833-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:47:59Z,user_data=None,user_id='4d998191ef0943ed95ba213e84d87bdc',uuid=2d74a02f-7180-4a2b-ac27-14c28d0b1d27,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12b5d245-d368-4a11-ad0f-29bb48dc743c", "address": "fa:16:3e:52:1b:c5", "network": {"id": "dc891e23-2b3b-44ae-8110-60fe01fe5e24", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1956899419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ccbd62645f54327a2b8999dcd9736ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12b5d245-d3", "ovs_interfaceid": "12b5d245-d368-4a11-ad0f-29bb48dc743c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:49:55 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-52dfcd37-1e38-4e4b-844b-e1d55d2d3e25 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Converting VIF {"id": "12b5d245-d368-4a11-ad0f-29bb48dc743c", "address": "fa:16:3e:52:1b:c5", "network": {"id": "dc891e23-2b3b-44ae-8110-60fe01fe5e24", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1956899419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ccbd62645f54327a2b8999dcd9736ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12b5d245-d3", "ovs_interfaceid": "12b5d245-d368-4a11-ad0f-29bb48dc743c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:49:55 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-52dfcd37-1e38-4e4b-844b-e1d55d2d3e25 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:1b:c5,bridge_name='br-int',has_traffic_filtering=True,id=12b5d245-d368-4a11-ad0f-29bb48dc743c,network=Network(dc891e23-2b3b-44ae-8110-60fe01fe5e24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12b5d245-d3') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:49:55 user nova-compute[72444]: DEBUG os_vif [None req-52dfcd37-1e38-4e4b-844b-e1d55d2d3e25 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:1b:c5,bridge_name='br-int',has_traffic_filtering=True,id=12b5d245-d368-4a11-ad0f-29bb48dc743c,network=Network(dc891e23-2b3b-44ae-8110-60fe01fe5e24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12b5d245-d3') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:49:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap12b5d245-d3, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:49:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:55 user nova-compute[72444]: INFO os_vif [None req-52dfcd37-1e38-4e4b-844b-e1d55d2d3e25 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:1b:c5,bridge_name='br-int',has_traffic_filtering=True,id=12b5d245-d368-4a11-ad0f-29bb48dc743c,network=Network(dc891e23-2b3b-44ae-8110-60fe01fe5e24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12b5d245-d3')
Aug 03 04:49:55 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-52dfcd37-1e38-4e4b-844b-e1d55d2d3e25 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Deleting instance files /opt/stack/data/nova/instances/2d74a02f-7180-4a2b-ac27-14c28d0b1d27_del
Aug 03 04:49:55 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-52dfcd37-1e38-4e4b-844b-e1d55d2d3e25 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Deletion of /opt/stack/data/nova/instances/2d74a02f-7180-4a2b-ac27-14c28d0b1d27_del complete
Aug 03 04:49:55 user nova-compute[72444]: INFO nova.compute.manager [None req-52dfcd37-1e38-4e4b-844b-e1d55d2d3e25 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Took 0.69 seconds to destroy the instance on the hypervisor.
Aug 03 04:49:55 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-52dfcd37-1e38-4e4b-844b-e1d55d2d3e25 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 04:49:55 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 04:49:55 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 04:49:56 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:49:56 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Took 0.86 seconds to deallocate network for instance.
Aug 03 04:49:56 user nova-compute[72444]: DEBUG nova.compute.manager [req-b9a77253-88b9-40c8-add5-ff24c4a30059 req-8277442d-795d-48a2-8446-c369a1d7d9ab service nova] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Received event network-vif-deleted-12b5d245-d368-4a11-ad0f-29bb48dc743c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:49:56 user nova-compute[72444]: INFO nova.compute.manager [req-b9a77253-88b9-40c8-add5-ff24c4a30059 req-8277442d-795d-48a2-8446-c369a1d7d9ab service nova] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Neutron deleted interface 12b5d245-d368-4a11-ad0f-29bb48dc743c; detaching it from the instance and deleting it from the info cache
Aug 03 04:49:56 user nova-compute[72444]: DEBUG nova.network.neutron [req-b9a77253-88b9-40c8-add5-ff24c4a30059 req-8277442d-795d-48a2-8446-c369a1d7d9ab service nova] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:49:56 user nova-compute[72444]: DEBUG nova.compute.manager [req-b9a77253-88b9-40c8-add5-ff24c4a30059 req-8277442d-795d-48a2-8446-c369a1d7d9ab service nova] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Detach interface failed, port_id=12b5d245-d368-4a11-ad0f-29bb48dc743c, reason: Instance 2d74a02f-7180-4a2b-ac27-14c28d0b1d27 could not be found. {{(pid=72444) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 03 04:49:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-52dfcd37-1e38-4e4b-844b-e1d55d2d3e25 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-52dfcd37-1e38-4e4b-844b-e1d55d2d3e25 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "c4af22f7-45f8-4777-83ee-5cf1481c9fe8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "c4af22f7-45f8-4777-83ee-5cf1481c9fe8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:57 user nova-compute[72444]: DEBUG nova.compute.manager [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 04:49:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:57 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-52dfcd37-1e38-4e4b-844b-e1d55d2d3e25 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:49:57 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-52dfcd37-1e38-4e4b-844b-e1d55d2d3e25 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:49:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-52dfcd37-1e38-4e4b-844b-e1d55d2d3e25 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.466s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.130s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:57 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 04:49:57 user nova-compute[72444]: INFO nova.compute.claims [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Claim successful on node user
Aug 03 04:49:57 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-52dfcd37-1e38-4e4b-844b-e1d55d2d3e25 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Deleted allocations for instance 2d74a02f-7180-4a2b-ac27-14c28d0b1d27
Aug 03 04:49:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-52dfcd37-1e38-4e4b-844b-e1d55d2d3e25 tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "2d74a02f-7180-4a2b-ac27-14c28d0b1d27" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.316s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:57 user nova-compute[72444]: DEBUG nova.compute.manager [req-73d3bcf9-e3a0-46e5-97e9-44ca9fb45708 req-1448feb3-d7f6-4e36-b9da-60171c7675a9 service nova] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Received event network-vif-plugged-12b5d245-d368-4a11-ad0f-29bb48dc743c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:49:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-73d3bcf9-e3a0-46e5-97e9-44ca9fb45708 req-1448feb3-d7f6-4e36-b9da-60171c7675a9 service nova] Acquiring lock "2d74a02f-7180-4a2b-ac27-14c28d0b1d27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:49:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-73d3bcf9-e3a0-46e5-97e9-44ca9fb45708 req-1448feb3-d7f6-4e36-b9da-60171c7675a9 service nova] Lock "2d74a02f-7180-4a2b-ac27-14c28d0b1d27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:49:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-73d3bcf9-e3a0-46e5-97e9-44ca9fb45708 req-1448feb3-d7f6-4e36-b9da-60171c7675a9 service nova] Lock "2d74a02f-7180-4a2b-ac27-14c28d0b1d27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:57 user nova-compute[72444]: DEBUG nova.compute.manager [req-73d3bcf9-e3a0-46e5-97e9-44ca9fb45708 req-1448feb3-d7f6-4e36-b9da-60171c7675a9 service nova] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] No waiting events found dispatching network-vif-plugged-12b5d245-d368-4a11-ad0f-29bb48dc743c {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:49:57 user nova-compute[72444]: WARNING nova.compute.manager [req-73d3bcf9-e3a0-46e5-97e9-44ca9fb45708 req-1448feb3-d7f6-4e36-b9da-60171c7675a9 service nova] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Received unexpected event network-vif-plugged-12b5d245-d368-4a11-ad0f-29bb48dc743c for instance with vm_state deleted and task_state None.
Aug 03 04:49:57 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691038182.8280532, e3089887-56df-42de-bc62-88e6db28daf0 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:49:57 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: e3089887-56df-42de-bc62-88e6db28daf0] VM Stopped (Lifecycle Event)
Aug 03 04:49:57 user nova-compute[72444]: DEBUG nova.compute.manager [None req-965df9ec-00a8-4e76-bb3d-e367596f995b None None] [instance: e3089887-56df-42de-bc62-88e6db28daf0] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:49:57 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:49:57 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:49:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.596s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:49:57 user nova-compute[72444]: DEBUG nova.compute.manager [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 04:49:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 04:49:58 user nova-compute[72444]: DEBUG nova.network.neutron [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 04:49:58 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 04:49:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 04:49:58 user nova-compute[72444]: DEBUG nova.policy [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7120445361dc4363b4cc6c7671a2716e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d17468ddd64dfabba3a2c7b6df71ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 04:49:58 user nova-compute[72444]: INFO nova.virt.block_device [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Booting with volume a14d792b-d953-43f8-8af2-c2ac8f765b86 at /dev/vda
Aug 03 04:49:58 user nova-compute[72444]: DEBUG os_brick.utils [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:49:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:58 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[182602e0-5b8f-4b2d-bc5b-40e7befcf94a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:58 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[53105fde-3b74-455b-981a-c29cb98a860b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:49:58 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c345c77-dd7c-40ff-897d-b6036e2288b3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:58 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[106ef7e8-a623-4606-8e40-88916b88aa60]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:49:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 04:49:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:49:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:49:58 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 04:49:58 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[507ed28f-dcea-494f-86ea-f96efb9d8519]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:49:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 04:49:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 04:49:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 04:49:58 user nova-compute[72444]: DEBUG os_brick.utils [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:49:58 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Updating existing volume attachment record: d20e32a5-7bec-4a04-aaa3-4c216971ee17 {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 04:49:58 user nova-compute[72444]: DEBUG nova.network.neutron [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Successfully created port: 73526f5e-c0da-4686-b2ab-e3859a2d6c85 {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:49:59 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:49:59 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 04:49:59 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Rebuilding the list of instances to heal {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 04:49:59 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Skipping network cache update for instance because it is Building. {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 03 04:49:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:49:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:49:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:49:59 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 04:49:59 user nova-compute[72444]: DEBUG nova.objects.instance [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lazy-loading 'info_cache' on Instance uuid 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:49:59 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Updating instance_info_cache with network_info: [{"id": "d0cfd0c0-ac67-4335-85d2-6f0b956fae5b", "address": "fa:16:3e:e0:f6:85", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cfd0c0-ac", "ovs_interfaceid": "d0cfd0c0-ac67-4335-85d2-6f0b956fae5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:49:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:49:59 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 04:50:00 user nova-compute[72444]: DEBUG nova.network.neutron [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Successfully updated port: 73526f5e-c0da-4686-b2ab-e3859a2d6c85 {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:50:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "refresh_cache-c4af22f7-45f8-4777-83ee-5cf1481c9fe8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:50:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquired lock "refresh_cache-c4af22f7-45f8-4777-83ee-5cf1481c9fe8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:50:00 user nova-compute[72444]: DEBUG nova.network.neutron [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:50:00 user nova-compute[72444]: DEBUG nova.compute.manager [req-5ead2eff-7ea0-4153-9610-e789b78eb075 req-51ada4c8-34be-4279-8d96-e700bfece5dd service nova] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Received event network-changed-73526f5e-c0da-4686-b2ab-e3859a2d6c85 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:50:00 user nova-compute[72444]: DEBUG nova.compute.manager [req-5ead2eff-7ea0-4153-9610-e789b78eb075 req-51ada4c8-34be-4279-8d96-e700bfece5dd service nova] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Refreshing instance network info cache due to event network-changed-73526f5e-c0da-4686-b2ab-e3859a2d6c85. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:50:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5ead2eff-7ea0-4153-9610-e789b78eb075 req-51ada4c8-34be-4279-8d96-e700bfece5dd service nova] Acquiring lock "refresh_cache-c4af22f7-45f8-4777-83ee-5cf1481c9fe8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:50:00 user nova-compute[72444]: DEBUG nova.network.neutron [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:50:00 user nova-compute[72444]: DEBUG nova.network.neutron [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Updating instance_info_cache with network_info: [{"id": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "address": "fa:16:3e:5e:64:b2", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73526f5e-c0", "ovs_interfaceid": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:50:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Releasing lock "refresh_cache-c4af22f7-45f8-4777-83ee-5cf1481c9fe8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:50:00 user nova-compute[72444]: DEBUG nova.compute.manager [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Instance network_info: |[{"id": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "address": "fa:16:3e:5e:64:b2", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73526f5e-c0", "ovs_interfaceid": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 04:50:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5ead2eff-7ea0-4153-9610-e789b78eb075 req-51ada4c8-34be-4279-8d96-e700bfece5dd service nova] Acquired lock "refresh_cache-c4af22f7-45f8-4777-83ee-5cf1481c9fe8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:50:00 user nova-compute[72444]: DEBUG nova.network.neutron [req-5ead2eff-7ea0-4153-9610-e789b78eb075 req-51ada4c8-34be-4279-8d96-e700bfece5dd service nova] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Refreshing network info cache for port 73526f5e-c0da-4686-b2ab-e3859a2d6c85 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:50:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:01 user nova-compute[72444]: DEBUG nova.network.neutron [req-5ead2eff-7ea0-4153-9610-e789b78eb075 req-51ada4c8-34be-4279-8d96-e700bfece5dd service nova] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Updated VIF entry in instance network info cache for port 73526f5e-c0da-4686-b2ab-e3859a2d6c85. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:50:01 user nova-compute[72444]: DEBUG nova.network.neutron [req-5ead2eff-7ea0-4153-9610-e789b78eb075 req-51ada4c8-34be-4279-8d96-e700bfece5dd service nova] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Updating instance_info_cache with network_info: [{"id": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "address": "fa:16:3e:5e:64:b2", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73526f5e-c0", "ovs_interfaceid": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:50:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5ead2eff-7ea0-4153-9610-e789b78eb075 req-51ada4c8-34be-4279-8d96-e700bfece5dd service nova] Releasing lock "refresh_cache-c4af22f7-45f8-4777-83ee-5cf1481c9fe8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:50:02 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG nova.compute.manager [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 04:50:07 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Creating image(s)
Aug 03 04:50:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Did not create local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Ensure instance console log exists: /opt/stack/data/nova/instances/c4af22f7-45f8-4777-83ee-5cf1481c9fe8/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Start _get_guest_xml network_info=[{"id": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "address": "fa:16:3e:5e:64:b2", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73526f5e-c0", "ovs_interfaceid": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xJiGAEmX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c4af22f7-45f8-4777-83ee-5cf1481c9fe8', 'attached_at': '', 'detached_at': '', 'volume_id': 'a14d792b-d953-43f8-8af2-c2ac8f765b86', 'serial': 'a14d792b-d953-43f8-8af2-c2ac8f765b86'}, 'disk_bus': 'virtio', 'attachment_id': 'd20e32a5-7bec-4a04-aaa3-4c216971ee17', 'guest_format': None, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:50:07 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:50:07 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:50:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xJiGAEmX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:50:07 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:50:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:50:07 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:50:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:50:07 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:50:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba3680d-d679-442a-8297-52df2445bd5f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 04:50:07 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e36a7e-7ec1-4d52-a186-f9ccc0c08a16]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86] added
Aug 03 04:50:07 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d3b6bf-bc4d-4147-afe6-a060674495b1]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd9177d-929f-499a-a246-56f0189d9f4c]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xJiGAEmX {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xJiGAEmX" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f243c9-d911-4dd9-9cf3-6ee66b6b8135]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xJiGAEmX'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[528a0a5b-520f-4672-86ab-3d517cf1dec5]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[932d1fc9-ab00-42fc-aeb0-34f7145c7b5f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 (non-flash)
Aug 03 04:50:07 user nova-compute[72444]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab (non-flash)
Aug 03 04:50:07 user nova-compute[72444]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 (non-flash)
Aug 03 04:50:07 user nova-compute[72444]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 (non-flash)
Aug 03 04:50:07 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:50:07 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 (non-flash)
Aug 03 04:50:07 user nova-compute[72444]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab (non-flash)
Aug 03 04:50:07 user nova-compute[72444]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 (non-flash)
Aug 03 04:50:07 user nova-compute[72444]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 (non-flash)
Aug 03 04:50:07 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:50:07 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --login" returned: 0 in 0.281s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ef7292-112b-4f3c-9fae-6d290d3a7828]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86, portal: 172.16.0.220,3260]
Aug 03 04:50:07 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86, portal: 172.16.0.220,3260] successful.
Aug 03 04:50:07 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c571e714-6746-46b8-9154-ab5b681de084]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f8607f-0050-47f7-a3d4-234bd6dfe3f7]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 (non-flash)
Aug 03 04:50:07 user nova-compute[72444]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab (non-flash)
Aug 03 04:50:07 user nova-compute[72444]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 (non-flash)
Aug 03 04:50:07 user nova-compute[72444]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 (non-flash)
Aug 03 04:50:07 user nova-compute[72444]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:50:07 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:50:07 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 (non-flash)
Aug 03 04:50:07 user nova-compute[72444]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab (non-flash)
Aug 03 04:50:07 user nova-compute[72444]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 (non-flash)
Aug 03 04:50:07 user nova-compute[72444]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 (non-flash)
Aug 03 04:50:07 user nova-compute[72444]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:50:07 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:50:07 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.518s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] HCTL ('38', '-', '-', 0) found on session 23 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4220d4-88b2-4ac6-a891-93fc4a3fccd0]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Searching for a device in session 23 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xJiGAEmX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Acquiring lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:50:07 user nova-compute[72444]: DEBUG nova.compute.manager [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 04:50:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:50:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:50:08 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 04:50:08 user nova-compute[72444]: INFO nova.compute.claims [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Claim successful on node user
Aug 03 04:50:08 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:50:08 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:50:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.480s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:50:08 user nova-compute[72444]: DEBUG nova.compute.manager [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 04:50:08 user nova-compute[72444]: DEBUG nova.compute.manager [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 04:50:08 user nova-compute[72444]: DEBUG nova.network.neutron [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 04:50:08 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 04:50:08 user nova-compute[72444]: DEBUG nova.compute.manager [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 04:50:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.562s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:50:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] <== connect_volume: return (1563ms) {'type': 'block', 'scsi_wwn': '26231323539363265', 'path': '/dev/sdg'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:50:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231323539363265', 'path': '/dev/sdg'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:50:08 user nova-compute[72444]: DEBUG nova.policy [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f29b6876e1a4bddab9a9a78b5a62863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c9730911c84c0fa38568d481753766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 04:50:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:49:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-469217001',display_name='tempest-ServerActionsTestOtherA-server-469217001',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-469217001',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDRHy6esW1Y8XjdGq8kBFPOjS8VFKeCY2PZq9mP7iSJL6lEWXDaTZRjD+kixW9a+QL5lbang2hEmB7Vd5YkTr9lWHW5QxoFRm5vUQ48SZ1Yf+s27SIuqNanyEMadE17HUA==',key_name='tempest-keypair-1657293229',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56d17468ddd64dfabba3a2c7b6df71ef',ramdisk_id='',reservation_id='r-s4u10w6o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1629114222',owner_user_name='tempest-ServerActionsTestOtherA-1629114222-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:49:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7120445361dc4363b4cc6c7671a2716e',uuid=c4af22f7-45f8-4777-83ee-5cf1481c9fe8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "address": "fa:16:3e:5e:64:b2", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73526f5e-c0", "ovs_interfaceid": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:50:08 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Converting VIF {"id": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "address": "fa:16:3e:5e:64:b2", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73526f5e-c0", "ovs_interfaceid": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:50:08 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:64:b2,bridge_name='br-int',has_traffic_filtering=True,id=73526f5e-c0da-4686-b2ab-e3859a2d6c85,network=Network(95b97be9-d6db-45e9-b0f1-a72fc90b69d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73526f5e-c0') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:50:08 user nova-compute[72444]: DEBUG nova.objects.instance [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lazy-loading 'pci_devices' on Instance uuid c4af22f7-45f8-4777-83ee-5cf1481c9fe8 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:50:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:50:08 user nova-compute[72444]:   <uuid>c4af22f7-45f8-4777-83ee-5cf1481c9fe8</uuid>
Aug 03 04:50:08 user nova-compute[72444]:   <name>instance-00000019</name>
Aug 03 04:50:08 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:50:08 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:50:08 user nova-compute[72444]:   <metadata>
Aug 03 04:50:08 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:50:08 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:50:08 user nova-compute[72444]:       <nova:name>tempest-ServerActionsTestOtherA-server-469217001</nova:name>
Aug 03 04:50:08 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:50:07</nova:creationTime>
Aug 03 04:50:08 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:50:08 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:50:08 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:50:08 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:50:08 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:50:08 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:50:08 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:50:08 user nova-compute[72444]:       <nova:owner>
Aug 03 04:50:08 user nova-compute[72444]:         <nova:user uuid="7120445361dc4363b4cc6c7671a2716e">tempest-ServerActionsTestOtherA-1629114222-project-member</nova:user>
Aug 03 04:50:08 user nova-compute[72444]:         <nova:project uuid="56d17468ddd64dfabba3a2c7b6df71ef">tempest-ServerActionsTestOtherA-1629114222</nova:project>
Aug 03 04:50:08 user nova-compute[72444]:       </nova:owner>
Aug 03 04:50:08 user nova-compute[72444]:       <nova:ports>
Aug 03 04:50:08 user nova-compute[72444]:         <nova:port uuid="73526f5e-c0da-4686-b2ab-e3859a2d6c85">
Aug 03 04:50:08 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 03 04:50:08 user nova-compute[72444]:         </nova:port>
Aug 03 04:50:08 user nova-compute[72444]:       </nova:ports>
Aug 03 04:50:08 user nova-compute[72444]:     </nova:instance>
Aug 03 04:50:08 user nova-compute[72444]:   </metadata>
Aug 03 04:50:08 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:50:08 user nova-compute[72444]:     <system>
Aug 03 04:50:08 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:50:08 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:50:08 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:50:08 user nova-compute[72444]:       <entry name="serial">c4af22f7-45f8-4777-83ee-5cf1481c9fe8</entry>
Aug 03 04:50:08 user nova-compute[72444]:       <entry name="uuid">c4af22f7-45f8-4777-83ee-5cf1481c9fe8</entry>
Aug 03 04:50:08 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:50:08 user nova-compute[72444]:     </system>
Aug 03 04:50:08 user nova-compute[72444]:   </sysinfo>
Aug 03 04:50:08 user nova-compute[72444]:   <os>
Aug 03 04:50:08 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:50:08 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:50:08 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:50:08 user nova-compute[72444]:   </os>
Aug 03 04:50:08 user nova-compute[72444]:   <features>
Aug 03 04:50:08 user nova-compute[72444]:     <acpi/>
Aug 03 04:50:08 user nova-compute[72444]:     <apic/>
Aug 03 04:50:08 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:50:08 user nova-compute[72444]:   </features>
Aug 03 04:50:08 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:50:08 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:50:08 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:50:08 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:50:08 user nova-compute[72444]:   </clock>
Aug 03 04:50:08 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:50:08 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:50:08 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:50:08 user nova-compute[72444]:   </cpu>
Aug 03 04:50:08 user nova-compute[72444]:   <devices>
Aug 03 04:50:08 user nova-compute[72444]:     <disk type="block" device="disk">
Aug 03 04:50:08 user nova-compute[72444]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:50:08 user nova-compute[72444]:       <source dev="/dev/sdg"/>
Aug 03 04:50:08 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:50:08 user nova-compute[72444]:       <serial>a14d792b-d953-43f8-8af2-c2ac8f765b86</serial>
Aug 03 04:50:08 user nova-compute[72444]:     </disk>
Aug 03 04:50:08 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:50:08 user nova-compute[72444]:       <mac address="fa:16:3e:5e:64:b2"/>
Aug 03 04:50:08 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:50:08 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:50:08 user nova-compute[72444]:       <target dev="tap73526f5e-c0"/>
Aug 03 04:50:08 user nova-compute[72444]:     </interface>
Aug 03 04:50:08 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:50:08 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/c4af22f7-45f8-4777-83ee-5cf1481c9fe8/console.log" append="off"/>
Aug 03 04:50:08 user nova-compute[72444]:     </serial>
Aug 03 04:50:08 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:50:08 user nova-compute[72444]:     <video>
Aug 03 04:50:08 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:50:08 user nova-compute[72444]:     </video>
Aug 03 04:50:08 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:50:08 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:50:08 user nova-compute[72444]:     </rng>
Aug 03 04:50:08 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:50:08 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:50:08 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:50:08 user nova-compute[72444]:     </memballoon>
Aug 03 04:50:08 user nova-compute[72444]:   </devices>
Aug 03 04:50:08 user nova-compute[72444]: </domain>
Aug 03 04:50:08 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:50:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:49:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-469217001',display_name='tempest-ServerActionsTestOtherA-server-469217001',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-469217001',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDRHy6esW1Y8XjdGq8kBFPOjS8VFKeCY2PZq9mP7iSJL6lEWXDaTZRjD+kixW9a+QL5lbang2hEmB7Vd5YkTr9lWHW5QxoFRm5vUQ48SZ1Yf+s27SIuqNanyEMadE17HUA==',key_name='tempest-keypair-1657293229',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56d17468ddd64dfabba3a2c7b6df71ef',ramdisk_id='',reservation_id='r-s4u10w6o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1629114222',owner_user_name='tempest-ServerActionsTestOtherA-1629114222-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:49:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7120445361dc4363b4cc6c7671a2716e',uuid=c4af22f7-45f8-4777-83ee-5cf1481c9fe8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "address": "fa:16:3e:5e:64:b2", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73526f5e-c0", "ovs_interfaceid": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:50:08 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Converting VIF {"id": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "address": "fa:16:3e:5e:64:b2", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73526f5e-c0", "ovs_interfaceid": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:50:08 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:64:b2,bridge_name='br-int',has_traffic_filtering=True,id=73526f5e-c0da-4686-b2ab-e3859a2d6c85,network=Network(95b97be9-d6db-45e9-b0f1-a72fc90b69d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73526f5e-c0') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:50:08 user nova-compute[72444]: DEBUG os_vif [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:64:b2,bridge_name='br-int',has_traffic_filtering=True,id=73526f5e-c0da-4686-b2ab-e3859a2d6c85,network=Network(95b97be9-d6db-45e9-b0f1-a72fc90b69d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73526f5e-c0') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:50:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:50:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:50:08 user nova-compute[72444]: DEBUG nova.compute.manager [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 04:50:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 04:50:08 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Creating image(s)
Aug 03 04:50:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Acquiring lock "/opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:50:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "/opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:50:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "/opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:50:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73526f5e-c0, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:50:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap73526f5e-c0, col_values=(('external_ids', {'iface-id': '73526f5e-c0da-4686-b2ab-e3859a2d6c85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:64:b2', 'vm-uuid': 'c4af22f7-45f8-4777-83ee-5cf1481c9fe8'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:50:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:50:08 user nova-compute[72444]: INFO os_vif [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:64:b2,bridge_name='br-int',has_traffic_filtering=True,id=73526f5e-c0da-4686-b2ab-e3859a2d6c85,network=Network(95b97be9-d6db-45e9-b0f1-a72fc90b69d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73526f5e-c0')
Aug 03 04:50:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.152s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:50:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:50:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:50:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] No VIF found with MAC fa:16:3e:5e:64:b2, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:50:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.157s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/disk 1073741824" returned: 0 in 0.079s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:50:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.179s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:09 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 04:50:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:09 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Cannot resize image /opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 04:50:09 user nova-compute[72444]: DEBUG nova.objects.instance [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lazy-loading 'migration_context' on Instance uuid c94f537a-b1a1-4cea-996d-e1a88a2c9dac {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:50:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 04:50:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Ensure instance console log exists: /opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 04:50:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:50:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:50:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:50:09 user nova-compute[72444]: DEBUG nova.network.neutron [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Successfully created port: b1d5afe6-1a33-4b79-a06b-79f4ea86652a {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:50:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:10 user nova-compute[72444]: DEBUG nova.network.neutron [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Successfully updated port: b1d5afe6-1a33-4b79-a06b-79f4ea86652a {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:50:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Acquiring lock "refresh_cache-c94f537a-b1a1-4cea-996d-e1a88a2c9dac" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:50:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Acquired lock "refresh_cache-c94f537a-b1a1-4cea-996d-e1a88a2c9dac" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:50:10 user nova-compute[72444]: DEBUG nova.network.neutron [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:50:10 user nova-compute[72444]: DEBUG nova.compute.manager [req-90656e03-42c8-4f73-be76-0fa28f6698ff req-779672a3-c52e-475f-a433-0e66cade462d service nova] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Received event network-changed-b1d5afe6-1a33-4b79-a06b-79f4ea86652a {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:50:10 user nova-compute[72444]: DEBUG nova.compute.manager [req-90656e03-42c8-4f73-be76-0fa28f6698ff req-779672a3-c52e-475f-a433-0e66cade462d service nova] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Refreshing instance network info cache due to event network-changed-b1d5afe6-1a33-4b79-a06b-79f4ea86652a. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:50:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-90656e03-42c8-4f73-be76-0fa28f6698ff req-779672a3-c52e-475f-a433-0e66cade462d service nova] Acquiring lock "refresh_cache-c94f537a-b1a1-4cea-996d-e1a88a2c9dac" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:50:10 user nova-compute[72444]: DEBUG nova.network.neutron [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:50:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:10 user nova-compute[72444]: DEBUG nova.compute.manager [req-11035a41-44f5-48b0-a2d0-ab75a572e5e2 req-b58cca97-c288-4229-853a-2d20e9c85826 service nova] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Received event network-vif-plugged-73526f5e-c0da-4686-b2ab-e3859a2d6c85 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:50:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-11035a41-44f5-48b0-a2d0-ab75a572e5e2 req-b58cca97-c288-4229-853a-2d20e9c85826 service nova] Acquiring lock "c4af22f7-45f8-4777-83ee-5cf1481c9fe8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:50:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-11035a41-44f5-48b0-a2d0-ab75a572e5e2 req-b58cca97-c288-4229-853a-2d20e9c85826 service nova] Lock "c4af22f7-45f8-4777-83ee-5cf1481c9fe8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:50:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-11035a41-44f5-48b0-a2d0-ab75a572e5e2 req-b58cca97-c288-4229-853a-2d20e9c85826 service nova] Lock "c4af22f7-45f8-4777-83ee-5cf1481c9fe8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:50:10 user nova-compute[72444]: DEBUG nova.compute.manager [req-11035a41-44f5-48b0-a2d0-ab75a572e5e2 req-b58cca97-c288-4229-853a-2d20e9c85826 service nova] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] No waiting events found dispatching network-vif-plugged-73526f5e-c0da-4686-b2ab-e3859a2d6c85 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:50:10 user nova-compute[72444]: WARNING nova.compute.manager [req-11035a41-44f5-48b0-a2d0-ab75a572e5e2 req-b58cca97-c288-4229-853a-2d20e9c85826 service nova] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Received unexpected event network-vif-plugged-73526f5e-c0da-4686-b2ab-e3859a2d6c85 for instance with vm_state building and task_state spawning.
Aug 03 04:50:10 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691038195.8947535, 2d74a02f-7180-4a2b-ac27-14c28d0b1d27 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:50:10 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] VM Stopped (Lifecycle Event)
Aug 03 04:50:10 user nova-compute[72444]: DEBUG nova.compute.manager [None req-6228125f-c166-449a-8717-111396bd793f None None] [instance: 2d74a02f-7180-4a2b-ac27-14c28d0b1d27] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:50:10 user nova-compute[72444]: DEBUG nova.network.neutron [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Updating instance_info_cache with network_info: [{"id": "b1d5afe6-1a33-4b79-a06b-79f4ea86652a", "address": "fa:16:3e:7f:5d:57", "network": {"id": "912c9d5f-3b43-4977-a056-cf05688bee52", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1503012962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9730911c84c0fa38568d481753766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1d5afe6-1a", "ovs_interfaceid": "b1d5afe6-1a33-4b79-a06b-79f4ea86652a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Releasing lock "refresh_cache-c94f537a-b1a1-4cea-996d-e1a88a2c9dac" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG nova.compute.manager [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Instance network_info: |[{"id": "b1d5afe6-1a33-4b79-a06b-79f4ea86652a", "address": "fa:16:3e:7f:5d:57", "network": {"id": "912c9d5f-3b43-4977-a056-cf05688bee52", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1503012962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9730911c84c0fa38568d481753766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1d5afe6-1a", "ovs_interfaceid": "b1d5afe6-1a33-4b79-a06b-79f4ea86652a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-90656e03-42c8-4f73-be76-0fa28f6698ff req-779672a3-c52e-475f-a433-0e66cade462d service nova] Acquired lock "refresh_cache-c94f537a-b1a1-4cea-996d-e1a88a2c9dac" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG nova.network.neutron [req-90656e03-42c8-4f73-be76-0fa28f6698ff req-779672a3-c52e-475f-a433-0e66cade462d service nova] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Refreshing network info cache for port b1d5afe6-1a33-4b79-a06b-79f4ea86652a {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Start _get_guest_xml network_info=[{"id": "b1d5afe6-1a33-4b79-a06b-79f4ea86652a", "address": "fa:16:3e:7f:5d:57", "network": {"id": "912c9d5f-3b43-4977-a056-cf05688bee52", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1503012962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9730911c84c0fa38568d481753766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1d5afe6-1a", "ovs_interfaceid": "b1d5afe6-1a33-4b79-a06b-79f4ea86652a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:50:11 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:50:11 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:50:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:50:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1422343999',display_name='tempest-SnapshotDataIntegrityTests-server-1422343999',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1422343999',id=26,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYRDdh8WMuKqd0C2ip1qkT34LF5rBYi+C+tFBo0jTQJ3zeV1Z8Nh9W7FE3hUxElsJFvaOy84yUa9z8PXDzZkHs+AFADUzz2IO0+dlGOVkABaIqmGpjcFyLRMcFdEw1Irw==',key_name='tempest-keypair-840943572',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34c9730911c84c0fa38568d481753766',ramdisk_id='',reservation_id='r-c32owu20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2003248722',owner_user_name='tempest-SnapshotDataIntegrityTests-2003248722-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:50:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f29b6876e1a4bddab9a9a78b5a62863',uuid=c94f537a-b1a1-4cea-996d-e1a88a2c9dac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1d5afe6-1a33-4b79-a06b-79f4ea86652a", "address": "fa:16:3e:7f:5d:57", "network": {"id": "912c9d5f-3b43-4977-a056-cf05688bee52", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1503012962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9730911c84c0fa38568d481753766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1d5afe6-1a", "ovs_interfaceid": "b1d5afe6-1a33-4b79-a06b-79f4ea86652a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Converting VIF {"id": "b1d5afe6-1a33-4b79-a06b-79f4ea86652a", "address": "fa:16:3e:7f:5d:57", "network": {"id": "912c9d5f-3b43-4977-a056-cf05688bee52", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1503012962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9730911c84c0fa38568d481753766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1d5afe6-1a", "ovs_interfaceid": "b1d5afe6-1a33-4b79-a06b-79f4ea86652a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:5d:57,bridge_name='br-int',has_traffic_filtering=True,id=b1d5afe6-1a33-4b79-a06b-79f4ea86652a,network=Network(912c9d5f-3b43-4977-a056-cf05688bee52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1d5afe6-1a') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG nova.objects.instance [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lazy-loading 'pci_devices' on Instance uuid c94f537a-b1a1-4cea-996d-e1a88a2c9dac {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:50:11 user nova-compute[72444]:   <uuid>c94f537a-b1a1-4cea-996d-e1a88a2c9dac</uuid>
Aug 03 04:50:11 user nova-compute[72444]:   <name>instance-0000001a</name>
Aug 03 04:50:11 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:50:11 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:50:11 user nova-compute[72444]:   <metadata>
Aug 03 04:50:11 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:50:11 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:50:11 user nova-compute[72444]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1422343999</nova:name>
Aug 03 04:50:11 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:50:11</nova:creationTime>
Aug 03 04:50:11 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:50:11 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:50:11 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:50:11 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:50:11 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:50:11 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:50:11 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:50:11 user nova-compute[72444]:       <nova:owner>
Aug 03 04:50:11 user nova-compute[72444]:         <nova:user uuid="0f29b6876e1a4bddab9a9a78b5a62863">tempest-SnapshotDataIntegrityTests-2003248722-project-member</nova:user>
Aug 03 04:50:11 user nova-compute[72444]:         <nova:project uuid="34c9730911c84c0fa38568d481753766">tempest-SnapshotDataIntegrityTests-2003248722</nova:project>
Aug 03 04:50:11 user nova-compute[72444]:       </nova:owner>
Aug 03 04:50:11 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:50:11 user nova-compute[72444]:       <nova:ports>
Aug 03 04:50:11 user nova-compute[72444]:         <nova:port uuid="b1d5afe6-1a33-4b79-a06b-79f4ea86652a">
Aug 03 04:50:11 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 03 04:50:11 user nova-compute[72444]:         </nova:port>
Aug 03 04:50:11 user nova-compute[72444]:       </nova:ports>
Aug 03 04:50:11 user nova-compute[72444]:     </nova:instance>
Aug 03 04:50:11 user nova-compute[72444]:   </metadata>
Aug 03 04:50:11 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:50:11 user nova-compute[72444]:     <system>
Aug 03 04:50:11 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:50:11 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:50:11 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:50:11 user nova-compute[72444]:       <entry name="serial">c94f537a-b1a1-4cea-996d-e1a88a2c9dac</entry>
Aug 03 04:50:11 user nova-compute[72444]:       <entry name="uuid">c94f537a-b1a1-4cea-996d-e1a88a2c9dac</entry>
Aug 03 04:50:11 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:50:11 user nova-compute[72444]:     </system>
Aug 03 04:50:11 user nova-compute[72444]:   </sysinfo>
Aug 03 04:50:11 user nova-compute[72444]:   <os>
Aug 03 04:50:11 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:50:11 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:50:11 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:50:11 user nova-compute[72444]:   </os>
Aug 03 04:50:11 user nova-compute[72444]:   <features>
Aug 03 04:50:11 user nova-compute[72444]:     <acpi/>
Aug 03 04:50:11 user nova-compute[72444]:     <apic/>
Aug 03 04:50:11 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:50:11 user nova-compute[72444]:   </features>
Aug 03 04:50:11 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:50:11 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:50:11 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:50:11 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:50:11 user nova-compute[72444]:   </clock>
Aug 03 04:50:11 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:50:11 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:50:11 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:50:11 user nova-compute[72444]:   </cpu>
Aug 03 04:50:11 user nova-compute[72444]:   <devices>
Aug 03 04:50:11 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:50:11 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:50:11 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/disk"/>
Aug 03 04:50:11 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:50:11 user nova-compute[72444]:     </disk>
Aug 03 04:50:11 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:50:11 user nova-compute[72444]:       <mac address="fa:16:3e:7f:5d:57"/>
Aug 03 04:50:11 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:50:11 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:50:11 user nova-compute[72444]:       <target dev="tapb1d5afe6-1a"/>
Aug 03 04:50:11 user nova-compute[72444]:     </interface>
Aug 03 04:50:11 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:50:11 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/console.log" append="off"/>
Aug 03 04:50:11 user nova-compute[72444]:     </serial>
Aug 03 04:50:11 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:50:11 user nova-compute[72444]:     <video>
Aug 03 04:50:11 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:50:11 user nova-compute[72444]:     </video>
Aug 03 04:50:11 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:50:11 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:50:11 user nova-compute[72444]:     </rng>
Aug 03 04:50:11 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:50:11 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:50:11 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:50:11 user nova-compute[72444]:     </memballoon>
Aug 03 04:50:11 user nova-compute[72444]:   </devices>
Aug 03 04:50:11 user nova-compute[72444]: </domain>
Aug 03 04:50:11 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:50:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1422343999',display_name='tempest-SnapshotDataIntegrityTests-server-1422343999',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1422343999',id=26,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYRDdh8WMuKqd0C2ip1qkT34LF5rBYi+C+tFBo0jTQJ3zeV1Z8Nh9W7FE3hUxElsJFvaOy84yUa9z8PXDzZkHs+AFADUzz2IO0+dlGOVkABaIqmGpjcFyLRMcFdEw1Irw==',key_name='tempest-keypair-840943572',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34c9730911c84c0fa38568d481753766',ramdisk_id='',reservation_id='r-c32owu20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2003248722',owner_user_name='tempest-SnapshotDataIntegrityTests-2003248722-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:50:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f29b6876e1a4bddab9a9a78b5a62863',uuid=c94f537a-b1a1-4cea-996d-e1a88a2c9dac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1d5afe6-1a33-4b79-a06b-79f4ea86652a", "address": "fa:16:3e:7f:5d:57", "network": {"id": "912c9d5f-3b43-4977-a056-cf05688bee52", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1503012962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9730911c84c0fa38568d481753766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1d5afe6-1a", "ovs_interfaceid": "b1d5afe6-1a33-4b79-a06b-79f4ea86652a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Converting VIF {"id": "b1d5afe6-1a33-4b79-a06b-79f4ea86652a", "address": "fa:16:3e:7f:5d:57", "network": {"id": "912c9d5f-3b43-4977-a056-cf05688bee52", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1503012962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9730911c84c0fa38568d481753766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1d5afe6-1a", "ovs_interfaceid": "b1d5afe6-1a33-4b79-a06b-79f4ea86652a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:5d:57,bridge_name='br-int',has_traffic_filtering=True,id=b1d5afe6-1a33-4b79-a06b-79f4ea86652a,network=Network(912c9d5f-3b43-4977-a056-cf05688bee52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1d5afe6-1a') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG os_vif [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:5d:57,bridge_name='br-int',has_traffic_filtering=True,id=b1d5afe6-1a33-4b79-a06b-79f4ea86652a,network=Network(912c9d5f-3b43-4977-a056-cf05688bee52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1d5afe6-1a') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1d5afe6-1a, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb1d5afe6-1a, col_values=(('external_ids', {'iface-id': 'b1d5afe6-1a33-4b79-a06b-79f4ea86652a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:5d:57', 'vm-uuid': 'c94f537a-b1a1-4cea-996d-e1a88a2c9dac'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:11 user nova-compute[72444]: INFO os_vif [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:5d:57,bridge_name='br-int',has_traffic_filtering=True,id=b1d5afe6-1a33-4b79-a06b-79f4ea86652a,network=Network(912c9d5f-3b43-4977-a056-cf05688bee52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1d5afe6-1a')
Aug 03 04:50:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] No VIF found with MAC fa:16:3e:7f:5d:57, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG nova.network.neutron [req-90656e03-42c8-4f73-be76-0fa28f6698ff req-779672a3-c52e-475f-a433-0e66cade462d service nova] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Updated VIF entry in instance network info cache for port b1d5afe6-1a33-4b79-a06b-79f4ea86652a. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG nova.network.neutron [req-90656e03-42c8-4f73-be76-0fa28f6698ff req-779672a3-c52e-475f-a433-0e66cade462d service nova] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Updating instance_info_cache with network_info: [{"id": "b1d5afe6-1a33-4b79-a06b-79f4ea86652a", "address": "fa:16:3e:7f:5d:57", "network": {"id": "912c9d5f-3b43-4977-a056-cf05688bee52", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1503012962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9730911c84c0fa38568d481753766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1d5afe6-1a", "ovs_interfaceid": "b1d5afe6-1a33-4b79-a06b-79f4ea86652a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:50:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-90656e03-42c8-4f73-be76-0fa28f6698ff req-779672a3-c52e-475f-a433-0e66cade462d service nova] Releasing lock "refresh_cache-c94f537a-b1a1-4cea-996d-e1a88a2c9dac" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:50:12 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:12 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:12 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:12 user nova-compute[72444]: DEBUG nova.compute.manager [req-8cf5e429-4a42-48e1-9d38-71f29ce2abb1 req-3e166d29-8606-4f93-8ffe-da628fe730e3 service nova] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Received event network-vif-plugged-b1d5afe6-1a33-4b79-a06b-79f4ea86652a {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:50:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8cf5e429-4a42-48e1-9d38-71f29ce2abb1 req-3e166d29-8606-4f93-8ffe-da628fe730e3 service nova] Acquiring lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:50:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8cf5e429-4a42-48e1-9d38-71f29ce2abb1 req-3e166d29-8606-4f93-8ffe-da628fe730e3 service nova] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:50:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8cf5e429-4a42-48e1-9d38-71f29ce2abb1 req-3e166d29-8606-4f93-8ffe-da628fe730e3 service nova] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:50:12 user nova-compute[72444]: DEBUG nova.compute.manager [req-8cf5e429-4a42-48e1-9d38-71f29ce2abb1 req-3e166d29-8606-4f93-8ffe-da628fe730e3 service nova] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] No waiting events found dispatching network-vif-plugged-b1d5afe6-1a33-4b79-a06b-79f4ea86652a {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:50:12 user nova-compute[72444]: WARNING nova.compute.manager [req-8cf5e429-4a42-48e1-9d38-71f29ce2abb1 req-3e166d29-8606-4f93-8ffe-da628fe730e3 service nova] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Received unexpected event network-vif-plugged-b1d5afe6-1a33-4b79-a06b-79f4ea86652a for instance with vm_state building and task_state spawning.
Aug 03 04:50:12 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038212.796593, c4af22f7-45f8-4777-83ee-5cf1481c9fe8 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:50:12 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] VM Resumed (Lifecycle Event)
Aug 03 04:50:12 user nova-compute[72444]: DEBUG nova.compute.manager [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:50:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 04:50:12 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Instance spawned successfully.
Aug 03 04:50:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 04:50:12 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:50:12 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:50:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:50:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:50:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:50:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:50:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:50:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:50:12 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:50:12 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038212.8022995, c4af22f7-45f8-4777-83ee-5cf1481c9fe8 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:50:12 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] VM Started (Lifecycle Event)
Aug 03 04:50:12 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:50:12 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:50:12 user nova-compute[72444]: INFO nova.compute.manager [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Took 5.79 seconds to spawn the instance on the hypervisor.
Aug 03 04:50:12 user nova-compute[72444]: DEBUG nova.compute.manager [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:50:12 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:50:12 user nova-compute[72444]: DEBUG nova.compute.manager [req-ae6cb433-79b8-46bb-a2c2-96b62325d170 req-b1d9f9b6-7dc8-4e13-ad08-a3d8b9c6a890 service nova] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Received event network-vif-plugged-73526f5e-c0da-4686-b2ab-e3859a2d6c85 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:50:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ae6cb433-79b8-46bb-a2c2-96b62325d170 req-b1d9f9b6-7dc8-4e13-ad08-a3d8b9c6a890 service nova] Acquiring lock "c4af22f7-45f8-4777-83ee-5cf1481c9fe8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:50:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ae6cb433-79b8-46bb-a2c2-96b62325d170 req-b1d9f9b6-7dc8-4e13-ad08-a3d8b9c6a890 service nova] Lock "c4af22f7-45f8-4777-83ee-5cf1481c9fe8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:50:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ae6cb433-79b8-46bb-a2c2-96b62325d170 req-b1d9f9b6-7dc8-4e13-ad08-a3d8b9c6a890 service nova] Lock "c4af22f7-45f8-4777-83ee-5cf1481c9fe8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:50:12 user nova-compute[72444]: DEBUG nova.compute.manager [req-ae6cb433-79b8-46bb-a2c2-96b62325d170 req-b1d9f9b6-7dc8-4e13-ad08-a3d8b9c6a890 service nova] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] No waiting events found dispatching network-vif-plugged-73526f5e-c0da-4686-b2ab-e3859a2d6c85 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:50:12 user nova-compute[72444]: WARNING nova.compute.manager [req-ae6cb433-79b8-46bb-a2c2-96b62325d170 req-b1d9f9b6-7dc8-4e13-ad08-a3d8b9c6a890 service nova] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Received unexpected event network-vif-plugged-73526f5e-c0da-4686-b2ab-e3859a2d6c85 for instance with vm_state building and task_state spawning.
Aug 03 04:50:13 user nova-compute[72444]: INFO nova.compute.manager [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Took 15.79 seconds to build instance.
Aug 03 04:50:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-1526a6bc-4200-42f0-8217-a82af565f8ac tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "c4af22f7-45f8-4777-83ee-5cf1481c9fe8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.909s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:50:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:14 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038214.8005383, c94f537a-b1a1-4cea-996d-e1a88a2c9dac => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:50:14 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] VM Resumed (Lifecycle Event)
Aug 03 04:50:14 user nova-compute[72444]: DEBUG nova.compute.manager [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:50:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 04:50:14 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Instance spawned successfully.
Aug 03 04:50:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 04:50:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:50:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:50:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:50:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:50:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:50:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:50:14 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:50:14 user nova-compute[72444]: DEBUG nova.compute.manager [req-44ed23a7-47c2-400c-95f3-4500ff2eeb20 req-8815e484-0ff0-4ca2-9ae5-67346a7d0f17 service nova] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Received event network-vif-plugged-b1d5afe6-1a33-4b79-a06b-79f4ea86652a {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:50:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-44ed23a7-47c2-400c-95f3-4500ff2eeb20 req-8815e484-0ff0-4ca2-9ae5-67346a7d0f17 service nova] Acquiring lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:50:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-44ed23a7-47c2-400c-95f3-4500ff2eeb20 req-8815e484-0ff0-4ca2-9ae5-67346a7d0f17 service nova] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:50:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-44ed23a7-47c2-400c-95f3-4500ff2eeb20 req-8815e484-0ff0-4ca2-9ae5-67346a7d0f17 service nova] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:50:14 user nova-compute[72444]: DEBUG nova.compute.manager [req-44ed23a7-47c2-400c-95f3-4500ff2eeb20 req-8815e484-0ff0-4ca2-9ae5-67346a7d0f17 service nova] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] No waiting events found dispatching network-vif-plugged-b1d5afe6-1a33-4b79-a06b-79f4ea86652a {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:50:14 user nova-compute[72444]: WARNING nova.compute.manager [req-44ed23a7-47c2-400c-95f3-4500ff2eeb20 req-8815e484-0ff0-4ca2-9ae5-67346a7d0f17 service nova] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Received unexpected event network-vif-plugged-b1d5afe6-1a33-4b79-a06b-79f4ea86652a for instance with vm_state building and task_state spawning.
Aug 03 04:50:14 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:50:14 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:50:14 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038214.8049405, c94f537a-b1a1-4cea-996d-e1a88a2c9dac => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:50:14 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] VM Started (Lifecycle Event)
Aug 03 04:50:14 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:50:14 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:50:14 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:50:15 user nova-compute[72444]: INFO nova.compute.manager [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Took 6.18 seconds to spawn the instance on the hypervisor.
Aug 03 04:50:15 user nova-compute[72444]: DEBUG nova.compute.manager [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:50:15 user nova-compute[72444]: INFO nova.compute.manager [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Took 7.15 seconds to build instance.
Aug 03 04:50:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-9df82977-6055-4b11-b5ce-6ba1d11f8d92 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.255s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:50:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2844b6dc-e704-4e6e-9207-6610e65d9445 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Acquiring lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:50:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2844b6dc-e704-4e6e-9207-6610e65d9445 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:50:17 user nova-compute[72444]: INFO nova.compute.manager [None req-2844b6dc-e704-4e6e-9207-6610e65d9445 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Detaching volume e69663dd-b408-4fc0-9694-de9040d7e1d7
Aug 03 04:50:17 user nova-compute[72444]: INFO nova.virt.block_device [None req-2844b6dc-e704-4e6e-9207-6610e65d9445 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Attempting to driver detach volume e69663dd-b408-4fc0-9694-de9040d7e1d7 from mountpoint /dev/vdb
Aug 03 04:50:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2844b6dc-e704-4e6e-9207-6610e65d9445 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Attempting to detach device vdb from instance 1baadfd2-6f00-436b-b3a0-c850cd8cb50e from the persistent domain config. {{(pid=72444) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 04:50:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-2844b6dc-e704-4e6e-9207-6610e65d9445 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 04:50:17 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:50:17 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 04:50:17 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:50:17 user nova-compute[72444]:   <serial>e69663dd-b408-4fc0-9694-de9040d7e1d7</serial>
Aug 03 04:50:17 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 04:50:17 user nova-compute[72444]: </disk>
Aug 03 04:50:17 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:50:17 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-2844b6dc-e704-4e6e-9207-6610e65d9445 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Successfully detached device vdb from instance 1baadfd2-6f00-436b-b3a0-c850cd8cb50e from the persistent domain config.
Aug 03 04:50:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2844b6dc-e704-4e6e-9207-6610e65d9445 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1baadfd2-6f00-436b-b3a0-c850cd8cb50e from the live domain config. {{(pid=72444) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 04:50:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-2844b6dc-e704-4e6e-9207-6610e65d9445 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 04:50:17 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:50:17 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 04:50:17 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:50:17 user nova-compute[72444]:   <serial>e69663dd-b408-4fc0-9694-de9040d7e1d7</serial>
Aug 03 04:50:17 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 04:50:17 user nova-compute[72444]: </disk>
Aug 03 04:50:17 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:50:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Received event <DeviceRemovedEvent: 1691038217.8448253, 1baadfd2-6f00-436b-b3a0-c850cd8cb50e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72444) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 04:50:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2844b6dc-e704-4e6e-9207-6610e65d9445 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1baadfd2-6f00-436b-b3a0-c850cd8cb50e {{(pid=72444) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 04:50:17 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-2844b6dc-e704-4e6e-9207-6610e65d9445 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Successfully detached device vdb from instance 1baadfd2-6f00-436b-b3a0-c850cd8cb50e from the live domain config.
Aug 03 04:50:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2844b6dc-e704-4e6e-9207-6610e65d9445 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:50:17 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2844b6dc-e704-4e6e-9207-6610e65d9445 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvQAtMxn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:50:17 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-2844b6dc-e704-4e6e-9207-6610e65d9445 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:50:17 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-2844b6dc-e704-4e6e-9207-6610e65d9445 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:50:17 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-2844b6dc-e704-4e6e-9207-6610e65d9445 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:50:17 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2844b6dc-e704-4e6e-9207-6610e65d9445 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:50:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:17 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52a34d6-9207-4f91-9ccd-1fe28bb8a3ad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:50:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:17 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[212a8d87-a77b-4fe2-8bf8-3c3a48a39621]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:50:17 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2844b6dc-e704-4e6e-9207-6610e65d9445 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 (non-flash)
Aug 03 04:50:17 user nova-compute[72444]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab (non-flash)
Aug 03 04:50:17 user nova-compute[72444]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 (non-flash)
Aug 03 04:50:17 user nova-compute[72444]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 (non-flash)
Aug 03 04:50:17 user nova-compute[72444]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:50:17 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:50:17 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:50:17 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2844b6dc-e704-4e6e-9207-6610e65d9445 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 (non-flash)
Aug 03 04:50:17 user nova-compute[72444]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab (non-flash)
Aug 03 04:50:17 user nova-compute[72444]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 (non-flash)
Aug 03 04:50:17 user nova-compute[72444]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 (non-flash)
Aug 03 04:50:17 user nova-compute[72444]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:50:17 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:50:17 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:50:17 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2844b6dc-e704-4e6e-9207-6610e65d9445 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3094304040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7'): ({'sdb'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:50:17 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-2844b6dc-e704-4e6e-9207-6610e65d9445 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Removing single pathed devices sdb {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 04:50:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:17 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa80f38-e350-4de2-92a4-65c0253193bd]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:50:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:17 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb97f230-b006-4487-9c49-87a5566d385d]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:50:17 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-2844b6dc-e704-4e6e-9207-6610e65d9445 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Flushing IO for device /dev/sdb {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 04:50:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:18 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[88574cd7-a46a-43a6-a68d-1ade17e4dd7f]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:50:18 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-2844b6dc-e704-4e6e-9207-6610e65d9445 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 04:50:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:18 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee17432d-6686-4e7e-a750-8c724c29edd2]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:50:18 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-2844b6dc-e704-4e6e-9207-6610e65d9445 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 04:50:18 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-2844b6dc-e704-4e6e-9207-6610e65d9445 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 04:50:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2844b6dc-e704-4e6e-9207-6610e65d9445 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:50:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:18 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c1ce93-f7c6-4184-94a6-5961442e6e75]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:50:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2844b6dc-e704-4e6e-9207-6610e65d9445 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:50:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:18 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77f78f4-a484-4b47-92f4-9142ed457159]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:50:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2844b6dc-e704-4e6e-9207-6610e65d9445 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7, portal: 172.16.0.220,3260]
Aug 03 04:50:18 user nova-compute[72444]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7, portal: 172.16.0.220,3260] successful.
Aug 03 04:50:18 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:50:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e69663dd-b408-4fc0-9694-de9040d7e1d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:18 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[232ea808-4c08-45c2-b99a-235febeba469]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:50:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2844b6dc-e704-4e6e-9207-6610e65d9445 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:50:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-2844b6dc-e704-4e6e-9207-6610e65d9445 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:50:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2844b6dc-e704-4e6e-9207-6610e65d9445 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] <== disconnect_volume: return (345ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:50:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2844b6dc-e704-4e6e-9207-6610e65d9445 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:50:18 user nova-compute[72444]: DEBUG nova.objects.instance [None req-2844b6dc-e704-4e6e-9207-6610e65d9445 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lazy-loading 'flavor' on Instance uuid 1baadfd2-6f00-436b-b3a0-c850cd8cb50e {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:50:19 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2844b6dc-e704-4e6e-9207-6610e65d9445 tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.796s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:50:19 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:29 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b70f55e2-3925-4414-a187-b9e386cebf1b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:50:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b70f55e2-3925-4414-a187-b9e386cebf1b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:50:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b70f55e2-3925-4414-a187-b9e386cebf1b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:50:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b70f55e2-3925-4414-a187-b9e386cebf1b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:50:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b70f55e2-3925-4414-a187-b9e386cebf1b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:50:38 user nova-compute[72444]: INFO nova.compute.manager [None req-b70f55e2-3925-4414-a187-b9e386cebf1b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Terminating instance
Aug 03 04:50:38 user nova-compute[72444]: DEBUG nova.compute.manager [None req-b70f55e2-3925-4414-a187-b9e386cebf1b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 04:50:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:38 user nova-compute[72444]: DEBUG nova.compute.manager [req-af1c5a0a-3011-48f4-9373-2223670e74aa req-a87980b4-8124-4337-a0f0-118914baafa3 service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Received event network-vif-unplugged-841a11a2-ffb3-44cf-9e15-c8099578d405 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:50:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-af1c5a0a-3011-48f4-9373-2223670e74aa req-a87980b4-8124-4337-a0f0-118914baafa3 service nova] Acquiring lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:50:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-af1c5a0a-3011-48f4-9373-2223670e74aa req-a87980b4-8124-4337-a0f0-118914baafa3 service nova] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:50:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-af1c5a0a-3011-48f4-9373-2223670e74aa req-a87980b4-8124-4337-a0f0-118914baafa3 service nova] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:50:38 user nova-compute[72444]: DEBUG nova.compute.manager [req-af1c5a0a-3011-48f4-9373-2223670e74aa req-a87980b4-8124-4337-a0f0-118914baafa3 service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] No waiting events found dispatching network-vif-unplugged-841a11a2-ffb3-44cf-9e15-c8099578d405 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:50:38 user nova-compute[72444]: DEBUG nova.compute.manager [req-af1c5a0a-3011-48f4-9373-2223670e74aa req-a87980b4-8124-4337-a0f0-118914baafa3 service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Received event network-vif-unplugged-841a11a2-ffb3-44cf-9e15-c8099578d405 for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:50:39 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Instance destroyed successfully.
Aug 03 04:50:39 user nova-compute[72444]: DEBUG nova.objects.instance [None req-b70f55e2-3925-4414-a187-b9e386cebf1b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lazy-loading 'resources' on Instance uuid 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:50:39 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-b70f55e2-3925-4414-a187-b9e386cebf1b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1937092257',display_name='tempest-AttachVolumeTestJSON-server-1937092257',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1937092257',id=8,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4GYonfRcDLCfzVaxO6+Z3h0SUoVfhhQmBtRpHMqljFVb2ikupLBIuKrpUkeWbdkWIlD6P8Fdx/ixyrvXF+8nK0TaaJy2ZUXJb0m3JpcoPOM4+0nQ1vkeu15aXRWeoGNg==',key_name='tempest-keypair-142269823',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:41:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a65efd00e0ac4039bf1d6429787b8595',ramdisk_id='',reservation_id='r-gcoy75p0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1814863301',owner_user_name='tempest-AttachVolumeTestJSON-1814863301-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:48:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e44603a26afa49098e76422420c825c2',uuid=7daab2c6-8768-46ed-a7bb-0ffbd107cf82,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "841a11a2-ffb3-44cf-9e15-c8099578d405", "address": "fa:16:3e:12:4d:37", "network": {"id": "628fbd1c-7104-4911-9eb9-1f38c394bebd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-366258398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a65efd00e0ac4039bf1d6429787b8595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841a11a2-ff", "ovs_interfaceid": "841a11a2-ffb3-44cf-9e15-c8099578d405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:50:39 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-b70f55e2-3925-4414-a187-b9e386cebf1b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Converting VIF {"id": "841a11a2-ffb3-44cf-9e15-c8099578d405", "address": "fa:16:3e:12:4d:37", "network": {"id": "628fbd1c-7104-4911-9eb9-1f38c394bebd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-366258398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a65efd00e0ac4039bf1d6429787b8595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841a11a2-ff", "ovs_interfaceid": "841a11a2-ffb3-44cf-9e15-c8099578d405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:50:39 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-b70f55e2-3925-4414-a187-b9e386cebf1b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:4d:37,bridge_name='br-int',has_traffic_filtering=True,id=841a11a2-ffb3-44cf-9e15-c8099578d405,network=Network(628fbd1c-7104-4911-9eb9-1f38c394bebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841a11a2-ff') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:50:39 user nova-compute[72444]: DEBUG os_vif [None req-b70f55e2-3925-4414-a187-b9e386cebf1b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:4d:37,bridge_name='br-int',has_traffic_filtering=True,id=841a11a2-ffb3-44cf-9e15-c8099578d405,network=Network(628fbd1c-7104-4911-9eb9-1f38c394bebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841a11a2-ff') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:50:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap841a11a2-ff, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:50:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:39 user nova-compute[72444]: INFO os_vif [None req-b70f55e2-3925-4414-a187-b9e386cebf1b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:4d:37,bridge_name='br-int',has_traffic_filtering=True,id=841a11a2-ffb3-44cf-9e15-c8099578d405,network=Network(628fbd1c-7104-4911-9eb9-1f38c394bebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841a11a2-ff')
Aug 03 04:50:39 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-b70f55e2-3925-4414-a187-b9e386cebf1b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Deleting instance files /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82_del
Aug 03 04:50:39 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-b70f55e2-3925-4414-a187-b9e386cebf1b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Deletion of /opt/stack/data/nova/instances/7daab2c6-8768-46ed-a7bb-0ffbd107cf82_del complete
Aug 03 04:50:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:39 user nova-compute[72444]: INFO nova.compute.manager [None req-b70f55e2-3925-4414-a187-b9e386cebf1b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 03 04:50:39 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-b70f55e2-3925-4414-a187-b9e386cebf1b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 04:50:39 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 04:50:39 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 04:50:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f359d669-bb14-4fa1-b8c8-01c41920381b tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Acquiring lock "bc1913f1-dc7d-40ef-9ab4-83e295135f30" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:50:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f359d669-bb14-4fa1-b8c8-01c41920381b tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Lock "bc1913f1-dc7d-40ef-9ab4-83e295135f30" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:50:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f359d669-bb14-4fa1-b8c8-01c41920381b tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Acquiring lock "bc1913f1-dc7d-40ef-9ab4-83e295135f30-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:50:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f359d669-bb14-4fa1-b8c8-01c41920381b tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Lock "bc1913f1-dc7d-40ef-9ab4-83e295135f30-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:50:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f359d669-bb14-4fa1-b8c8-01c41920381b tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Lock "bc1913f1-dc7d-40ef-9ab4-83e295135f30-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:50:39 user nova-compute[72444]: INFO nova.compute.manager [None req-f359d669-bb14-4fa1-b8c8-01c41920381b tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Terminating instance
Aug 03 04:50:39 user nova-compute[72444]: DEBUG nova.compute.manager [None req-f359d669-bb14-4fa1-b8c8-01c41920381b tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 04:50:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:40 user nova-compute[72444]: DEBUG nova.compute.manager [req-2165b599-39e2-49c9-b672-f0a6392054e3 req-e110f95f-a55f-4d33-8abc-1c118c083125 service nova] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Received event network-vif-unplugged-28c3ac17-8cc0-46b6-83cd-911b8b65665d {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:50:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2165b599-39e2-49c9-b672-f0a6392054e3 req-e110f95f-a55f-4d33-8abc-1c118c083125 service nova] Acquiring lock "bc1913f1-dc7d-40ef-9ab4-83e295135f30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:50:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2165b599-39e2-49c9-b672-f0a6392054e3 req-e110f95f-a55f-4d33-8abc-1c118c083125 service nova] Lock "bc1913f1-dc7d-40ef-9ab4-83e295135f30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:50:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2165b599-39e2-49c9-b672-f0a6392054e3 req-e110f95f-a55f-4d33-8abc-1c118c083125 service nova] Lock "bc1913f1-dc7d-40ef-9ab4-83e295135f30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:50:40 user nova-compute[72444]: DEBUG nova.compute.manager [req-2165b599-39e2-49c9-b672-f0a6392054e3 req-e110f95f-a55f-4d33-8abc-1c118c083125 service nova] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] No waiting events found dispatching network-vif-unplugged-28c3ac17-8cc0-46b6-83cd-911b8b65665d {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:50:40 user nova-compute[72444]: DEBUG nova.compute.manager [req-2165b599-39e2-49c9-b672-f0a6392054e3 req-e110f95f-a55f-4d33-8abc-1c118c083125 service nova] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Received event network-vif-unplugged-28c3ac17-8cc0-46b6-83cd-911b8b65665d for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:50:40 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:50:40 user nova-compute[72444]: DEBUG nova.compute.manager [req-be6604d8-2df6-4d49-97f1-30750efa6b85 req-c1070933-1e05-4864-9691-5ec128af833b service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Received event network-vif-deleted-841a11a2-ffb3-44cf-9e15-c8099578d405 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:50:40 user nova-compute[72444]: INFO nova.compute.manager [req-be6604d8-2df6-4d49-97f1-30750efa6b85 req-c1070933-1e05-4864-9691-5ec128af833b service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Neutron deleted interface 841a11a2-ffb3-44cf-9e15-c8099578d405; detaching it from the instance and deleting it from the info cache
Aug 03 04:50:40 user nova-compute[72444]: DEBUG nova.network.neutron [req-be6604d8-2df6-4d49-97f1-30750efa6b85 req-c1070933-1e05-4864-9691-5ec128af833b service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:50:40 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Took 0.98 seconds to deallocate network for instance.
Aug 03 04:50:40 user nova-compute[72444]: DEBUG nova.compute.manager [req-be6604d8-2df6-4d49-97f1-30750efa6b85 req-c1070933-1e05-4864-9691-5ec128af833b service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Detach interface failed, port_id=841a11a2-ffb3-44cf-9e15-c8099578d405, reason: Instance 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 could not be found. {{(pid=72444) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 03 04:50:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b70f55e2-3925-4414-a187-b9e386cebf1b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:50:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b70f55e2-3925-4414-a187-b9e386cebf1b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:50:40 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Instance destroyed successfully.
Aug 03 04:50:40 user nova-compute[72444]: DEBUG nova.objects.instance [None req-f359d669-bb14-4fa1-b8c8-01c41920381b tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Lazy-loading 'resources' on Instance uuid bc1913f1-dc7d-40ef-9ab4-83e295135f30 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:50:40 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-f359d669-bb14-4fa1-b8c8-01c41920381b tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:48:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-318910725',display_name='tempest-VolumesNegativeTest-instance-318910725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-318910725',id=21,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:48:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac3e9906216f4b84b3fcc344a9b897ff',ramdisk_id='',reservation_id='r-f94o08q0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1019810687',owner_user_name='tempest-VolumesNegativeTest-1019810687-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:48:58Z,user_data=None,user_id='afb9c50fa527465a92b94d11c1e149fd',uuid=bc1913f1-dc7d-40ef-9ab4-83e295135f30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28c3ac17-8cc0-46b6-83cd-911b8b65665d", "address": "fa:16:3e:87:b0:41", "network": {"id": "6f50f871-ca48-46cd-9678-f4358293735b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "50aa3805febd42378b17cc229e7597c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c3ac17-8c", "ovs_interfaceid": "28c3ac17-8cc0-46b6-83cd-911b8b65665d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:50:40 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-f359d669-bb14-4fa1-b8c8-01c41920381b tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Converting VIF {"id": "28c3ac17-8cc0-46b6-83cd-911b8b65665d", "address": "fa:16:3e:87:b0:41", "network": {"id": "6f50f871-ca48-46cd-9678-f4358293735b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "50aa3805febd42378b17cc229e7597c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c3ac17-8c", "ovs_interfaceid": "28c3ac17-8cc0-46b6-83cd-911b8b65665d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:50:40 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-f359d669-bb14-4fa1-b8c8-01c41920381b tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:b0:41,bridge_name='br-int',has_traffic_filtering=True,id=28c3ac17-8cc0-46b6-83cd-911b8b65665d,network=Network(6f50f871-ca48-46cd-9678-f4358293735b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c3ac17-8c') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:50:40 user nova-compute[72444]: DEBUG os_vif [None req-f359d669-bb14-4fa1-b8c8-01c41920381b tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:b0:41,bridge_name='br-int',has_traffic_filtering=True,id=28c3ac17-8cc0-46b6-83cd-911b8b65665d,network=Network(6f50f871-ca48-46cd-9678-f4358293735b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c3ac17-8c') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:50:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28c3ac17-8c, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:50:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:40 user nova-compute[72444]: INFO os_vif [None req-f359d669-bb14-4fa1-b8c8-01c41920381b tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:b0:41,bridge_name='br-int',has_traffic_filtering=True,id=28c3ac17-8cc0-46b6-83cd-911b8b65665d,network=Network(6f50f871-ca48-46cd-9678-f4358293735b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c3ac17-8c')
Aug 03 04:50:40 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-f359d669-bb14-4fa1-b8c8-01c41920381b tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Deleting instance files /opt/stack/data/nova/instances/bc1913f1-dc7d-40ef-9ab4-83e295135f30_del
Aug 03 04:50:40 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-f359d669-bb14-4fa1-b8c8-01c41920381b tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Deletion of /opt/stack/data/nova/instances/bc1913f1-dc7d-40ef-9ab4-83e295135f30_del complete
Aug 03 04:50:40 user nova-compute[72444]: INFO nova.compute.manager [None req-f359d669-bb14-4fa1-b8c8-01c41920381b tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 03 04:50:40 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-f359d669-bb14-4fa1-b8c8-01c41920381b tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 04:50:40 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 04:50:40 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 04:50:40 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-b70f55e2-3925-4414-a187-b9e386cebf1b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:50:40 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-b70f55e2-3925-4414-a187-b9e386cebf1b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:50:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b70f55e2-3925-4414-a187-b9e386cebf1b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.492s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:50:40 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-b70f55e2-3925-4414-a187-b9e386cebf1b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Deleted allocations for instance 7daab2c6-8768-46ed-a7bb-0ffbd107cf82
Aug 03 04:50:40 user nova-compute[72444]: DEBUG nova.compute.manager [req-aee16521-b879-40ea-acba-d463f04997b0 req-ac18f077-608f-48bc-9abd-7a13bf2d6af7 service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Received event network-vif-plugged-841a11a2-ffb3-44cf-9e15-c8099578d405 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:50:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-aee16521-b879-40ea-acba-d463f04997b0 req-ac18f077-608f-48bc-9abd-7a13bf2d6af7 service nova] Acquiring lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:50:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-aee16521-b879-40ea-acba-d463f04997b0 req-ac18f077-608f-48bc-9abd-7a13bf2d6af7 service nova] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:50:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-aee16521-b879-40ea-acba-d463f04997b0 req-ac18f077-608f-48bc-9abd-7a13bf2d6af7 service nova] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:50:40 user nova-compute[72444]: DEBUG nova.compute.manager [req-aee16521-b879-40ea-acba-d463f04997b0 req-ac18f077-608f-48bc-9abd-7a13bf2d6af7 service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] No waiting events found dispatching network-vif-plugged-841a11a2-ffb3-44cf-9e15-c8099578d405 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:50:40 user nova-compute[72444]: WARNING nova.compute.manager [req-aee16521-b879-40ea-acba-d463f04997b0 req-ac18f077-608f-48bc-9abd-7a13bf2d6af7 service nova] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Received unexpected event network-vif-plugged-841a11a2-ffb3-44cf-9e15-c8099578d405 for instance with vm_state deleted and task_state None.
Aug 03 04:50:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b70f55e2-3925-4414-a187-b9e386cebf1b tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "7daab2c6-8768-46ed-a7bb-0ffbd107cf82" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.526s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:50:41 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:50:41 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Took 0.51 seconds to deallocate network for instance.
Aug 03 04:50:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f359d669-bb14-4fa1-b8c8-01c41920381b tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:50:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f359d669-bb14-4fa1-b8c8-01c41920381b tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:50:41 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-f359d669-bb14-4fa1-b8c8-01c41920381b tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:50:41 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-f359d669-bb14-4fa1-b8c8-01c41920381b tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:50:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f359d669-bb14-4fa1-b8c8-01c41920381b tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.400s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:50:41 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-f359d669-bb14-4fa1-b8c8-01c41920381b tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Deleted allocations for instance bc1913f1-dc7d-40ef-9ab4-83e295135f30
Aug 03 04:50:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f359d669-bb14-4fa1-b8c8-01c41920381b tempest-VolumesNegativeTest-1019810687 tempest-VolumesNegativeTest-1019810687-project-member] Lock "bc1913f1-dc7d-40ef-9ab4-83e295135f30" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.993s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:50:42 user nova-compute[72444]: DEBUG nova.compute.manager [req-af24a696-4cca-4bf0-bc33-6c5b6326a365 req-d2a4e680-472f-497e-96f0-6e1cf53bc63f service nova] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Received event network-vif-plugged-28c3ac17-8cc0-46b6-83cd-911b8b65665d {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:50:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-af24a696-4cca-4bf0-bc33-6c5b6326a365 req-d2a4e680-472f-497e-96f0-6e1cf53bc63f service nova] Acquiring lock "bc1913f1-dc7d-40ef-9ab4-83e295135f30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:50:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-af24a696-4cca-4bf0-bc33-6c5b6326a365 req-d2a4e680-472f-497e-96f0-6e1cf53bc63f service nova] Lock "bc1913f1-dc7d-40ef-9ab4-83e295135f30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:50:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-af24a696-4cca-4bf0-bc33-6c5b6326a365 req-d2a4e680-472f-497e-96f0-6e1cf53bc63f service nova] Lock "bc1913f1-dc7d-40ef-9ab4-83e295135f30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:50:42 user nova-compute[72444]: DEBUG nova.compute.manager [req-af24a696-4cca-4bf0-bc33-6c5b6326a365 req-d2a4e680-472f-497e-96f0-6e1cf53bc63f service nova] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] No waiting events found dispatching network-vif-plugged-28c3ac17-8cc0-46b6-83cd-911b8b65665d {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:50:42 user nova-compute[72444]: WARNING nova.compute.manager [req-af24a696-4cca-4bf0-bc33-6c5b6326a365 req-d2a4e680-472f-497e-96f0-6e1cf53bc63f service nova] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Received unexpected event network-vif-plugged-28c3ac17-8cc0-46b6-83cd-911b8b65665d for instance with vm_state deleted and task_state None.
Aug 03 04:50:42 user nova-compute[72444]: DEBUG nova.compute.manager [req-3c8e7828-95ab-42a6-a01a-3d5a027a01fd req-98380f5c-d565-412f-89d9-b0a4b6977adc service nova] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Received event network-vif-deleted-28c3ac17-8cc0-46b6-83cd-911b8b65665d {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:50:43 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:50:44 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:45 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:50:45 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 04:50:46 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:50:46 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:50:46 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:50:47 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:50:49 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:50:49 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:50:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:50:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:50:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:50:49 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 04:50:50 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:50:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-664fb6a8-221c-47fc-bab8-6b19b2a4213c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Acquiring lock "26922d3f-0a2d-48d1-b758-9c87e0621fef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:50:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-664fb6a8-221c-47fc-bab8-6b19b2a4213c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "26922d3f-0a2d-48d1-b758-9c87e0621fef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:50:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-664fb6a8-221c-47fc-bab8-6b19b2a4213c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Acquiring lock "26922d3f-0a2d-48d1-b758-9c87e0621fef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:50:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-664fb6a8-221c-47fc-bab8-6b19b2a4213c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "26922d3f-0a2d-48d1-b758-9c87e0621fef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:50:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-664fb6a8-221c-47fc-bab8-6b19b2a4213c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "26922d3f-0a2d-48d1-b758-9c87e0621fef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:50:50 user nova-compute[72444]: INFO nova.compute.manager [None req-664fb6a8-221c-47fc-bab8-6b19b2a4213c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Terminating instance
Aug 03 04:50:50 user nova-compute[72444]: DEBUG nova.compute.manager [None req-664fb6a8-221c-47fc-bab8-6b19b2a4213c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 04:50:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:50 user nova-compute[72444]: DEBUG nova.compute.manager [req-895118de-9515-4696-b025-f96d77b38f46 req-4cb92b23-23be-4517-9691-77708711f579 service nova] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Received event network-vif-unplugged-9e663e87-4907-4b83-9c78-22674d4fe471 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:50:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-895118de-9515-4696-b025-f96d77b38f46 req-4cb92b23-23be-4517-9691-77708711f579 service nova] Acquiring lock "26922d3f-0a2d-48d1-b758-9c87e0621fef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:50:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-895118de-9515-4696-b025-f96d77b38f46 req-4cb92b23-23be-4517-9691-77708711f579 service nova] Lock "26922d3f-0a2d-48d1-b758-9c87e0621fef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:50:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-895118de-9515-4696-b025-f96d77b38f46 req-4cb92b23-23be-4517-9691-77708711f579 service nova] Lock "26922d3f-0a2d-48d1-b758-9c87e0621fef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:50:50 user nova-compute[72444]: DEBUG nova.compute.manager [req-895118de-9515-4696-b025-f96d77b38f46 req-4cb92b23-23be-4517-9691-77708711f579 service nova] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] No waiting events found dispatching network-vif-unplugged-9e663e87-4907-4b83-9c78-22674d4fe471 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:50:50 user nova-compute[72444]: DEBUG nova.compute.manager [req-895118de-9515-4696-b025-f96d77b38f46 req-4cb92b23-23be-4517-9691-77708711f579 service nova] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Received event network-vif-unplugged-9e663e87-4907-4b83-9c78-22674d4fe471 for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:50:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:51 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Instance destroyed successfully.
Aug 03 04:50:51 user nova-compute[72444]: DEBUG nova.objects.instance [None req-664fb6a8-221c-47fc-bab8-6b19b2a4213c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lazy-loading 'resources' on Instance uuid 26922d3f-0a2d-48d1-b758-9c87e0621fef {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:50:51 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-664fb6a8-221c-47fc-bab8-6b19b2a4213c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:44:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2040565375',display_name='tempest-VolumesAdminNegativeTest-server-2040565375',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2040565375',id=17,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdnQBQ6jPTeRUPqgJe8hMG5Ws5rQcF1uzQvFAptSxcvaVQ3UUFvTYe6M9LbXKTouVc7FFElaEDinh19e5u1wM6o14vTZU7VEDdz86mX7HmHRIsKxyR7VJ9BEO7p5bzroA==',key_name='tempest-keypair-596854044',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:45:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ccbd62645f54327a2b8999dcd9736ce',ramdisk_id='',reservation_id='r-w8lq7oyo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1069854833',owner_user_name='tempest-VolumesAdminNegativeTest-1069854833-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:45:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d998191ef0943ed95ba213e84d87bdc',uuid=26922d3f-0a2d-48d1-b758-9c87e0621fef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e663e87-4907-4b83-9c78-22674d4fe471", "address": "fa:16:3e:c9:2c:bd", "network": {"id": "dc891e23-2b3b-44ae-8110-60fe01fe5e24", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1956899419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ccbd62645f54327a2b8999dcd9736ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e663e87-49", "ovs_interfaceid": "9e663e87-4907-4b83-9c78-22674d4fe471", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:50:51 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-664fb6a8-221c-47fc-bab8-6b19b2a4213c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Converting VIF {"id": "9e663e87-4907-4b83-9c78-22674d4fe471", "address": "fa:16:3e:c9:2c:bd", "network": {"id": "dc891e23-2b3b-44ae-8110-60fe01fe5e24", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1956899419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ccbd62645f54327a2b8999dcd9736ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e663e87-49", "ovs_interfaceid": "9e663e87-4907-4b83-9c78-22674d4fe471", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:50:51 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-664fb6a8-221c-47fc-bab8-6b19b2a4213c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:2c:bd,bridge_name='br-int',has_traffic_filtering=True,id=9e663e87-4907-4b83-9c78-22674d4fe471,network=Network(dc891e23-2b3b-44ae-8110-60fe01fe5e24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e663e87-49') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:50:51 user nova-compute[72444]: DEBUG os_vif [None req-664fb6a8-221c-47fc-bab8-6b19b2a4213c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:2c:bd,bridge_name='br-int',has_traffic_filtering=True,id=9e663e87-4907-4b83-9c78-22674d4fe471,network=Network(dc891e23-2b3b-44ae-8110-60fe01fe5e24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e663e87-49') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:50:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e663e87-49, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:50:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:50:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:50:51 user nova-compute[72444]: INFO os_vif [None req-664fb6a8-221c-47fc-bab8-6b19b2a4213c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:2c:bd,bridge_name='br-int',has_traffic_filtering=True,id=9e663e87-4907-4b83-9c78-22674d4fe471,network=Network(dc891e23-2b3b-44ae-8110-60fe01fe5e24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e663e87-49')
Aug 03 04:50:51 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-664fb6a8-221c-47fc-bab8-6b19b2a4213c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Deleting instance files /opt/stack/data/nova/instances/26922d3f-0a2d-48d1-b758-9c87e0621fef_del
Aug 03 04:50:51 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-664fb6a8-221c-47fc-bab8-6b19b2a4213c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Deletion of /opt/stack/data/nova/instances/26922d3f-0a2d-48d1-b758-9c87e0621fef_del complete
Aug 03 04:50:51 user nova-compute[72444]: INFO nova.compute.manager [None req-664fb6a8-221c-47fc-bab8-6b19b2a4213c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 03 04:50:51 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-664fb6a8-221c-47fc-bab8-6b19b2a4213c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 04:50:51 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 04:50:51 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 04:50:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:51 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:50:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1baadfd2-6f00-436b-b3a0-c850cd8cb50e/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1baadfd2-6f00-436b-b3a0-c850cd8cb50e/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1baadfd2-6f00-436b-b3a0-c850cd8cb50e/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1baadfd2-6f00-436b-b3a0-c850cd8cb50e/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:52 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:50:52 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:50:52 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:50:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:52 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:50:52 user nova-compute[72444]: DEBUG nova.compute.manager [req-627d2461-4db9-446f-82af-fd760f0348ae req-cc36872f-980e-41eb-b5c1-5d771508bec8 service nova] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Received event network-vif-deleted-9e663e87-4907-4b83-9c78-22674d4fe471 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:50:52 user nova-compute[72444]: INFO nova.compute.manager [req-627d2461-4db9-446f-82af-fd760f0348ae req-cc36872f-980e-41eb-b5c1-5d771508bec8 service nova] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Neutron deleted interface 9e663e87-4907-4b83-9c78-22674d4fe471; detaching it from the instance and deleting it from the info cache
Aug 03 04:50:52 user nova-compute[72444]: DEBUG nova.network.neutron [req-627d2461-4db9-446f-82af-fd760f0348ae req-cc36872f-980e-41eb-b5c1-5d771508bec8 service nova] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:50:52 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Took 1.34 seconds to deallocate network for instance.
Aug 03 04:50:52 user nova-compute[72444]: DEBUG nova.compute.manager [req-627d2461-4db9-446f-82af-fd760f0348ae req-cc36872f-980e-41eb-b5c1-5d771508bec8 service nova] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Detach interface failed, port_id=9e663e87-4907-4b83-9c78-22674d4fe471, reason: Instance 26922d3f-0a2d-48d1-b758-9c87e0621fef could not be found. {{(pid=72444) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 03 04:50:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-664fb6a8-221c-47fc-bab8-6b19b2a4213c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:50:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-664fb6a8-221c-47fc-bab8-6b19b2a4213c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:50:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:50:52 user nova-compute[72444]: DEBUG nova.compute.manager [req-60f41986-6080-45d2-b892-fbf04678be2f req-03cea615-3740-40f9-9671-64d32a58b6b3 service nova] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Received event network-vif-plugged-9e663e87-4907-4b83-9c78-22674d4fe471 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:50:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-60f41986-6080-45d2-b892-fbf04678be2f req-03cea615-3740-40f9-9671-64d32a58b6b3 service nova] Acquiring lock "26922d3f-0a2d-48d1-b758-9c87e0621fef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:50:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-60f41986-6080-45d2-b892-fbf04678be2f req-03cea615-3740-40f9-9671-64d32a58b6b3 service nova] Lock "26922d3f-0a2d-48d1-b758-9c87e0621fef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:50:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-60f41986-6080-45d2-b892-fbf04678be2f req-03cea615-3740-40f9-9671-64d32a58b6b3 service nova] Lock "26922d3f-0a2d-48d1-b758-9c87e0621fef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:50:52 user nova-compute[72444]: DEBUG nova.compute.manager [req-60f41986-6080-45d2-b892-fbf04678be2f req-03cea615-3740-40f9-9671-64d32a58b6b3 service nova] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] No waiting events found dispatching network-vif-plugged-9e663e87-4907-4b83-9c78-22674d4fe471 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:50:52 user nova-compute[72444]: WARNING nova.compute.manager [req-60f41986-6080-45d2-b892-fbf04678be2f req-03cea615-3740-40f9-9671-64d32a58b6b3 service nova] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Received unexpected event network-vif-plugged-9e663e87-4907-4b83-9c78-22674d4fe471 for instance with vm_state deleted and task_state None.
Aug 03 04:50:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:50:52 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Error from libvirt while getting description of instance-00000011: [Error Code 42] Domain not found: no domain with matching uuid '26922d3f-0a2d-48d1-b758-9c87e0621fef' (instance-00000011): libvirt.libvirtError: Domain not found: no domain with matching uuid '26922d3f-0a2d-48d1-b758-9c87e0621fef' (instance-00000011)
Aug 03 04:50:53 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:50:53 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:50:53 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=6965MB free_disk=25.56167221069336GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 04:50:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:50:53 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-664fb6a8-221c-47fc-bab8-6b19b2a4213c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:50:53 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-664fb6a8-221c-47fc-bab8-6b19b2a4213c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:50:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-664fb6a8-221c-47fc-bab8-6b19b2a4213c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.949s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:50:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.218s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:50:53 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-664fb6a8-221c-47fc-bab8-6b19b2a4213c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Deleted allocations for instance 26922d3f-0a2d-48d1-b758-9c87e0621fef
Aug 03 04:50:53 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:50:53 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 81725845-6158-4e34-bedb-6e41219bc227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:50:53 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance b6ed9c42-fa6e-4a0d-8312-588471e157f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:50:53 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance e2859322-6f99-442d-bee1-65fe49ce6360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:50:53 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:50:53 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 1baadfd2-6f00-436b-b3a0-c850cd8cb50e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:50:53 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:50:53 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 0b219bf3-a3b6-44b5-946e-c10e7498e1d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:50:53 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance c77e96da-6411-4ae9-af05-8e9bb3c432c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:50:53 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance c4af22f7-45f8-4777-83ee-5cf1481c9fe8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:50:53 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance c94f537a-b1a1-4cea-996d-e1a88a2c9dac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:50:53 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 04:50:53 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 04:50:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-664fb6a8-221c-47fc-bab8-6b19b2a4213c tempest-VolumesAdminNegativeTest-1069854833 tempest-VolumesAdminNegativeTest-1069854833-project-member] Lock "26922d3f-0a2d-48d1-b758-9c87e0621fef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.464s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:50:54 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:50:54 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:50:54 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691038239.1925998, 7daab2c6-8768-46ed-a7bb-0ffbd107cf82 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:50:54 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] VM Stopped (Lifecycle Event)
Aug 03 04:50:54 user nova-compute[72444]: DEBUG nova.compute.manager [None req-e334fb0d-0e32-49ec-bad8-cb43dddc2993 None None] [instance: 7daab2c6-8768-46ed-a7bb-0ffbd107cf82] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:50:54 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 04:50:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.511s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:50:55 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:50:55 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:50:55 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 04:50:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-81725845-6158-4e34-bedb-6e41219bc227" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:50:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-81725845-6158-4e34-bedb-6e41219bc227" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:50:55 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 04:50:55 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691038240.5475173, bc1913f1-dc7d-40ef-9ab4-83e295135f30 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:50:55 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] VM Stopped (Lifecycle Event)
Aug 03 04:50:55 user nova-compute[72444]: DEBUG nova.compute.manager [None req-e6001641-7525-4b5f-b8ed-b4948faa562a None None] [instance: bc1913f1-dc7d-40ef-9ab4-83e295135f30] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:50:55 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Updating instance_info_cache with network_info: [{"id": "9b1b9675-c2df-4b16-ba94-807765bab119", "address": "fa:16:3e:e6:7a:2e", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b1b9675-c2", "ovs_interfaceid": "9b1b9675-c2df-4b16-ba94-807765bab119", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:50:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-81725845-6158-4e34-bedb-6e41219bc227" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:50:55 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 04:50:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:51:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 04:51:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 04:51:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 04:51:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:06 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691038251.1664064, 26922d3f-0a2d-48d1-b758-9c87e0621fef => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:51:06 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] VM Stopped (Lifecycle Event)
Aug 03 04:51:06 user nova-compute[72444]: DEBUG nova.compute.manager [None req-46016144-0203-48a1-a15a-8c430df24463 None None] [instance: 26922d3f-0a2d-48d1-b758-9c87e0621fef] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:51:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:06 user nova-compute[72444]: DEBUG nova.compute.manager [req-f7580aae-6832-44a5-926a-234b2aac4251 req-d78da793-627c-4254-b560-a39fb144a2f8 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-changed-0b5e2297-6ab0-4965-a202-3f36a81e5646 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:51:06 user nova-compute[72444]: DEBUG nova.compute.manager [req-f7580aae-6832-44a5-926a-234b2aac4251 req-d78da793-627c-4254-b560-a39fb144a2f8 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Refreshing instance network info cache due to event network-changed-0b5e2297-6ab0-4965-a202-3f36a81e5646. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:51:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f7580aae-6832-44a5-926a-234b2aac4251 req-d78da793-627c-4254-b560-a39fb144a2f8 service nova] Acquiring lock "refresh_cache-6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:51:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f7580aae-6832-44a5-926a-234b2aac4251 req-d78da793-627c-4254-b560-a39fb144a2f8 service nova] Acquired lock "refresh_cache-6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:51:06 user nova-compute[72444]: DEBUG nova.network.neutron [req-f7580aae-6832-44a5-926a-234b2aac4251 req-d78da793-627c-4254-b560-a39fb144a2f8 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Refreshing network info cache for port 0b5e2297-6ab0-4965-a202-3f36a81e5646 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:51:06 user nova-compute[72444]: DEBUG nova.compute.manager [None req-612d5dbc-f9e9-4449-bdb3-2428b189b97e tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:51:06 user nova-compute[72444]: INFO nova.compute.manager [None req-612d5dbc-f9e9-4449-bdb3-2428b189b97e tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] instance snapshotting
Aug 03 04:51:06 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-612d5dbc-f9e9-4449-bdb3-2428b189b97e tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Beginning live snapshot process
Aug 03 04:51:06 user nova-compute[72444]: DEBUG nova.network.neutron [req-f7580aae-6832-44a5-926a-234b2aac4251 req-d78da793-627c-4254-b560-a39fb144a2f8 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Updated VIF entry in instance network info cache for port 0b5e2297-6ab0-4965-a202-3f36a81e5646. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:51:06 user nova-compute[72444]: DEBUG nova.network.neutron [req-f7580aae-6832-44a5-926a-234b2aac4251 req-d78da793-627c-4254-b560-a39fb144a2f8 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Updating instance_info_cache with network_info: [{"id": "0b5e2297-6ab0-4965-a202-3f36a81e5646", "address": "fa:16:3e:2f:06:86", "network": {"id": "68729275-1a5f-4087-a6ca-34c6b674ecfd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-45954298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b5e2297-6a", "ovs_interfaceid": "0b5e2297-6ab0-4965-a202-3f36a81e5646", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0819cee-25ca-4271-aca3-47125f12360b", "address": "fa:16:3e:87:4b:ea", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0819cee-25", "ovs_interfaceid": "a0819cee-25ca-4271-aca3-47125f12360b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "36cd0894-4081-4d21-870e-3d635e0ed9c4", "address": "fa:16:3e:24:83:27", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36cd0894-40", "ovs_interfaceid": "36cd0894-4081-4d21-870e-3d635e0ed9c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "88715119-aa32-4ad2-8c22-8188ee7a1a1f", "address": "fa:16:3e:3d:c8:82", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88715119-aa", "ovs_interfaceid": "88715119-aa32-4ad2-8c22-8188ee7a1a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab45da29-a935-4aa8-9a10-1793ddbc7ab1", "address": "fa:16:3e:e2:8b:4d", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab45da29-a9", "ovs_interfaceid": "ab45da29-a935-4aa8-9a10-1793ddbc7ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b540799-a36a-4b46-a678-53a6db44477a", "address": "fa:16:3e:f0:75:b6", "network": {"id": "0f0a5fa7-1d9d-47a5-9dac-416467b65d29", "bridge": "br-int", "label": "tempest-device-tagging-net2-1543847764", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b540799-a3", "ovs_interfaceid": "4b540799-a36a-4b46-a678-53a6db44477a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0290730e-648d-44ba-b03b-53918307a717", "address": "fa:16:3e:9a:c6:30", "network": {"id": "0f0a5fa7-1d9d-47a5-9dac-416467b65d29", "bridge": "br-int", "label": "tempest-device-tagging-net2-1543847764", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0290730e-64", "ovs_interfaceid": "0290730e-648d-44ba-b03b-53918307a717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:51:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f7580aae-6832-44a5-926a-234b2aac4251 req-d78da793-627c-4254-b560-a39fb144a2f8 service nova] Releasing lock "refresh_cache-6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:51:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-612d5dbc-f9e9-4449-bdb3-2428b189b97e tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json -f qcow2 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-612d5dbc-f9e9-4449-bdb3-2428b189b97e tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json -f qcow2" returned: 0 in 0.135s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-612d5dbc-f9e9-4449-bdb3-2428b189b97e tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json -f qcow2 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-612d5dbc-f9e9-4449-bdb3-2428b189b97e tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json -f qcow2" returned: 0 in 0.153s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-612d5dbc-f9e9-4449-bdb3-2428b189b97e tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-612d5dbc-f9e9-4449-bdb3-2428b189b97e tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.142s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-612d5dbc-f9e9-4449-bdb3-2428b189b97e tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpaz7yk2yb/8d9f2125b83c44bbb6efd5a995e6d61a.delta 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-612d5dbc-f9e9-4449-bdb3-2428b189b97e tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpaz7yk2yb/8d9f2125b83c44bbb6efd5a995e6d61a.delta 1073741824" returned: 0 in 0.047s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:07 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-612d5dbc-f9e9-4449-bdb3-2428b189b97e tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 03 04:51:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e702bebd-5acb-4b82-afbf-f727d908c46e tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Acquiring lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e702bebd-5acb-4b82-afbf-f727d908c46e tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e702bebd-5acb-4b82-afbf-f727d908c46e tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Acquiring lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e702bebd-5acb-4b82-afbf-f727d908c46e tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e702bebd-5acb-4b82-afbf-f727d908c46e tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:07 user nova-compute[72444]: INFO nova.compute.manager [None req-e702bebd-5acb-4b82-afbf-f727d908c46e tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Terminating instance
Aug 03 04:51:07 user nova-compute[72444]: DEBUG nova.compute.manager [None req-e702bebd-5acb-4b82-afbf-f727d908c46e tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 04:51:07 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:07 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:07 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:07 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:08 user nova-compute[72444]: DEBUG nova.compute.manager [req-75cb0653-2908-4315-b3d8-699c62629780 req-e4bb00d6-5066-4ad7-8918-9799fc0ffffd service nova] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Received event network-vif-unplugged-2f55f137-3b34-49a7-a77c-e03f9c263c43 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:51:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-75cb0653-2908-4315-b3d8-699c62629780 req-e4bb00d6-5066-4ad7-8918-9799fc0ffffd service nova] Acquiring lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-75cb0653-2908-4315-b3d8-699c62629780 req-e4bb00d6-5066-4ad7-8918-9799fc0ffffd service nova] Lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-75cb0653-2908-4315-b3d8-699c62629780 req-e4bb00d6-5066-4ad7-8918-9799fc0ffffd service nova] Lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:08 user nova-compute[72444]: DEBUG nova.compute.manager [req-75cb0653-2908-4315-b3d8-699c62629780 req-e4bb00d6-5066-4ad7-8918-9799fc0ffffd service nova] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] No waiting events found dispatching network-vif-unplugged-2f55f137-3b34-49a7-a77c-e03f9c263c43 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:51:08 user nova-compute[72444]: DEBUG nova.compute.manager [req-75cb0653-2908-4315-b3d8-699c62629780 req-e4bb00d6-5066-4ad7-8918-9799fc0ffffd service nova] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Received event network-vif-unplugged-2f55f137-3b34-49a7-a77c-e03f9c263c43 for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:51:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-612d5dbc-f9e9-4449-bdb3-2428b189b97e tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72444) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 03 04:51:08 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Instance destroyed successfully.
Aug 03 04:51:08 user nova-compute[72444]: DEBUG nova.objects.instance [None req-e702bebd-5acb-4b82-afbf-f727d908c46e tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lazy-loading 'resources' on Instance uuid 1baadfd2-6f00-436b-b3a0-c850cd8cb50e {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:51:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-e702bebd-5acb-4b82-afbf-f727d908c46e tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1795304975',display_name='tempest-TestServerVolumeAttachmentScenario-server-1795304975',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1795304975',id=19,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcIeWQ23qVXo8uHBHWnIULq/798lNFk4fXZB1/+eSMAsA9mwaVg2e6zTvNvK4YJBidbB08SWCZsgGxqJ3sFMO2d02iw85yUmRreVMcUeZ2B+crihthXQdW4rtFyXsAMFA==',key_name='tempest-keypair-1894885333',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:47:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='256e3a45110d4bc683f3a9b6c250e522',ramdisk_id='',reservation_id='r-ysranctw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-511083576',owner_user_name='tempest-TestServerVolumeAttachmentScenario-511083576-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:47:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32bdd12ab0a24dc8a73dfa25cd5ff897',uuid=1baadfd2-6f00-436b-b3a0-c850cd8cb50e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f55f137-3b34-49a7-a77c-e03f9c263c43", "address": "fa:16:3e:cc:5c:79", "network": {"id": "66fcf59b-a2bc-4a34-a881-bf1534ba9e3f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1260837866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256e3a45110d4bc683f3a9b6c250e522", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f55f137-3b", "ovs_interfaceid": "2f55f137-3b34-49a7-a77c-e03f9c263c43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:51:08 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e702bebd-5acb-4b82-afbf-f727d908c46e tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Converting VIF {"id": "2f55f137-3b34-49a7-a77c-e03f9c263c43", "address": "fa:16:3e:cc:5c:79", "network": {"id": "66fcf59b-a2bc-4a34-a881-bf1534ba9e3f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1260837866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "256e3a45110d4bc683f3a9b6c250e522", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f55f137-3b", "ovs_interfaceid": "2f55f137-3b34-49a7-a77c-e03f9c263c43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:51:08 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e702bebd-5acb-4b82-afbf-f727d908c46e tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:5c:79,bridge_name='br-int',has_traffic_filtering=True,id=2f55f137-3b34-49a7-a77c-e03f9c263c43,network=Network(66fcf59b-a2bc-4a34-a881-bf1534ba9e3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f55f137-3b') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:51:08 user nova-compute[72444]: DEBUG os_vif [None req-e702bebd-5acb-4b82-afbf-f727d908c46e tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:5c:79,bridge_name='br-int',has_traffic_filtering=True,id=2f55f137-3b34-49a7-a77c-e03f9c263c43,network=Network(66fcf59b-a2bc-4a34-a881-bf1534ba9e3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f55f137-3b') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:51:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f55f137-3b, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:51:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:51:08 user nova-compute[72444]: INFO os_vif [None req-e702bebd-5acb-4b82-afbf-f727d908c46e tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:5c:79,bridge_name='br-int',has_traffic_filtering=True,id=2f55f137-3b34-49a7-a77c-e03f9c263c43,network=Network(66fcf59b-a2bc-4a34-a881-bf1534ba9e3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f55f137-3b')
Aug 03 04:51:08 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-e702bebd-5acb-4b82-afbf-f727d908c46e tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Deleting instance files /opt/stack/data/nova/instances/1baadfd2-6f00-436b-b3a0-c850cd8cb50e_del
Aug 03 04:51:08 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-e702bebd-5acb-4b82-afbf-f727d908c46e tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Deletion of /opt/stack/data/nova/instances/1baadfd2-6f00-436b-b3a0-c850cd8cb50e_del complete
Aug 03 04:51:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-612d5dbc-f9e9-4449-bdb3-2428b189b97e tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] COPY block job progress, current cursor: 75169792 final cursor: 75497472 {{(pid=72444) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 03 04:51:08 user nova-compute[72444]: INFO nova.compute.manager [None req-e702bebd-5acb-4b82-afbf-f727d908c46e tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Took 1.31 seconds to destroy the instance on the hypervisor.
Aug 03 04:51:08 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-e702bebd-5acb-4b82-afbf-f727d908c46e tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 04:51:08 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 04:51:08 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 04:51:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Acquiring lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Acquiring lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:09 user nova-compute[72444]: INFO nova.compute.manager [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Terminating instance
Aug 03 04:51:09 user nova-compute[72444]: DEBUG nova.compute.manager [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 04:51:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-612d5dbc-f9e9-4449-bdb3-2428b189b97e tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72444) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 03 04:51:09 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-612d5dbc-f9e9-4449-bdb3-2428b189b97e tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 03 04:51:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:09 user nova-compute[72444]: DEBUG nova.privsep.utils [None req-612d5dbc-f9e9-4449-bdb3-2428b189b97e tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72444) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 03 04:51:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-612d5dbc-f9e9-4449-bdb3-2428b189b97e tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpaz7yk2yb/8d9f2125b83c44bbb6efd5a995e6d61a.delta /opt/stack/data/nova/instances/snapshots/tmpaz7yk2yb/8d9f2125b83c44bbb6efd5a995e6d61a {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:10 user nova-compute[72444]: DEBUG nova.compute.manager [req-bc89af1e-22d0-4395-be00-d156ed4d9e79 req-dcde20a7-f838-425d-a9e3-6941e9b9fe0b service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-unplugged-88715119-aa32-4ad2-8c22-8188ee7a1a1f {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:51:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-bc89af1e-22d0-4395-be00-d156ed4d9e79 req-dcde20a7-f838-425d-a9e3-6941e9b9fe0b service nova] Acquiring lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-bc89af1e-22d0-4395-be00-d156ed4d9e79 req-dcde20a7-f838-425d-a9e3-6941e9b9fe0b service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-bc89af1e-22d0-4395-be00-d156ed4d9e79 req-dcde20a7-f838-425d-a9e3-6941e9b9fe0b service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:10 user nova-compute[72444]: DEBUG nova.compute.manager [req-bc89af1e-22d0-4395-be00-d156ed4d9e79 req-dcde20a7-f838-425d-a9e3-6941e9b9fe0b service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] No waiting events found dispatching network-vif-unplugged-88715119-aa32-4ad2-8c22-8188ee7a1a1f {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:51:10 user nova-compute[72444]: DEBUG nova.compute.manager [req-bc89af1e-22d0-4395-be00-d156ed4d9e79 req-dcde20a7-f838-425d-a9e3-6941e9b9fe0b service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-unplugged-88715119-aa32-4ad2-8c22-8188ee7a1a1f for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:51:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:10 user nova-compute[72444]: DEBUG nova.compute.manager [req-19141b32-9ee0-4479-8b17-d47f93b2f96e req-b3c078b8-9cbb-4763-bfb6-304ad9666f23 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-unplugged-0b5e2297-6ab0-4965-a202-3f36a81e5646 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:51:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-19141b32-9ee0-4479-8b17-d47f93b2f96e req-b3c078b8-9cbb-4763-bfb6-304ad9666f23 service nova] Acquiring lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-19141b32-9ee0-4479-8b17-d47f93b2f96e req-b3c078b8-9cbb-4763-bfb6-304ad9666f23 service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-19141b32-9ee0-4479-8b17-d47f93b2f96e req-b3c078b8-9cbb-4763-bfb6-304ad9666f23 service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:10 user nova-compute[72444]: DEBUG nova.compute.manager [req-19141b32-9ee0-4479-8b17-d47f93b2f96e req-b3c078b8-9cbb-4763-bfb6-304ad9666f23 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] No waiting events found dispatching network-vif-unplugged-0b5e2297-6ab0-4965-a202-3f36a81e5646 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:51:10 user nova-compute[72444]: DEBUG nova.compute.manager [req-19141b32-9ee0-4479-8b17-d47f93b2f96e req-b3c078b8-9cbb-4763-bfb6-304ad9666f23 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-unplugged-0b5e2297-6ab0-4965-a202-3f36a81e5646 for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:51:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:10 user nova-compute[72444]: DEBUG nova.compute.manager [req-8a9b119f-a2b5-4fa7-9bda-f47a9feff44d req-654ed26b-d5f8-426a-84e4-27c6f9d90160 service nova] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Received event network-vif-plugged-2f55f137-3b34-49a7-a77c-e03f9c263c43 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:51:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8a9b119f-a2b5-4fa7-9bda-f47a9feff44d req-654ed26b-d5f8-426a-84e4-27c6f9d90160 service nova] Acquiring lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8a9b119f-a2b5-4fa7-9bda-f47a9feff44d req-654ed26b-d5f8-426a-84e4-27c6f9d90160 service nova] Lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8a9b119f-a2b5-4fa7-9bda-f47a9feff44d req-654ed26b-d5f8-426a-84e4-27c6f9d90160 service nova] Lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:10 user nova-compute[72444]: DEBUG nova.compute.manager [req-8a9b119f-a2b5-4fa7-9bda-f47a9feff44d req-654ed26b-d5f8-426a-84e4-27c6f9d90160 service nova] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] No waiting events found dispatching network-vif-plugged-2f55f137-3b34-49a7-a77c-e03f9c263c43 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:51:10 user nova-compute[72444]: WARNING nova.compute.manager [req-8a9b119f-a2b5-4fa7-9bda-f47a9feff44d req-654ed26b-d5f8-426a-84e4-27c6f9d90160 service nova] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Received unexpected event network-vif-plugged-2f55f137-3b34-49a7-a77c-e03f9c263c43 for instance with vm_state active and task_state deleting.
Aug 03 04:51:10 user nova-compute[72444]: DEBUG nova.compute.manager [req-8a9b119f-a2b5-4fa7-9bda-f47a9feff44d req-654ed26b-d5f8-426a-84e4-27c6f9d90160 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-unplugged-36cd0894-4081-4d21-870e-3d635e0ed9c4 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:51:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8a9b119f-a2b5-4fa7-9bda-f47a9feff44d req-654ed26b-d5f8-426a-84e4-27c6f9d90160 service nova] Acquiring lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8a9b119f-a2b5-4fa7-9bda-f47a9feff44d req-654ed26b-d5f8-426a-84e4-27c6f9d90160 service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8a9b119f-a2b5-4fa7-9bda-f47a9feff44d req-654ed26b-d5f8-426a-84e4-27c6f9d90160 service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:10 user nova-compute[72444]: DEBUG nova.compute.manager [req-8a9b119f-a2b5-4fa7-9bda-f47a9feff44d req-654ed26b-d5f8-426a-84e4-27c6f9d90160 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] No waiting events found dispatching network-vif-unplugged-36cd0894-4081-4d21-870e-3d635e0ed9c4 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:51:10 user nova-compute[72444]: DEBUG nova.compute.manager [req-8a9b119f-a2b5-4fa7-9bda-f47a9feff44d req-654ed26b-d5f8-426a-84e4-27c6f9d90160 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-unplugged-36cd0894-4081-4d21-870e-3d635e0ed9c4 for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:51:10 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-612d5dbc-f9e9-4449-bdb3-2428b189b97e tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpaz7yk2yb/8d9f2125b83c44bbb6efd5a995e6d61a.delta /opt/stack/data/nova/instances/snapshots/tmpaz7yk2yb/8d9f2125b83c44bbb6efd5a995e6d61a" returned: 0 in 0.674s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:10 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-612d5dbc-f9e9-4449-bdb3-2428b189b97e tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Snapshot extracted, beginning image upload
Aug 03 04:51:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:51:11 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Took 2.29 seconds to deallocate network for instance.
Aug 03 04:51:11 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Instance destroyed successfully.
Aug 03 04:51:11 user nova-compute[72444]: DEBUG nova.objects.instance [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Lazy-loading 'resources' on Instance uuid 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:49:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236579212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236579212',id=22,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGMQcHG8oBit3ZUG9qTovtEpNiUBS2ZhjNnojHDQeFgdbWAPBuSR0LSZUYTSmF0zzTn7tLY0Fsf0QF8KnuY50DVRY4YVIZckuRFGNQHAugbtlsN9Zb4BFepLTdj/uAGHQ==',key_name='tempest-keypair-1563763870',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:49:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1996f0a97dc84be4906a638ee6e19b19',ramdisk_id='',reservation_id='r-w4whabm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1365843340',owner_user_name='tempest-TaggedBootDevicesTest-1365843340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:49:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d24fc36445c245ff83f65f2a86f4f393',uuid=6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b5e2297-6ab0-4965-a202-3f36a81e5646", "address": "fa:16:3e:2f:06:86", "network": {"id": "68729275-1a5f-4087-a6ca-34c6b674ecfd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-45954298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b5e2297-6a", "ovs_interfaceid": "0b5e2297-6ab0-4965-a202-3f36a81e5646", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converting VIF {"id": "0b5e2297-6ab0-4965-a202-3f36a81e5646", "address": "fa:16:3e:2f:06:86", "network": {"id": "68729275-1a5f-4087-a6ca-34c6b674ecfd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-45954298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b5e2297-6a", "ovs_interfaceid": "0b5e2297-6ab0-4965-a202-3f36a81e5646", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:06:86,bridge_name='br-int',has_traffic_filtering=True,id=0b5e2297-6ab0-4965-a202-3f36a81e5646,network=Network(68729275-1a5f-4087-a6ca-34c6b674ecfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b5e2297-6a') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG os_vif [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:06:86,bridge_name='br-int',has_traffic_filtering=True,id=0b5e2297-6ab0-4965-a202-3f36a81e5646,network=Network(68729275-1a5f-4087-a6ca-34c6b674ecfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b5e2297-6a') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b5e2297-6a, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e702bebd-5acb-4b82-afbf-f727d908c46e tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e702bebd-5acb-4b82-afbf-f727d908c46e tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:11 user nova-compute[72444]: INFO os_vif [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:06:86,bridge_name='br-int',has_traffic_filtering=True,id=0b5e2297-6ab0-4965-a202-3f36a81e5646,network=Network(68729275-1a5f-4087-a6ca-34c6b674ecfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b5e2297-6a')
Aug 03 04:51:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:49:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236579212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236579212',id=22,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGMQcHG8oBit3ZUG9qTovtEpNiUBS2ZhjNnojHDQeFgdbWAPBuSR0LSZUYTSmF0zzTn7tLY0Fsf0QF8KnuY50DVRY4YVIZckuRFGNQHAugbtlsN9Zb4BFepLTdj/uAGHQ==',key_name='tempest-keypair-1563763870',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:49:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1996f0a97dc84be4906a638ee6e19b19',ramdisk_id='',reservation_id='r-w4whabm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1365843340',owner_user_name='tempest-TaggedBootDevicesTest-1365843340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:49:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d24fc36445c245ff83f65f2a86f4f393',uuid=6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0819cee-25ca-4271-aca3-47125f12360b", "address": "fa:16:3e:87:4b:ea", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0819cee-25", "ovs_interfaceid": "a0819cee-25ca-4271-aca3-47125f12360b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converting VIF {"id": "a0819cee-25ca-4271-aca3-47125f12360b", "address": "fa:16:3e:87:4b:ea", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0819cee-25", "ovs_interfaceid": "a0819cee-25ca-4271-aca3-47125f12360b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:4b:ea,bridge_name='br-int',has_traffic_filtering=True,id=a0819cee-25ca-4271-aca3-47125f12360b,network=Network(cb9f2274-bc37-4057-8256-c812cdb4b262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa0819cee-25') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG os_vif [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:4b:ea,bridge_name='br-int',has_traffic_filtering=True,id=a0819cee-25ca-4271-aca3-47125f12360b,network=Network(cb9f2274-bc37-4057-8256-c812cdb4b262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa0819cee-25') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0819cee-25, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:11 user nova-compute[72444]: INFO os_vif [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:4b:ea,bridge_name='br-int',has_traffic_filtering=True,id=a0819cee-25ca-4271-aca3-47125f12360b,network=Network(cb9f2274-bc37-4057-8256-c812cdb4b262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa0819cee-25')
Aug 03 04:51:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:49:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236579212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236579212',id=22,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGMQcHG8oBit3ZUG9qTovtEpNiUBS2ZhjNnojHDQeFgdbWAPBuSR0LSZUYTSmF0zzTn7tLY0Fsf0QF8KnuY50DVRY4YVIZckuRFGNQHAugbtlsN9Zb4BFepLTdj/uAGHQ==',key_name='tempest-keypair-1563763870',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:49:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1996f0a97dc84be4906a638ee6e19b19',ramdisk_id='',reservation_id='r-w4whabm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1365843340',owner_user_name='tempest-TaggedBootDevicesTest-1365843340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:49:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d24fc36445c245ff83f65f2a86f4f393',uuid=6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36cd0894-4081-4d21-870e-3d635e0ed9c4", "address": "fa:16:3e:24:83:27", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36cd0894-40", "ovs_interfaceid": "36cd0894-4081-4d21-870e-3d635e0ed9c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converting VIF {"id": "36cd0894-4081-4d21-870e-3d635e0ed9c4", "address": "fa:16:3e:24:83:27", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36cd0894-40", "ovs_interfaceid": "36cd0894-4081-4d21-870e-3d635e0ed9c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:83:27,bridge_name='br-int',has_traffic_filtering=True,id=36cd0894-4081-4d21-870e-3d635e0ed9c4,network=Network(cb9f2274-bc37-4057-8256-c812cdb4b262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap36cd0894-40') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG os_vif [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:83:27,bridge_name='br-int',has_traffic_filtering=True,id=36cd0894-4081-4d21-870e-3d635e0ed9c4,network=Network(cb9f2274-bc37-4057-8256-c812cdb4b262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap36cd0894-40') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36cd0894-40, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:11 user nova-compute[72444]: INFO os_vif [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:83:27,bridge_name='br-int',has_traffic_filtering=True,id=36cd0894-4081-4d21-870e-3d635e0ed9c4,network=Network(cb9f2274-bc37-4057-8256-c812cdb4b262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap36cd0894-40')
Aug 03 04:51:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:49:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236579212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236579212',id=22,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGMQcHG8oBit3ZUG9qTovtEpNiUBS2ZhjNnojHDQeFgdbWAPBuSR0LSZUYTSmF0zzTn7tLY0Fsf0QF8KnuY50DVRY4YVIZckuRFGNQHAugbtlsN9Zb4BFepLTdj/uAGHQ==',key_name='tempest-keypair-1563763870',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:49:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1996f0a97dc84be4906a638ee6e19b19',ramdisk_id='',reservation_id='r-w4whabm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1365843340',owner_user_name='tempest-TaggedBootDevicesTest-1365843340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:49:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d24fc36445c245ff83f65f2a86f4f393',uuid=6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88715119-aa32-4ad2-8c22-8188ee7a1a1f", "address": "fa:16:3e:3d:c8:82", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88715119-aa", "ovs_interfaceid": "88715119-aa32-4ad2-8c22-8188ee7a1a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converting VIF {"id": "88715119-aa32-4ad2-8c22-8188ee7a1a1f", "address": "fa:16:3e:3d:c8:82", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88715119-aa", "ovs_interfaceid": "88715119-aa32-4ad2-8c22-8188ee7a1a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:c8:82,bridge_name='br-int',has_traffic_filtering=True,id=88715119-aa32-4ad2-8c22-8188ee7a1a1f,network=Network(cb9f2274-bc37-4057-8256-c812cdb4b262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88715119-aa') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG os_vif [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:c8:82,bridge_name='br-int',has_traffic_filtering=True,id=88715119-aa32-4ad2-8c22-8188ee7a1a1f,network=Network(cb9f2274-bc37-4057-8256-c812cdb4b262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88715119-aa') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88715119-aa, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:11 user nova-compute[72444]: INFO os_vif [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:c8:82,bridge_name='br-int',has_traffic_filtering=True,id=88715119-aa32-4ad2-8c22-8188ee7a1a1f,network=Network(cb9f2274-bc37-4057-8256-c812cdb4b262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88715119-aa')
Aug 03 04:51:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:49:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236579212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236579212',id=22,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGMQcHG8oBit3ZUG9qTovtEpNiUBS2ZhjNnojHDQeFgdbWAPBuSR0LSZUYTSmF0zzTn7tLY0Fsf0QF8KnuY50DVRY4YVIZckuRFGNQHAugbtlsN9Zb4BFepLTdj/uAGHQ==',key_name='tempest-keypair-1563763870',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:49:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1996f0a97dc84be4906a638ee6e19b19',ramdisk_id='',reservation_id='r-w4whabm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1365843340',owner_user_name='tempest-TaggedBootDevicesTest-1365843340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:49:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d24fc36445c245ff83f65f2a86f4f393',uuid=6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab45da29-a935-4aa8-9a10-1793ddbc7ab1", "address": "fa:16:3e:e2:8b:4d", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab45da29-a9", "ovs_interfaceid": "ab45da29-a935-4aa8-9a10-1793ddbc7ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converting VIF {"id": "ab45da29-a935-4aa8-9a10-1793ddbc7ab1", "address": "fa:16:3e:e2:8b:4d", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab45da29-a9", "ovs_interfaceid": "ab45da29-a935-4aa8-9a10-1793ddbc7ab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:8b:4d,bridge_name='br-int',has_traffic_filtering=True,id=ab45da29-a935-4aa8-9a10-1793ddbc7ab1,network=Network(cb9f2274-bc37-4057-8256-c812cdb4b262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab45da29-a9') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG os_vif [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:8b:4d,bridge_name='br-int',has_traffic_filtering=True,id=ab45da29-a935-4aa8-9a10-1793ddbc7ab1,network=Network(cb9f2274-bc37-4057-8256-c812cdb4b262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab45da29-a9') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab45da29-a9, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:11 user nova-compute[72444]: INFO os_vif [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:8b:4d,bridge_name='br-int',has_traffic_filtering=True,id=ab45da29-a935-4aa8-9a10-1793ddbc7ab1,network=Network(cb9f2274-bc37-4057-8256-c812cdb4b262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab45da29-a9')
Aug 03 04:51:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:49:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236579212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236579212',id=22,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGMQcHG8oBit3ZUG9qTovtEpNiUBS2ZhjNnojHDQeFgdbWAPBuSR0LSZUYTSmF0zzTn7tLY0Fsf0QF8KnuY50DVRY4YVIZckuRFGNQHAugbtlsN9Zb4BFepLTdj/uAGHQ==',key_name='tempest-keypair-1563763870',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:49:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1996f0a97dc84be4906a638ee6e19b19',ramdisk_id='',reservation_id='r-w4whabm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1365843340',owner_user_name='tempest-TaggedBootDevicesTest-1365843340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:49:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d24fc36445c245ff83f65f2a86f4f393',uuid=6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b540799-a36a-4b46-a678-53a6db44477a", "address": "fa:16:3e:f0:75:b6", "network": {"id": "0f0a5fa7-1d9d-47a5-9dac-416467b65d29", "bridge": "br-int", "label": "tempest-device-tagging-net2-1543847764", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b540799-a3", "ovs_interfaceid": "4b540799-a36a-4b46-a678-53a6db44477a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converting VIF {"id": "4b540799-a36a-4b46-a678-53a6db44477a", "address": "fa:16:3e:f0:75:b6", "network": {"id": "0f0a5fa7-1d9d-47a5-9dac-416467b65d29", "bridge": "br-int", "label": "tempest-device-tagging-net2-1543847764", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b540799-a3", "ovs_interfaceid": "4b540799-a36a-4b46-a678-53a6db44477a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:75:b6,bridge_name='br-int',has_traffic_filtering=True,id=4b540799-a36a-4b46-a678-53a6db44477a,network=Network(0f0a5fa7-1d9d-47a5-9dac-416467b65d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b540799-a3') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG os_vif [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:75:b6,bridge_name='br-int',has_traffic_filtering=True,id=4b540799-a36a-4b46-a678-53a6db44477a,network=Network(0f0a5fa7-1d9d-47a5-9dac-416467b65d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b540799-a3') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b540799-a3, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:11 user nova-compute[72444]: INFO os_vif [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:75:b6,bridge_name='br-int',has_traffic_filtering=True,id=4b540799-a36a-4b46-a678-53a6db44477a,network=Network(0f0a5fa7-1d9d-47a5-9dac-416467b65d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b540799-a3')
Aug 03 04:51:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:49:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236579212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236579212',id=22,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGMQcHG8oBit3ZUG9qTovtEpNiUBS2ZhjNnojHDQeFgdbWAPBuSR0LSZUYTSmF0zzTn7tLY0Fsf0QF8KnuY50DVRY4YVIZckuRFGNQHAugbtlsN9Zb4BFepLTdj/uAGHQ==',key_name='tempest-keypair-1563763870',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:49:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1996f0a97dc84be4906a638ee6e19b19',ramdisk_id='',reservation_id='r-w4whabm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1365843340',owner_user_name='tempest-TaggedBootDevicesTest-1365843340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:49:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d24fc36445c245ff83f65f2a86f4f393',uuid=6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0290730e-648d-44ba-b03b-53918307a717", "address": "fa:16:3e:9a:c6:30", "network": {"id": "0f0a5fa7-1d9d-47a5-9dac-416467b65d29", "bridge": "br-int", "label": "tempest-device-tagging-net2-1543847764", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0290730e-64", "ovs_interfaceid": "0290730e-648d-44ba-b03b-53918307a717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converting VIF {"id": "0290730e-648d-44ba-b03b-53918307a717", "address": "fa:16:3e:9a:c6:30", "network": {"id": "0f0a5fa7-1d9d-47a5-9dac-416467b65d29", "bridge": "br-int", "label": "tempest-device-tagging-net2-1543847764", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0290730e-64", "ovs_interfaceid": "0290730e-648d-44ba-b03b-53918307a717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:c6:30,bridge_name='br-int',has_traffic_filtering=True,id=0290730e-648d-44ba-b03b-53918307a717,network=Network(0f0a5fa7-1d9d-47a5-9dac-416467b65d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0290730e-64') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG os_vif [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:c6:30,bridge_name='br-int',has_traffic_filtering=True,id=0290730e-648d-44ba-b03b-53918307a717,network=Network(0f0a5fa7-1d9d-47a5-9dac-416467b65d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0290730e-64') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0290730e-64, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:51:11 user nova-compute[72444]: INFO os_vif [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:c6:30,bridge_name='br-int',has_traffic_filtering=True,id=0290730e-648d-44ba-b03b-53918307a717,network=Network(0f0a5fa7-1d9d-47a5-9dac-416467b65d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0290730e-64')
Aug 03 04:51:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ySfAObUj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:51:11 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:51:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96c77a6-3f8b-49b1-985c-b3ce150bd400]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc89b03-a51d-47e3-89f9-5cf86edc550b]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab (non-flash)
Aug 03 04:51:11 user nova-compute[72444]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 (non-flash)
Aug 03 04:51:11 user nova-compute[72444]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 (non-flash)
Aug 03 04:51:11 user nova-compute[72444]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:51:11 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:51:11 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab (non-flash)
Aug 03 04:51:11 user nova-compute[72444]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 (non-flash)
Aug 03 04:51:11 user nova-compute[72444]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 (non-flash)
Aug 03 04:51:11 user nova-compute[72444]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:51:11 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:51:11 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f309423c5e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab'): ({'sdc'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Removing single pathed devices sdc {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1599be-d58c-41bb-a784-47cb1399f983]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-e702bebd-5acb-4b82-afbf-f727d908c46e tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b8cbde-e0a2-4ca4-9e51-eee4cfac03fd]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Flushing IO for device /dev/sdc {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-e702bebd-5acb-4b82-afbf-f727d908c46e tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccacab5-1dcd-4b10-8558-9b4e44c637ad]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e702bebd-5acb-4b82-afbf-f727d908c46e tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.575s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4efbe1-dd24-4749-addf-a1d9d08e4172]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] SCSI volumes sdc have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc16e06-eb7d-4964-8bbe-1e0330eef4b9]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:12 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-e702bebd-5acb-4b82-afbf-f727d908c46e tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Deleted allocations for instance 1baadfd2-6f00-436b-b3a0-c850cd8cb50e
Aug 03 04:51:12 user nova-compute[72444]: DEBUG nova.compute.manager [req-ffeb92f0-56b7-4a00-b228-662bd26faed7 req-3ec92aac-ca69-472b-8128-df8c3ff84a6e service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-plugged-88715119-aa32-4ad2-8c22-8188ee7a1a1f {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ffeb92f0-56b7-4a00-b228-662bd26faed7 req-3ec92aac-ca69-472b-8128-df8c3ff84a6e service nova] Acquiring lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ffeb92f0-56b7-4a00-b228-662bd26faed7 req-3ec92aac-ca69-472b-8128-df8c3ff84a6e service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ffeb92f0-56b7-4a00-b228-662bd26faed7 req-3ec92aac-ca69-472b-8128-df8c3ff84a6e service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG nova.compute.manager [req-ffeb92f0-56b7-4a00-b228-662bd26faed7 req-3ec92aac-ca69-472b-8128-df8c3ff84a6e service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] No waiting events found dispatching network-vif-plugged-88715119-aa32-4ad2-8c22-8188ee7a1a1f {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:51:12 user nova-compute[72444]: WARNING nova.compute.manager [req-ffeb92f0-56b7-4a00-b228-662bd26faed7 req-3ec92aac-ca69-472b-8128-df8c3ff84a6e service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received unexpected event network-vif-plugged-88715119-aa32-4ad2-8c22-8188ee7a1a1f for instance with vm_state active and task_state deleting.
Aug 03 04:51:12 user nova-compute[72444]: DEBUG nova.compute.manager [req-ffeb92f0-56b7-4a00-b228-662bd26faed7 req-3ec92aac-ca69-472b-8128-df8c3ff84a6e service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-unplugged-ab45da29-a935-4aa8-9a10-1793ddbc7ab1 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ffeb92f0-56b7-4a00-b228-662bd26faed7 req-3ec92aac-ca69-472b-8128-df8c3ff84a6e service nova] Acquiring lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ffeb92f0-56b7-4a00-b228-662bd26faed7 req-3ec92aac-ca69-472b-8128-df8c3ff84a6e service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ffeb92f0-56b7-4a00-b228-662bd26faed7 req-3ec92aac-ca69-472b-8128-df8c3ff84a6e service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG nova.compute.manager [req-ffeb92f0-56b7-4a00-b228-662bd26faed7 req-3ec92aac-ca69-472b-8128-df8c3ff84a6e service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] No waiting events found dispatching network-vif-unplugged-ab45da29-a935-4aa8-9a10-1793ddbc7ab1 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG nova.compute.manager [req-ffeb92f0-56b7-4a00-b228-662bd26faed7 req-3ec92aac-ca69-472b-8128-df8c3ff84a6e service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-unplugged-ab45da29-a935-4aa8-9a10-1793ddbc7ab1 for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG nova.compute.manager [req-ffeb92f0-56b7-4a00-b228-662bd26faed7 req-3ec92aac-ca69-472b-8128-df8c3ff84a6e service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-plugged-ab45da29-a935-4aa8-9a10-1793ddbc7ab1 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ffeb92f0-56b7-4a00-b228-662bd26faed7 req-3ec92aac-ca69-472b-8128-df8c3ff84a6e service nova] Acquiring lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ffeb92f0-56b7-4a00-b228-662bd26faed7 req-3ec92aac-ca69-472b-8128-df8c3ff84a6e service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ffeb92f0-56b7-4a00-b228-662bd26faed7 req-3ec92aac-ca69-472b-8128-df8c3ff84a6e service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG nova.compute.manager [req-ffeb92f0-56b7-4a00-b228-662bd26faed7 req-3ec92aac-ca69-472b-8128-df8c3ff84a6e service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] No waiting events found dispatching network-vif-plugged-ab45da29-a935-4aa8-9a10-1793ddbc7ab1 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:51:12 user nova-compute[72444]: WARNING nova.compute.manager [req-ffeb92f0-56b7-4a00-b228-662bd26faed7 req-3ec92aac-ca69-472b-8128-df8c3ff84a6e service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received unexpected event network-vif-plugged-ab45da29-a935-4aa8-9a10-1793ddbc7ab1 for instance with vm_state active and task_state deleting.
Aug 03 04:51:12 user nova-compute[72444]: DEBUG nova.compute.manager [req-ffeb92f0-56b7-4a00-b228-662bd26faed7 req-3ec92aac-ca69-472b-8128-df8c3ff84a6e service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-unplugged-0290730e-648d-44ba-b03b-53918307a717 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ffeb92f0-56b7-4a00-b228-662bd26faed7 req-3ec92aac-ca69-472b-8128-df8c3ff84a6e service nova] Acquiring lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ffeb92f0-56b7-4a00-b228-662bd26faed7 req-3ec92aac-ca69-472b-8128-df8c3ff84a6e service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ffeb92f0-56b7-4a00-b228-662bd26faed7 req-3ec92aac-ca69-472b-8128-df8c3ff84a6e service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG nova.compute.manager [req-ffeb92f0-56b7-4a00-b228-662bd26faed7 req-3ec92aac-ca69-472b-8128-df8c3ff84a6e service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] No waiting events found dispatching network-vif-unplugged-0290730e-648d-44ba-b03b-53918307a717 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG nova.compute.manager [req-ffeb92f0-56b7-4a00-b228-662bd26faed7 req-3ec92aac-ca69-472b-8128-df8c3ff84a6e service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-unplugged-0290730e-648d-44ba-b03b-53918307a717 for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG nova.compute.manager [req-ffeb92f0-56b7-4a00-b228-662bd26faed7 req-3ec92aac-ca69-472b-8128-df8c3ff84a6e service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-plugged-0290730e-648d-44ba-b03b-53918307a717 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ffeb92f0-56b7-4a00-b228-662bd26faed7 req-3ec92aac-ca69-472b-8128-df8c3ff84a6e service nova] Acquiring lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ffeb92f0-56b7-4a00-b228-662bd26faed7 req-3ec92aac-ca69-472b-8128-df8c3ff84a6e service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ffeb92f0-56b7-4a00-b228-662bd26faed7 req-3ec92aac-ca69-472b-8128-df8c3ff84a6e service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG nova.compute.manager [req-ffeb92f0-56b7-4a00-b228-662bd26faed7 req-3ec92aac-ca69-472b-8128-df8c3ff84a6e service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] No waiting events found dispatching network-vif-plugged-0290730e-648d-44ba-b03b-53918307a717 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:51:12 user nova-compute[72444]: WARNING nova.compute.manager [req-ffeb92f0-56b7-4a00-b228-662bd26faed7 req-3ec92aac-ca69-472b-8128-df8c3ff84a6e service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received unexpected event network-vif-plugged-0290730e-648d-44ba-b03b-53918307a717 for instance with vm_state active and task_state deleting.
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c5f5b9-6b15-4db5-b794-b1f66630c886]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab, portal: 172.16.0.220,3260]
Aug 03 04:51:12 user nova-compute[72444]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab, portal: 172.16.0.220,3260] successful.
Aug 03 04:51:12 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e702bebd-5acb-4b82-afbf-f727d908c46e tempest-TestServerVolumeAttachmentScenario-511083576 tempest-TestServerVolumeAttachmentScenario-511083576-project-member] Lock "1baadfd2-6f00-436b-b3a0-c850cd8cb50e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.472s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a7eeea2-85c7-436b-8003-948ca1dbbcab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[02505377-77b3-4684-8372-9eead430f11e]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] <== disconnect_volume: return (363ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IZgUWojX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:51:12 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4775bf0-c28e-4a86-9af0-fbfd69af2218]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[842f8f41-df3f-440d-84d9-4277183a3823]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 (non-flash)
Aug 03 04:51:12 user nova-compute[72444]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 (non-flash)
Aug 03 04:51:12 user nova-compute[72444]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:51:12 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:51:12 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 (non-flash)
Aug 03 04:51:12 user nova-compute[72444]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 (non-flash)
Aug 03 04:51:12 user nova-compute[72444]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:51:12 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:51:12 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308c35f0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2'): ({'sdd'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Removing single pathed devices sdd {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[010374d9-9455-4bf1-a724-abc305049b33]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26ec1d7-ca00-4f89-95b5-eb5f81cdcbc0]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Flushing IO for device /dev/sdd {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd57e0f-e4bb-4438-b4bc-686d04058df9]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4f48c3-57a7-42dc-a16a-9f72f8617ba0]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] SCSI volumes sdd have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG nova.compute.manager [req-086b21dd-4f15-4bf1-8601-6fa4e4b2b1ec req-b9fcaa30-f568-40cd-86b1-61e76f2fa71a service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-plugged-0b5e2297-6ab0-4965-a202-3f36a81e5646 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-086b21dd-4f15-4bf1-8601-6fa4e4b2b1ec req-b9fcaa30-f568-40cd-86b1-61e76f2fa71a service nova] Acquiring lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-086b21dd-4f15-4bf1-8601-6fa4e4b2b1ec req-b9fcaa30-f568-40cd-86b1-61e76f2fa71a service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-086b21dd-4f15-4bf1-8601-6fa4e4b2b1ec req-b9fcaa30-f568-40cd-86b1-61e76f2fa71a service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG nova.compute.manager [req-086b21dd-4f15-4bf1-8601-6fa4e4b2b1ec req-b9fcaa30-f568-40cd-86b1-61e76f2fa71a service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] No waiting events found dispatching network-vif-plugged-0b5e2297-6ab0-4965-a202-3f36a81e5646 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:51:12 user nova-compute[72444]: WARNING nova.compute.manager [req-086b21dd-4f15-4bf1-8601-6fa4e4b2b1ec req-b9fcaa30-f568-40cd-86b1-61e76f2fa71a service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received unexpected event network-vif-plugged-0b5e2297-6ab0-4965-a202-3f36a81e5646 for instance with vm_state active and task_state deleting.
Aug 03 04:51:12 user nova-compute[72444]: DEBUG nova.compute.manager [req-086b21dd-4f15-4bf1-8601-6fa4e4b2b1ec req-b9fcaa30-f568-40cd-86b1-61e76f2fa71a service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-unplugged-a0819cee-25ca-4271-aca3-47125f12360b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-086b21dd-4f15-4bf1-8601-6fa4e4b2b1ec req-b9fcaa30-f568-40cd-86b1-61e76f2fa71a service nova] Acquiring lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-086b21dd-4f15-4bf1-8601-6fa4e4b2b1ec req-b9fcaa30-f568-40cd-86b1-61e76f2fa71a service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-086b21dd-4f15-4bf1-8601-6fa4e4b2b1ec req-b9fcaa30-f568-40cd-86b1-61e76f2fa71a service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG nova.compute.manager [req-086b21dd-4f15-4bf1-8601-6fa4e4b2b1ec req-b9fcaa30-f568-40cd-86b1-61e76f2fa71a service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] No waiting events found dispatching network-vif-unplugged-a0819cee-25ca-4271-aca3-47125f12360b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG nova.compute.manager [req-086b21dd-4f15-4bf1-8601-6fa4e4b2b1ec req-b9fcaa30-f568-40cd-86b1-61e76f2fa71a service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-unplugged-a0819cee-25ca-4271-aca3-47125f12360b for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG nova.compute.manager [req-086b21dd-4f15-4bf1-8601-6fa4e4b2b1ec req-b9fcaa30-f568-40cd-86b1-61e76f2fa71a service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-plugged-a0819cee-25ca-4271-aca3-47125f12360b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-086b21dd-4f15-4bf1-8601-6fa4e4b2b1ec req-b9fcaa30-f568-40cd-86b1-61e76f2fa71a service nova] Acquiring lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-086b21dd-4f15-4bf1-8601-6fa4e4b2b1ec req-b9fcaa30-f568-40cd-86b1-61e76f2fa71a service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-086b21dd-4f15-4bf1-8601-6fa4e4b2b1ec req-b9fcaa30-f568-40cd-86b1-61e76f2fa71a service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG nova.compute.manager [req-086b21dd-4f15-4bf1-8601-6fa4e4b2b1ec req-b9fcaa30-f568-40cd-86b1-61e76f2fa71a service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] No waiting events found dispatching network-vif-plugged-a0819cee-25ca-4271-aca3-47125f12360b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:51:12 user nova-compute[72444]: WARNING nova.compute.manager [req-086b21dd-4f15-4bf1-8601-6fa4e4b2b1ec req-b9fcaa30-f568-40cd-86b1-61e76f2fa71a service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received unexpected event network-vif-plugged-a0819cee-25ca-4271-aca3-47125f12360b for instance with vm_state active and task_state deleting.
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4268b36c-ee88-43da-b8fc-f0a8dd29dd8b]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG nova.compute.manager [req-b2ccb85d-b832-44a2-b6a6-72fca14b20ab req-b8335c90-e0c1-483f-a889-ec78538ce1b8 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-plugged-36cd0894-4081-4d21-870e-3d635e0ed9c4 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b2ccb85d-b832-44a2-b6a6-72fca14b20ab req-b8335c90-e0c1-483f-a889-ec78538ce1b8 service nova] Acquiring lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b2ccb85d-b832-44a2-b6a6-72fca14b20ab req-b8335c90-e0c1-483f-a889-ec78538ce1b8 service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b2ccb85d-b832-44a2-b6a6-72fca14b20ab req-b8335c90-e0c1-483f-a889-ec78538ce1b8 service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG nova.compute.manager [req-b2ccb85d-b832-44a2-b6a6-72fca14b20ab req-b8335c90-e0c1-483f-a889-ec78538ce1b8 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] No waiting events found dispatching network-vif-plugged-36cd0894-4081-4d21-870e-3d635e0ed9c4 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:51:12 user nova-compute[72444]: WARNING nova.compute.manager [req-b2ccb85d-b832-44a2-b6a6-72fca14b20ab req-b8335c90-e0c1-483f-a889-ec78538ce1b8 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received unexpected event network-vif-plugged-36cd0894-4081-4d21-870e-3d635e0ed9c4 for instance with vm_state active and task_state deleting.
Aug 03 04:51:12 user nova-compute[72444]: DEBUG nova.compute.manager [req-b2ccb85d-b832-44a2-b6a6-72fca14b20ab req-b8335c90-e0c1-483f-a889-ec78538ce1b8 service nova] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Received event network-vif-deleted-2f55f137-3b34-49a7-a77c-e03f9c263c43 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG nova.compute.manager [req-b2ccb85d-b832-44a2-b6a6-72fca14b20ab req-b8335c90-e0c1-483f-a889-ec78538ce1b8 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-unplugged-4b540799-a36a-4b46-a678-53a6db44477a {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b2ccb85d-b832-44a2-b6a6-72fca14b20ab req-b8335c90-e0c1-483f-a889-ec78538ce1b8 service nova] Acquiring lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b2ccb85d-b832-44a2-b6a6-72fca14b20ab req-b8335c90-e0c1-483f-a889-ec78538ce1b8 service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b2ccb85d-b832-44a2-b6a6-72fca14b20ab req-b8335c90-e0c1-483f-a889-ec78538ce1b8 service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG nova.compute.manager [req-b2ccb85d-b832-44a2-b6a6-72fca14b20ab req-b8335c90-e0c1-483f-a889-ec78538ce1b8 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] No waiting events found dispatching network-vif-unplugged-4b540799-a36a-4b46-a678-53a6db44477a {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG nova.compute.manager [req-b2ccb85d-b832-44a2-b6a6-72fca14b20ab req-b8335c90-e0c1-483f-a889-ec78538ce1b8 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-unplugged-4b540799-a36a-4b46-a678-53a6db44477a for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG nova.compute.manager [req-b2ccb85d-b832-44a2-b6a6-72fca14b20ab req-b8335c90-e0c1-483f-a889-ec78538ce1b8 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-plugged-4b540799-a36a-4b46-a678-53a6db44477a {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b2ccb85d-b832-44a2-b6a6-72fca14b20ab req-b8335c90-e0c1-483f-a889-ec78538ce1b8 service nova] Acquiring lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b2ccb85d-b832-44a2-b6a6-72fca14b20ab req-b8335c90-e0c1-483f-a889-ec78538ce1b8 service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b2ccb85d-b832-44a2-b6a6-72fca14b20ab req-b8335c90-e0c1-483f-a889-ec78538ce1b8 service nova] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG nova.compute.manager [req-b2ccb85d-b832-44a2-b6a6-72fca14b20ab req-b8335c90-e0c1-483f-a889-ec78538ce1b8 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] No waiting events found dispatching network-vif-plugged-4b540799-a36a-4b46-a678-53a6db44477a {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:51:12 user nova-compute[72444]: WARNING nova.compute.manager [req-b2ccb85d-b832-44a2-b6a6-72fca14b20ab req-b8335c90-e0c1-483f-a889-ec78538ce1b8 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received unexpected event network-vif-plugged-4b540799-a36a-4b46-a678-53a6db44477a for instance with vm_state active and task_state deleting.
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f26377-0bd2-4656-8ff5-11744b9b77a7]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2, portal: 172.16.0.220,3260]
Aug 03 04:51:12 user nova-compute[72444]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2, portal: 172.16.0.220,3260] successful.
Aug 03 04:51:12 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:066c7beb-14e3-4f6e-aa2e-90e8f82590f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8486563-c7f3-4181-8084-6be75a40fd7c]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] <== disconnect_volume: return (327ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KtvVOgei', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:51:12 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ee9b4b-493d-4eca-919d-1e3ca980608f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f3f9ab-6f67-4cc0-a462-5b1b00b9dc94]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 (non-flash)
Aug 03 04:51:12 user nova-compute[72444]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:51:12 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:51:12 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 (non-flash)
Aug 03 04:51:12 user nova-compute[72444]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:51:12 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:51:12 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308c35f0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39'): ({'sde'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Removing single pathed devices sde {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ef94ab-1047-4090-be42-631532b0fe38]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG nova.objects.instance [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lazy-loading 'flavor' on Instance uuid c77e96da-6411-4ae9-af05-8e9bb3c432c6 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3484631e-432a-415f-befe-735e09fe39ef]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Flushing IO for device /dev/sde {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a092d3-d149-4b30-8224-f8ae90a93976]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.060s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[60be657b-93d0-410f-a07f-f3717b607b9f]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] SCSI volumes sde have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ced2196-0649-44b4-8524-4951b206116f]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbdc9e5-b992-4b71-8b93-96669f6378b0]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39, portal: 172.16.0.220,3260]
Aug 03 04:51:12 user nova-compute[72444]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39, portal: 172.16.0.220,3260] successful.
Aug 03 04:51:12 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:12 user nova-compute[72444]: INFO nova.compute.manager [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Attaching volume b64c5177-e1bd-47bc-899c-798c847c978d to /dev/vdb
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c6e85ec-1d45-4c13-a173-78e9a9373d39 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31a9abf-c868-43a6-b7b1-e632b4c12761]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] <== disconnect_volume: return (330ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:51:12 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Deleting instance files /opt/stack/data/nova/instances/6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16_del
Aug 03 04:51:12 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Deletion of /opt/stack/data/nova/instances/6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16_del complete
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.utils [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9652cc0f-2f22-430d-b8c6-cad33b789fa3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:12 user nova-compute[72444]: INFO nova.compute.manager [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Took 3.76 seconds to destroy the instance on the hypervisor.
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[caba3673-86d8-49b6-ab0d-97c1a56e911c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a49c21-6af2-4a62-ad00-0baa666fbc73]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da70073-3641-4854-a8e1-3d037915c158]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 04:51:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:51:13 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 04:51:13 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d47c55-8743-40ce-85ee-9d029270f5ab]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 04:51:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 04:51:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 04:51:13 user nova-compute[72444]: DEBUG os_brick.utils [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:51:13 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Updating existing volume attachment record: 870fb3ef-b94b-4f9f-976f-92b2abb7a820 {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 04:51:13 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-612d5dbc-f9e9-4449-bdb3-2428b189b97e tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Snapshot image upload complete
Aug 03 04:51:13 user nova-compute[72444]: INFO nova.compute.manager [None req-612d5dbc-f9e9-4449-bdb3-2428b189b97e tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Took 6.96 seconds to snapshot the instance on the hypervisor.
Aug 03 04:51:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:14 user nova-compute[72444]: DEBUG nova.compute.manager [req-9109e321-0ef4-4d20-842c-e8843c328cb8 req-8ec1aacc-bf38-41d6-8327-91f0da37a396 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Received event network-changed-90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:51:14 user nova-compute[72444]: DEBUG nova.compute.manager [req-9109e321-0ef4-4d20-842c-e8843c328cb8 req-8ec1aacc-bf38-41d6-8327-91f0da37a396 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Refreshing instance network info cache due to event network-changed-90104ef6-fe9b-4347-8df6-934a276e077b. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:51:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9109e321-0ef4-4d20-842c-e8843c328cb8 req-8ec1aacc-bf38-41d6-8327-91f0da37a396 service nova] Acquiring lock "refresh_cache-c77e96da-6411-4ae9-af05-8e9bb3c432c6" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:51:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9109e321-0ef4-4d20-842c-e8843c328cb8 req-8ec1aacc-bf38-41d6-8327-91f0da37a396 service nova] Acquired lock "refresh_cache-c77e96da-6411-4ae9-af05-8e9bb3c432c6" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:51:14 user nova-compute[72444]: DEBUG nova.network.neutron [req-9109e321-0ef4-4d20-842c-e8843c328cb8 req-8ec1aacc-bf38-41d6-8327-91f0da37a396 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Refreshing network info cache for port 90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:51:14 user nova-compute[72444]: DEBUG nova.network.neutron [req-9109e321-0ef4-4d20-842c-e8843c328cb8 req-8ec1aacc-bf38-41d6-8327-91f0da37a396 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Updated VIF entry in instance network info cache for port 90104ef6-fe9b-4347-8df6-934a276e077b. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:51:14 user nova-compute[72444]: DEBUG nova.network.neutron [req-9109e321-0ef4-4d20-842c-e8843c328cb8 req-8ec1aacc-bf38-41d6-8327-91f0da37a396 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Updating instance_info_cache with network_info: [{"id": "90104ef6-fe9b-4347-8df6-934a276e077b", "address": "fa:16:3e:22:ec:e0", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90104ef6-fe", "ovs_interfaceid": "90104ef6-fe9b-4347-8df6-934a276e077b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:51:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9109e321-0ef4-4d20-842c-e8843c328cb8 req-8ec1aacc-bf38-41d6-8327-91f0da37a396 service nova] Releasing lock "refresh_cache-c77e96da-6411-4ae9-af05-8e9bb3c432c6" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:51:15 user nova-compute[72444]: DEBUG nova.compute.manager [req-6ebdf10a-a8eb-42f3-bcef-8690ee474388 req-8a53bc9b-6e43-43a4-86fd-439ce5739cf1 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-deleted-ab45da29-a935-4aa8-9a10-1793ddbc7ab1 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:51:15 user nova-compute[72444]: INFO nova.compute.manager [req-6ebdf10a-a8eb-42f3-bcef-8690ee474388 req-8a53bc9b-6e43-43a4-86fd-439ce5739cf1 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Neutron deleted interface ab45da29-a935-4aa8-9a10-1793ddbc7ab1; detaching it from the instance and deleting it from the info cache
Aug 03 04:51:15 user nova-compute[72444]: DEBUG nova.network.neutron [req-6ebdf10a-a8eb-42f3-bcef-8690ee474388 req-8a53bc9b-6e43-43a4-86fd-439ce5739cf1 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Updating instance_info_cache with network_info: [{"id": "0b5e2297-6ab0-4965-a202-3f36a81e5646", "address": "fa:16:3e:2f:06:86", "network": {"id": "68729275-1a5f-4087-a6ca-34c6b674ecfd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-45954298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b5e2297-6a", "ovs_interfaceid": "0b5e2297-6ab0-4965-a202-3f36a81e5646", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0819cee-25ca-4271-aca3-47125f12360b", "address": "fa:16:3e:87:4b:ea", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0819cee-25", "ovs_interfaceid": "a0819cee-25ca-4271-aca3-47125f12360b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "36cd0894-4081-4d21-870e-3d635e0ed9c4", "address": "fa:16:3e:24:83:27", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36cd0894-40", "ovs_interfaceid": "36cd0894-4081-4d21-870e-3d635e0ed9c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "88715119-aa32-4ad2-8c22-8188ee7a1a1f", "address": "fa:16:3e:3d:c8:82", "network": {"id": "cb9f2274-bc37-4057-8256-c812cdb4b262", "bridge": "br-int", "label": "tempest-device-tagging-net1-947306587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88715119-aa", "ovs_interfaceid": "88715119-aa32-4ad2-8c22-8188ee7a1a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b540799-a36a-4b46-a678-53a6db44477a", "address": "fa:16:3e:f0:75:b6", "network": {"id": "0f0a5fa7-1d9d-47a5-9dac-416467b65d29", "bridge": "br-int", "label": "tempest-device-tagging-net2-1543847764", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b540799-a3", "ovs_interfaceid": "4b540799-a36a-4b46-a678-53a6db44477a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0290730e-648d-44ba-b03b-53918307a717", "address": "fa:16:3e:9a:c6:30", "network": {"id": "0f0a5fa7-1d9d-47a5-9dac-416467b65d29", "bridge": "br-int", "label": "tempest-device-tagging-net2-1543847764", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1996f0a97dc84be4906a638ee6e19b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0290730e-64", "ovs_interfaceid": "0290730e-648d-44ba-b03b-53918307a717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:51:15 user nova-compute[72444]: DEBUG nova.compute.manager [req-6ebdf10a-a8eb-42f3-bcef-8690ee474388 req-8a53bc9b-6e43-43a4-86fd-439ce5739cf1 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Detach interface failed, port_id=ab45da29-a935-4aa8-9a10-1793ddbc7ab1, reason: Instance 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16 could not be found. {{(pid=72444) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 03 04:51:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:17 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:51:17 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Took 4.19 seconds to deallocate network for instance.
Aug 03 04:51:17 user nova-compute[72444]: DEBUG nova.compute.manager [req-aab4994d-1351-459c-8b1d-ce4abb6e1677 req-a00bf4e7-2e60-4fba-976b-b21e9adc3957 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-deleted-4b540799-a36a-4b46-a678-53a6db44477a {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:51:17 user nova-compute[72444]: DEBUG nova.compute.manager [req-aab4994d-1351-459c-8b1d-ce4abb6e1677 req-a00bf4e7-2e60-4fba-976b-b21e9adc3957 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-deleted-0b5e2297-6ab0-4965-a202-3f36a81e5646 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:51:17 user nova-compute[72444]: DEBUG nova.compute.manager [req-aab4994d-1351-459c-8b1d-ce4abb6e1677 req-a00bf4e7-2e60-4fba-976b-b21e9adc3957 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-deleted-0290730e-648d-44ba-b03b-53918307a717 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:51:17 user nova-compute[72444]: DEBUG nova.compute.manager [req-aab4994d-1351-459c-8b1d-ce4abb6e1677 req-a00bf4e7-2e60-4fba-976b-b21e9adc3957 service nova] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Received event network-vif-deleted-88715119-aa32-4ad2-8c22-8188ee7a1a1f {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:51:19 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoqzCFpy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:51:21 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:51:21 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:51:21 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:51:21 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:51:21 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:51:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22889dd-edae-46c6-a3bd-8ad1f170c754]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 04:51:21 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5552ac5b-b70f-4736-b310-92e1829ff708]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d] added
Aug 03 04:51:21 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b2fbd0-0667-4a36-a9cb-1475f8a1cce5]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba582d39-7847-42ac-9b25-85467ff7b05f]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AoqzCFpy {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AoqzCFpy" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[45de584e-db12-4e04-9e47-b8054c975b9c]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AoqzCFpy'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0f8bd5-efef-45b7-9c8a-cbb73aca61c4]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f8d73d-aec6-4a2a-bad1-0fd24e71c986]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:51:21 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:51:21 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:51:21 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:51:21 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a447de4d-7781-4165-8262-04d0907bd1a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d, portal: 172.16.0.220,3260]
Aug 03 04:51:21 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d, portal: 172.16.0.220,3260] successful.
Aug 03 04:51:21 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[15aa614c-c1a1-49ee-a7fa-9e27acc1d457]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a259e63f-d5a6-4599-94cb-58bd600ee528]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:51:21 user nova-compute[72444]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:51:21 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:51:21 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:51:21 user nova-compute[72444]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:51:21 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:51:21 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[85825461-a728-4736-b6ac-2b57d1da6ac6]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoqzCFpy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:51:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:22 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:51:22 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23961343461356165', 'path': '/dev/sdb'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:51:22 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961343461356165', 'path': '/dev/sdb'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:51:22 user nova-compute[72444]: DEBUG nova.objects.instance [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lazy-loading 'flavor' on Instance uuid c77e96da-6411-4ae9-af05-8e9bb3c432c6 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:51:22 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 04:51:22 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:51:22 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 04:51:22 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:51:22 user nova-compute[72444]:   <serial>b64c5177-e1bd-47bc-899c-798c847c978d</serial>
Aug 03 04:51:22 user nova-compute[72444]: </disk>
Aug 03 04:51:22 user nova-compute[72444]:  {{(pid=72444) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 04:51:23 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:51:23 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:51:23 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] No VIF found with MAC fa:16:3e:22:ec:e0, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:51:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f121cc3c-501f-4bcb-a8dd-a8d2d9750b4c tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.458s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:23 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691038268.7593334, 1baadfd2-6f00-436b-b3a0-c850cd8cb50e => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:51:23 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] VM Stopped (Lifecycle Event)
Aug 03 04:51:23 user nova-compute[72444]: DEBUG nova.compute.manager [None req-d9182ed6-117b-458b-be25-181054cc4939 None None] [instance: 1baadfd2-6f00-436b-b3a0-c850cd8cb50e] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:51:23 user nova-compute[72444]: INFO nova.compute.manager [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Rescuing
Aug 03 04:51:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "refresh_cache-c77e96da-6411-4ae9-af05-8e9bb3c432c6" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:51:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquired lock "refresh_cache-c77e96da-6411-4ae9-af05-8e9bb3c432c6" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:51:23 user nova-compute[72444]: DEBUG nova.network.neutron [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:51:24 user nova-compute[72444]: DEBUG nova.network.neutron [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Updating instance_info_cache with network_info: [{"id": "90104ef6-fe9b-4347-8df6-934a276e077b", "address": "fa:16:3e:22:ec:e0", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90104ef6-fe", "ovs_interfaceid": "90104ef6-fe9b-4347-8df6-934a276e077b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:51:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Releasing lock "refresh_cache-c77e96da-6411-4ae9-af05-8e9bb3c432c6" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:51:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:24 user nova-compute[72444]: DEBUG nova.compute.manager [req-f5d1fdbd-76d4-4a1c-b584-3743a83623ef req-f090c1bd-0f32-4b40-906d-a061292ec147 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Received event network-vif-unplugged-90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:51:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f5d1fdbd-76d4-4a1c-b584-3743a83623ef req-f090c1bd-0f32-4b40-906d-a061292ec147 service nova] Acquiring lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f5d1fdbd-76d4-4a1c-b584-3743a83623ef req-f090c1bd-0f32-4b40-906d-a061292ec147 service nova] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f5d1fdbd-76d4-4a1c-b584-3743a83623ef req-f090c1bd-0f32-4b40-906d-a061292ec147 service nova] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:24 user nova-compute[72444]: DEBUG nova.compute.manager [req-f5d1fdbd-76d4-4a1c-b584-3743a83623ef req-f090c1bd-0f32-4b40-906d-a061292ec147 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] No waiting events found dispatching network-vif-unplugged-90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:51:24 user nova-compute[72444]: WARNING nova.compute.manager [req-f5d1fdbd-76d4-4a1c-b584-3743a83623ef req-f090c1bd-0f32-4b40-906d-a061292ec147 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Received unexpected event network-vif-unplugged-90104ef6-fe9b-4347-8df6-934a276e077b for instance with vm_state active and task_state rescuing.
Aug 03 04:51:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:25 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Instance destroyed successfully.
Aug 03 04:51:25 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Attempting rescue
Aug 03 04:51:25 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72444) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 03 04:51:25 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Instance directory exists: not creating {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 03 04:51:25 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Creating image(s)
Aug 03 04:51:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "/opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "/opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "/opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:25 user nova-compute[72444]: DEBUG nova.objects.instance [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lazy-loading 'trusted_certs' on Instance uuid c77e96da-6411-4ae9-af05-8e9bb3c432c6 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:51:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.137s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk.rescue {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk.rescue" returned: 0 in 0.047s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:25 user nova-compute[72444]: DEBUG nova.objects.instance [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lazy-loading 'migration_context' on Instance uuid c77e96da-6411-4ae9-af05-8e9bb3c432c6 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:51:25 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 04:51:25 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Start _get_guest_xml network_info=[{"id": "90104ef6-fe9b-4347-8df6-934a276e077b", "address": "fa:16:3e:22:ec:e0", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "vif_mac": "fa:16:3e:22:ec:e0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90104ef6-fe", "ovs_interfaceid": "90104ef6-fe9b-4347-8df6-934a276e077b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:51:25 user nova-compute[72444]: DEBUG nova.objects.instance [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lazy-loading 'resources' on Instance uuid c77e96da-6411-4ae9-af05-8e9bb3c432c6 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:51:25 user nova-compute[72444]: DEBUG nova.objects.instance [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lazy-loading 'numa_topology' on Instance uuid c77e96da-6411-4ae9-af05-8e9bb3c432c6 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:51:25 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:51:25 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:51:25 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:51:25 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:51:25 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:51:25 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:51:25 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:51:25 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:51:25 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:51:25 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:51:25 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:51:25 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:51:25 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:51:25 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:51:25 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:51:25 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:51:25 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:51:25 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:51:25 user nova-compute[72444]: DEBUG nova.objects.instance [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lazy-loading 'vcpu_model' on Instance uuid c77e96da-6411-4ae9-af05-8e9bb3c432c6 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:51:25 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:49:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-542782890',display_name='tempest-ServerRescueNegativeTestJSON-server-542782890',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-542782890',id=24,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmAjhUOOKCDltmr3EihMJCY9iEkC7NkRXw90VLoV9/lViPdH11qRTjE77g0xdU01gSL4ArFvtdc3yFICpu7HOjpk1RPgfTzpHtHhNK+y/xi3IO0oDY9ffaaWHdtTe8QZQ==',key_name='tempest-keypair-242052909',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:49:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='063a2a64796f4b87a44383014f0af3dc',ramdisk_id='',reservation_id='r-nw7lk90d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-665683708',owner_user_name='tempest-ServerRescueNegativeTestJSON-665683708-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:49:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07e8b540c9194e1195cb898ad08acaa0',uuid=c77e96da-6411-4ae9-af05-8e9bb3c432c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90104ef6-fe9b-4347-8df6-934a276e077b", "address": "fa:16:3e:22:ec:e0", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "vif_mac": "fa:16:3e:22:ec:e0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90104ef6-fe", "ovs_interfaceid": "90104ef6-fe9b-4347-8df6-934a276e077b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:51:25 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Converting VIF {"id": "90104ef6-fe9b-4347-8df6-934a276e077b", "address": "fa:16:3e:22:ec:e0", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "vif_mac": "fa:16:3e:22:ec:e0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90104ef6-fe", "ovs_interfaceid": "90104ef6-fe9b-4347-8df6-934a276e077b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:51:25 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:ec:e0,bridge_name='br-int',has_traffic_filtering=True,id=90104ef6-fe9b-4347-8df6-934a276e077b,network=Network(bc85da72-7764-4b65-a071-aec46e3a2398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90104ef6-fe') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:51:25 user nova-compute[72444]: DEBUG nova.objects.instance [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lazy-loading 'pci_devices' on Instance uuid c77e96da-6411-4ae9-af05-8e9bb3c432c6 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:51:25 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:51:25 user nova-compute[72444]:   <uuid>c77e96da-6411-4ae9-af05-8e9bb3c432c6</uuid>
Aug 03 04:51:25 user nova-compute[72444]:   <name>instance-00000018</name>
Aug 03 04:51:25 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:51:25 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:51:25 user nova-compute[72444]:   <metadata>
Aug 03 04:51:25 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:51:25 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:51:25 user nova-compute[72444]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-542782890</nova:name>
Aug 03 04:51:25 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:51:25</nova:creationTime>
Aug 03 04:51:25 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:51:25 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:51:25 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:51:25 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:51:25 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:51:25 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:51:25 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:51:25 user nova-compute[72444]:       <nova:owner>
Aug 03 04:51:25 user nova-compute[72444]:         <nova:user uuid="07e8b540c9194e1195cb898ad08acaa0">tempest-ServerRescueNegativeTestJSON-665683708-project-member</nova:user>
Aug 03 04:51:25 user nova-compute[72444]:         <nova:project uuid="063a2a64796f4b87a44383014f0af3dc">tempest-ServerRescueNegativeTestJSON-665683708</nova:project>
Aug 03 04:51:25 user nova-compute[72444]:       </nova:owner>
Aug 03 04:51:25 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:51:25 user nova-compute[72444]:       <nova:ports>
Aug 03 04:51:25 user nova-compute[72444]:         <nova:port uuid="90104ef6-fe9b-4347-8df6-934a276e077b">
Aug 03 04:51:25 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 03 04:51:25 user nova-compute[72444]:         </nova:port>
Aug 03 04:51:25 user nova-compute[72444]:       </nova:ports>
Aug 03 04:51:25 user nova-compute[72444]:     </nova:instance>
Aug 03 04:51:25 user nova-compute[72444]:   </metadata>
Aug 03 04:51:25 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:51:25 user nova-compute[72444]:     <system>
Aug 03 04:51:25 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:51:25 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:51:25 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:51:25 user nova-compute[72444]:       <entry name="serial">c77e96da-6411-4ae9-af05-8e9bb3c432c6</entry>
Aug 03 04:51:25 user nova-compute[72444]:       <entry name="uuid">c77e96da-6411-4ae9-af05-8e9bb3c432c6</entry>
Aug 03 04:51:25 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:51:25 user nova-compute[72444]:     </system>
Aug 03 04:51:25 user nova-compute[72444]:   </sysinfo>
Aug 03 04:51:25 user nova-compute[72444]:   <os>
Aug 03 04:51:25 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:51:25 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:51:25 user nova-compute[72444]:   </os>
Aug 03 04:51:25 user nova-compute[72444]:   <features>
Aug 03 04:51:25 user nova-compute[72444]:     <acpi/>
Aug 03 04:51:25 user nova-compute[72444]:     <apic/>
Aug 03 04:51:25 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:51:25 user nova-compute[72444]:   </features>
Aug 03 04:51:25 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:51:25 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:51:25 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:51:25 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:51:25 user nova-compute[72444]:   </clock>
Aug 03 04:51:25 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:51:25 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:51:25 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:51:25 user nova-compute[72444]:   </cpu>
Aug 03 04:51:25 user nova-compute[72444]:   <devices>
Aug 03 04:51:25 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:51:25 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:51:25 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk.rescue"/>
Aug 03 04:51:25 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:51:25 user nova-compute[72444]:     </disk>
Aug 03 04:51:25 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:51:25 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:51:25 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk"/>
Aug 03 04:51:25 user nova-compute[72444]:       <target dev="vdb" bus="virtio"/>
Aug 03 04:51:25 user nova-compute[72444]:     </disk>
Aug 03 04:51:25 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:51:25 user nova-compute[72444]:       <mac address="fa:16:3e:22:ec:e0"/>
Aug 03 04:51:25 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:51:25 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:51:25 user nova-compute[72444]:       <target dev="tap90104ef6-fe"/>
Aug 03 04:51:25 user nova-compute[72444]:     </interface>
Aug 03 04:51:25 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:51:25 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/console.log" append="off"/>
Aug 03 04:51:25 user nova-compute[72444]:     </serial>
Aug 03 04:51:25 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:51:25 user nova-compute[72444]:     <video>
Aug 03 04:51:25 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:51:25 user nova-compute[72444]:     </video>
Aug 03 04:51:25 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:51:25 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:51:25 user nova-compute[72444]:     </rng>
Aug 03 04:51:25 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:51:25 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:51:25 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:51:25 user nova-compute[72444]:     </memballoon>
Aug 03 04:51:25 user nova-compute[72444]:   </devices>
Aug 03 04:51:25 user nova-compute[72444]: </domain>
Aug 03 04:51:25 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:51:25 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Instance destroyed successfully.
Aug 03 04:51:25 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:51:25 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:51:25 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] No VIF found with MAC fa:16:3e:22:ec:e0, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:51:26 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691038271.280071, 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:51:26 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] VM Stopped (Lifecycle Event)
Aug 03 04:51:26 user nova-compute[72444]: DEBUG nova.compute.manager [None req-df4d7d2f-64f5-4a98-8a46-af707be87143 None None] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:51:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:26 user nova-compute[72444]: DEBUG nova.compute.manager [req-5ab5faed-0cbf-45f0-8c07-bc512e539772 req-e060d8a6-8e8e-4ba6-960d-68b9c86a9049 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Received event network-vif-plugged-90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:51:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5ab5faed-0cbf-45f0-8c07-bc512e539772 req-e060d8a6-8e8e-4ba6-960d-68b9c86a9049 service nova] Acquiring lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5ab5faed-0cbf-45f0-8c07-bc512e539772 req-e060d8a6-8e8e-4ba6-960d-68b9c86a9049 service nova] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5ab5faed-0cbf-45f0-8c07-bc512e539772 req-e060d8a6-8e8e-4ba6-960d-68b9c86a9049 service nova] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:26 user nova-compute[72444]: DEBUG nova.compute.manager [req-5ab5faed-0cbf-45f0-8c07-bc512e539772 req-e060d8a6-8e8e-4ba6-960d-68b9c86a9049 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] No waiting events found dispatching network-vif-plugged-90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:51:26 user nova-compute[72444]: WARNING nova.compute.manager [req-5ab5faed-0cbf-45f0-8c07-bc512e539772 req-e060d8a6-8e8e-4ba6-960d-68b9c86a9049 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Received unexpected event network-vif-plugged-90104ef6-fe9b-4347-8df6-934a276e077b for instance with vm_state active and task_state rescuing.
Aug 03 04:51:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:28 user nova-compute[72444]: DEBUG nova.compute.manager [req-d7cbfe2e-6a59-43a5-9731-b1e71ece20da req-a5f540ba-b93a-47c9-aa00-46c3cdb58c7e service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Received event network-vif-plugged-90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:51:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d7cbfe2e-6a59-43a5-9731-b1e71ece20da req-a5f540ba-b93a-47c9-aa00-46c3cdb58c7e service nova] Acquiring lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d7cbfe2e-6a59-43a5-9731-b1e71ece20da req-a5f540ba-b93a-47c9-aa00-46c3cdb58c7e service nova] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d7cbfe2e-6a59-43a5-9731-b1e71ece20da req-a5f540ba-b93a-47c9-aa00-46c3cdb58c7e service nova] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:28 user nova-compute[72444]: DEBUG nova.compute.manager [req-d7cbfe2e-6a59-43a5-9731-b1e71ece20da req-a5f540ba-b93a-47c9-aa00-46c3cdb58c7e service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] No waiting events found dispatching network-vif-plugged-90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:51:28 user nova-compute[72444]: WARNING nova.compute.manager [req-d7cbfe2e-6a59-43a5-9731-b1e71ece20da req-a5f540ba-b93a-47c9-aa00-46c3cdb58c7e service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Received unexpected event network-vif-plugged-90104ef6-fe9b-4347-8df6-934a276e077b for instance with vm_state active and task_state rescuing.
Aug 03 04:51:28 user nova-compute[72444]: DEBUG nova.compute.manager [req-d7cbfe2e-6a59-43a5-9731-b1e71ece20da req-a5f540ba-b93a-47c9-aa00-46c3cdb58c7e service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Received event network-vif-plugged-90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:51:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d7cbfe2e-6a59-43a5-9731-b1e71ece20da req-a5f540ba-b93a-47c9-aa00-46c3cdb58c7e service nova] Acquiring lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d7cbfe2e-6a59-43a5-9731-b1e71ece20da req-a5f540ba-b93a-47c9-aa00-46c3cdb58c7e service nova] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d7cbfe2e-6a59-43a5-9731-b1e71ece20da req-a5f540ba-b93a-47c9-aa00-46c3cdb58c7e service nova] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:28 user nova-compute[72444]: DEBUG nova.compute.manager [req-d7cbfe2e-6a59-43a5-9731-b1e71ece20da req-a5f540ba-b93a-47c9-aa00-46c3cdb58c7e service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] No waiting events found dispatching network-vif-plugged-90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:51:28 user nova-compute[72444]: WARNING nova.compute.manager [req-d7cbfe2e-6a59-43a5-9731-b1e71ece20da req-a5f540ba-b93a-47c9-aa00-46c3cdb58c7e service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Received unexpected event network-vif-plugged-90104ef6-fe9b-4347-8df6-934a276e077b for instance with vm_state active and task_state rescuing.
Aug 03 04:51:29 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Removed pending event for c77e96da-6411-4ae9-af05-8e9bb3c432c6 due to event {{(pid=72444) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 03 04:51:29 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038289.1642776, c77e96da-6411-4ae9-af05-8e9bb3c432c6 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:51:29 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] VM Resumed (Lifecycle Event)
Aug 03 04:51:29 user nova-compute[72444]: DEBUG nova.compute.manager [None req-1228db41-dcc0-4d55-9fcf-11e9e1f51bbe tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:51:29 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:51:29 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:51:29 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 03 04:51:29 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038289.1676939, c77e96da-6411-4ae9-af05-8e9bb3c432c6 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:51:29 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] VM Started (Lifecycle Event)
Aug 03 04:51:29 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:51:29 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:51:29 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:31 user nova-compute[72444]: INFO nova.compute.manager [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] [instance: 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16] Took 14.64 seconds to detach 3 volumes for instance.
Aug 03 04:51:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:32 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:51:32 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:51:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:32 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Deleted allocations for instance 6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16
Aug 03 04:51:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8acf97ff-d86c-48cd-966f-d0845e5d81ad tempest-TaggedBootDevicesTest-1365843340 tempest-TaggedBootDevicesTest-1365843340-project-member] Lock "6b70d15d-a6a0-4992-8e73-c8c1e6fbbf16" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 23.216s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "0214a998-5624-46f9-801e-c582b4a297e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "0214a998-5624-46f9-801e-c582b4a297e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:32 user nova-compute[72444]: DEBUG nova.compute.manager [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 04:51:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:32 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 04:51:32 user nova-compute[72444]: INFO nova.compute.claims [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Claim successful on node user
Aug 03 04:51:32 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:51:32 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:51:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:33 user nova-compute[72444]: DEBUG nova.compute.manager [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 04:51:33 user nova-compute[72444]: DEBUG nova.compute.manager [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 04:51:33 user nova-compute[72444]: DEBUG nova.network.neutron [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 04:51:33 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 04:51:33 user nova-compute[72444]: DEBUG nova.compute.manager [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 04:51:33 user nova-compute[72444]: DEBUG nova.policy [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e44603a26afa49098e76422420c825c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65efd00e0ac4039bf1d6429787b8595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 04:51:33 user nova-compute[72444]: DEBUG nova.compute.manager [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 04:51:33 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 04:51:33 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Creating image(s)
Aug 03 04:51:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "/opt/stack/data/nova/instances/0214a998-5624-46f9-801e-c582b4a297e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "/opt/stack/data/nova/instances/0214a998-5624-46f9-801e-c582b4a297e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "/opt/stack/data/nova/instances/0214a998-5624-46f9-801e-c582b4a297e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.154s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.152s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/0214a998-5624-46f9-801e-c582b4a297e5/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/0214a998-5624-46f9-801e-c582b4a297e5/disk 1073741824" returned: 0 in 0.065s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.144s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:33 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0214a998-5624-46f9-801e-c582b4a297e5/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 04:51:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0214a998-5624-46f9-801e-c582b4a297e5/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:33 user nova-compute[72444]: DEBUG nova.network.neutron [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Successfully created port: 62f68bc6-6c23-4a77-9000-46670e8312fa {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:51:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0214a998-5624-46f9-801e-c582b4a297e5/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:33 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Cannot resize image /opt/stack/data/nova/instances/0214a998-5624-46f9-801e-c582b4a297e5/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 04:51:33 user nova-compute[72444]: DEBUG nova.objects.instance [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lazy-loading 'migration_context' on Instance uuid 0214a998-5624-46f9-801e-c582b4a297e5 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:51:33 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 04:51:33 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Ensure instance console log exists: /opt/stack/data/nova/instances/0214a998-5624-46f9-801e-c582b4a297e5/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 04:51:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:34 user nova-compute[72444]: DEBUG nova.network.neutron [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Successfully updated port: 62f68bc6-6c23-4a77-9000-46670e8312fa {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:51:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "refresh_cache-0214a998-5624-46f9-801e-c582b4a297e5" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:51:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquired lock "refresh_cache-0214a998-5624-46f9-801e-c582b4a297e5" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:51:34 user nova-compute[72444]: DEBUG nova.network.neutron [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:51:34 user nova-compute[72444]: DEBUG nova.compute.manager [req-e40443d9-3148-4f42-bb0a-6c1822e5fcde req-624b89b3-3bd6-4c96-bfc8-fcc157650f7c service nova] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Received event network-changed-62f68bc6-6c23-4a77-9000-46670e8312fa {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:51:34 user nova-compute[72444]: DEBUG nova.compute.manager [req-e40443d9-3148-4f42-bb0a-6c1822e5fcde req-624b89b3-3bd6-4c96-bfc8-fcc157650f7c service nova] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Refreshing instance network info cache due to event network-changed-62f68bc6-6c23-4a77-9000-46670e8312fa. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:51:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e40443d9-3148-4f42-bb0a-6c1822e5fcde req-624b89b3-3bd6-4c96-bfc8-fcc157650f7c service nova] Acquiring lock "refresh_cache-0214a998-5624-46f9-801e-c582b4a297e5" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:51:34 user nova-compute[72444]: DEBUG nova.network.neutron [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG nova.network.neutron [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Updating instance_info_cache with network_info: [{"id": "62f68bc6-6c23-4a77-9000-46670e8312fa", "address": "fa:16:3e:54:97:0f", "network": {"id": "628fbd1c-7104-4911-9eb9-1f38c394bebd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-366258398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a65efd00e0ac4039bf1d6429787b8595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f68bc6-6c", "ovs_interfaceid": "62f68bc6-6c23-4a77-9000-46670e8312fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Releasing lock "refresh_cache-0214a998-5624-46f9-801e-c582b4a297e5" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG nova.compute.manager [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Instance network_info: |[{"id": "62f68bc6-6c23-4a77-9000-46670e8312fa", "address": "fa:16:3e:54:97:0f", "network": {"id": "628fbd1c-7104-4911-9eb9-1f38c394bebd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-366258398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a65efd00e0ac4039bf1d6429787b8595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f68bc6-6c", "ovs_interfaceid": "62f68bc6-6c23-4a77-9000-46670e8312fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e40443d9-3148-4f42-bb0a-6c1822e5fcde req-624b89b3-3bd6-4c96-bfc8-fcc157650f7c service nova] Acquired lock "refresh_cache-0214a998-5624-46f9-801e-c582b4a297e5" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG nova.network.neutron [req-e40443d9-3148-4f42-bb0a-6c1822e5fcde req-624b89b3-3bd6-4c96-bfc8-fcc157650f7c service nova] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Refreshing network info cache for port 62f68bc6-6c23-4a77-9000-46670e8312fa {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Start _get_guest_xml network_info=[{"id": "62f68bc6-6c23-4a77-9000-46670e8312fa", "address": "fa:16:3e:54:97:0f", "network": {"id": "628fbd1c-7104-4911-9eb9-1f38c394bebd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-366258398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a65efd00e0ac4039bf1d6429787b8595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f68bc6-6c", "ovs_interfaceid": "62f68bc6-6c23-4a77-9000-46670e8312fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:51:35 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:51:35 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:51:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:51:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-496141584',display_name='tempest-AttachVolumeTestJSON-server-496141584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-496141584',id=27,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMXBVtWUxj++Zjsxy4sFEtIsPN+GU+NEpWxox0y7DZzqNy60nwOEuwRURSiVJKnaYyjSrINgPfeHM4xYuXWv7s5I2FYtN7vxpBGsU9L4N0Ec1Q7f9fEZFh3DdmzCcZT/g==',key_name='tempest-keypair-1442806230',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a65efd00e0ac4039bf1d6429787b8595',ramdisk_id='',reservation_id='r-dyaml07b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1814863301',owner_user_name='tempest-AttachVolumeTestJSON-1814863301-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:51:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e44603a26afa49098e76422420c825c2',uuid=0214a998-5624-46f9-801e-c582b4a297e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62f68bc6-6c23-4a77-9000-46670e8312fa", "address": "fa:16:3e:54:97:0f", "network": {"id": "628fbd1c-7104-4911-9eb9-1f38c394bebd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-366258398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a65efd00e0ac4039bf1d6429787b8595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f68bc6-6c", "ovs_interfaceid": "62f68bc6-6c23-4a77-9000-46670e8312fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Converting VIF {"id": "62f68bc6-6c23-4a77-9000-46670e8312fa", "address": "fa:16:3e:54:97:0f", "network": {"id": "628fbd1c-7104-4911-9eb9-1f38c394bebd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-366258398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a65efd00e0ac4039bf1d6429787b8595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f68bc6-6c", "ovs_interfaceid": "62f68bc6-6c23-4a77-9000-46670e8312fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:97:0f,bridge_name='br-int',has_traffic_filtering=True,id=62f68bc6-6c23-4a77-9000-46670e8312fa,network=Network(628fbd1c-7104-4911-9eb9-1f38c394bebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62f68bc6-6c') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG nova.objects.instance [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lazy-loading 'pci_devices' on Instance uuid 0214a998-5624-46f9-801e-c582b4a297e5 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:51:35 user nova-compute[72444]:   <uuid>0214a998-5624-46f9-801e-c582b4a297e5</uuid>
Aug 03 04:51:35 user nova-compute[72444]:   <name>instance-0000001b</name>
Aug 03 04:51:35 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:51:35 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:51:35 user nova-compute[72444]:   <metadata>
Aug 03 04:51:35 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:51:35 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:51:35 user nova-compute[72444]:       <nova:name>tempest-AttachVolumeTestJSON-server-496141584</nova:name>
Aug 03 04:51:35 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:51:35</nova:creationTime>
Aug 03 04:51:35 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:51:35 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:51:35 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:51:35 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:51:35 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:51:35 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:51:35 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:51:35 user nova-compute[72444]:       <nova:owner>
Aug 03 04:51:35 user nova-compute[72444]:         <nova:user uuid="e44603a26afa49098e76422420c825c2">tempest-AttachVolumeTestJSON-1814863301-project-member</nova:user>
Aug 03 04:51:35 user nova-compute[72444]:         <nova:project uuid="a65efd00e0ac4039bf1d6429787b8595">tempest-AttachVolumeTestJSON-1814863301</nova:project>
Aug 03 04:51:35 user nova-compute[72444]:       </nova:owner>
Aug 03 04:51:35 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:51:35 user nova-compute[72444]:       <nova:ports>
Aug 03 04:51:35 user nova-compute[72444]:         <nova:port uuid="62f68bc6-6c23-4a77-9000-46670e8312fa">
Aug 03 04:51:35 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 03 04:51:35 user nova-compute[72444]:         </nova:port>
Aug 03 04:51:35 user nova-compute[72444]:       </nova:ports>
Aug 03 04:51:35 user nova-compute[72444]:     </nova:instance>
Aug 03 04:51:35 user nova-compute[72444]:   </metadata>
Aug 03 04:51:35 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:51:35 user nova-compute[72444]:     <system>
Aug 03 04:51:35 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:51:35 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:51:35 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:51:35 user nova-compute[72444]:       <entry name="serial">0214a998-5624-46f9-801e-c582b4a297e5</entry>
Aug 03 04:51:35 user nova-compute[72444]:       <entry name="uuid">0214a998-5624-46f9-801e-c582b4a297e5</entry>
Aug 03 04:51:35 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:51:35 user nova-compute[72444]:     </system>
Aug 03 04:51:35 user nova-compute[72444]:   </sysinfo>
Aug 03 04:51:35 user nova-compute[72444]:   <os>
Aug 03 04:51:35 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:51:35 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:51:35 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:51:35 user nova-compute[72444]:   </os>
Aug 03 04:51:35 user nova-compute[72444]:   <features>
Aug 03 04:51:35 user nova-compute[72444]:     <acpi/>
Aug 03 04:51:35 user nova-compute[72444]:     <apic/>
Aug 03 04:51:35 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:51:35 user nova-compute[72444]:   </features>
Aug 03 04:51:35 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:51:35 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:51:35 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:51:35 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:51:35 user nova-compute[72444]:   </clock>
Aug 03 04:51:35 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:51:35 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:51:35 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:51:35 user nova-compute[72444]:   </cpu>
Aug 03 04:51:35 user nova-compute[72444]:   <devices>
Aug 03 04:51:35 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:51:35 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:51:35 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/0214a998-5624-46f9-801e-c582b4a297e5/disk"/>
Aug 03 04:51:35 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:51:35 user nova-compute[72444]:     </disk>
Aug 03 04:51:35 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:51:35 user nova-compute[72444]:       <mac address="fa:16:3e:54:97:0f"/>
Aug 03 04:51:35 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:51:35 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:51:35 user nova-compute[72444]:       <target dev="tap62f68bc6-6c"/>
Aug 03 04:51:35 user nova-compute[72444]:     </interface>
Aug 03 04:51:35 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:51:35 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/0214a998-5624-46f9-801e-c582b4a297e5/console.log" append="off"/>
Aug 03 04:51:35 user nova-compute[72444]:     </serial>
Aug 03 04:51:35 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:51:35 user nova-compute[72444]:     <video>
Aug 03 04:51:35 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:51:35 user nova-compute[72444]:     </video>
Aug 03 04:51:35 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:51:35 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:51:35 user nova-compute[72444]:     </rng>
Aug 03 04:51:35 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:51:35 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:51:35 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:51:35 user nova-compute[72444]:     </memballoon>
Aug 03 04:51:35 user nova-compute[72444]:   </devices>
Aug 03 04:51:35 user nova-compute[72444]: </domain>
Aug 03 04:51:35 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:51:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-496141584',display_name='tempest-AttachVolumeTestJSON-server-496141584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-496141584',id=27,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMXBVtWUxj++Zjsxy4sFEtIsPN+GU+NEpWxox0y7DZzqNy60nwOEuwRURSiVJKnaYyjSrINgPfeHM4xYuXWv7s5I2FYtN7vxpBGsU9L4N0Ec1Q7f9fEZFh3DdmzCcZT/g==',key_name='tempest-keypair-1442806230',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a65efd00e0ac4039bf1d6429787b8595',ramdisk_id='',reservation_id='r-dyaml07b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1814863301',owner_user_name='tempest-AttachVolumeTestJSON-1814863301-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:51:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e44603a26afa49098e76422420c825c2',uuid=0214a998-5624-46f9-801e-c582b4a297e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62f68bc6-6c23-4a77-9000-46670e8312fa", "address": "fa:16:3e:54:97:0f", "network": {"id": "628fbd1c-7104-4911-9eb9-1f38c394bebd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-366258398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a65efd00e0ac4039bf1d6429787b8595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f68bc6-6c", "ovs_interfaceid": "62f68bc6-6c23-4a77-9000-46670e8312fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Converting VIF {"id": "62f68bc6-6c23-4a77-9000-46670e8312fa", "address": "fa:16:3e:54:97:0f", "network": {"id": "628fbd1c-7104-4911-9eb9-1f38c394bebd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-366258398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a65efd00e0ac4039bf1d6429787b8595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f68bc6-6c", "ovs_interfaceid": "62f68bc6-6c23-4a77-9000-46670e8312fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:97:0f,bridge_name='br-int',has_traffic_filtering=True,id=62f68bc6-6c23-4a77-9000-46670e8312fa,network=Network(628fbd1c-7104-4911-9eb9-1f38c394bebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62f68bc6-6c') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG os_vif [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:97:0f,bridge_name='br-int',has_traffic_filtering=True,id=62f68bc6-6c23-4a77-9000-46670e8312fa,network=Network(628fbd1c-7104-4911-9eb9-1f38c394bebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62f68bc6-6c') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62f68bc6-6c, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap62f68bc6-6c, col_values=(('external_ids', {'iface-id': '62f68bc6-6c23-4a77-9000-46670e8312fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:97:0f', 'vm-uuid': '0214a998-5624-46f9-801e-c582b4a297e5'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:35 user nova-compute[72444]: INFO os_vif [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:97:0f,bridge_name='br-int',has_traffic_filtering=True,id=62f68bc6-6c23-4a77-9000-46670e8312fa,network=Network(628fbd1c-7104-4911-9eb9-1f38c394bebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62f68bc6-6c')
Aug 03 04:51:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] No VIF found with MAC fa:16:3e:54:97:0f, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG nova.network.neutron [req-e40443d9-3148-4f42-bb0a-6c1822e5fcde req-624b89b3-3bd6-4c96-bfc8-fcc157650f7c service nova] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Updated VIF entry in instance network info cache for port 62f68bc6-6c23-4a77-9000-46670e8312fa. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG nova.network.neutron [req-e40443d9-3148-4f42-bb0a-6c1822e5fcde req-624b89b3-3bd6-4c96-bfc8-fcc157650f7c service nova] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Updating instance_info_cache with network_info: [{"id": "62f68bc6-6c23-4a77-9000-46670e8312fa", "address": "fa:16:3e:54:97:0f", "network": {"id": "628fbd1c-7104-4911-9eb9-1f38c394bebd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-366258398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a65efd00e0ac4039bf1d6429787b8595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f68bc6-6c", "ovs_interfaceid": "62f68bc6-6c23-4a77-9000-46670e8312fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:51:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e40443d9-3148-4f42-bb0a-6c1822e5fcde req-624b89b3-3bd6-4c96-bfc8-fcc157650f7c service nova] Releasing lock "refresh_cache-0214a998-5624-46f9-801e-c582b4a297e5" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:51:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:36 user nova-compute[72444]: DEBUG nova.compute.manager [req-a04ebfb3-cc94-49fa-a950-fb5e31c8b623 req-88e6bd5d-3bcf-409e-95a2-44df5d525829 service nova] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Received event network-vif-plugged-62f68bc6-6c23-4a77-9000-46670e8312fa {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:51:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a04ebfb3-cc94-49fa-a950-fb5e31c8b623 req-88e6bd5d-3bcf-409e-95a2-44df5d525829 service nova] Acquiring lock "0214a998-5624-46f9-801e-c582b4a297e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a04ebfb3-cc94-49fa-a950-fb5e31c8b623 req-88e6bd5d-3bcf-409e-95a2-44df5d525829 service nova] Lock "0214a998-5624-46f9-801e-c582b4a297e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a04ebfb3-cc94-49fa-a950-fb5e31c8b623 req-88e6bd5d-3bcf-409e-95a2-44df5d525829 service nova] Lock "0214a998-5624-46f9-801e-c582b4a297e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:36 user nova-compute[72444]: DEBUG nova.compute.manager [req-a04ebfb3-cc94-49fa-a950-fb5e31c8b623 req-88e6bd5d-3bcf-409e-95a2-44df5d525829 service nova] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] No waiting events found dispatching network-vif-plugged-62f68bc6-6c23-4a77-9000-46670e8312fa {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:51:36 user nova-compute[72444]: WARNING nova.compute.manager [req-a04ebfb3-cc94-49fa-a950-fb5e31c8b623 req-88e6bd5d-3bcf-409e-95a2-44df5d525829 service nova] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Received unexpected event network-vif-plugged-62f68bc6-6c23-4a77-9000-46670e8312fa for instance with vm_state building and task_state spawning.
Aug 03 04:51:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:37 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:51:37 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Cleaning up deleted instances {{(pid=72444) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 03 04:51:37 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] There are 0 instances to clean {{(pid=72444) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 03 04:51:38 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038298.908967, 0214a998-5624-46f9-801e-c582b4a297e5 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:51:38 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] VM Resumed (Lifecycle Event)
Aug 03 04:51:38 user nova-compute[72444]: DEBUG nova.compute.manager [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:51:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 04:51:38 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Instance spawned successfully.
Aug 03 04:51:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 04:51:38 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:51:38 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:51:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:51:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:51:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:51:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:51:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:51:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:51:38 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:51:38 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038298.9130425, 0214a998-5624-46f9-801e-c582b4a297e5 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:51:38 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] VM Started (Lifecycle Event)
Aug 03 04:51:38 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:51:39 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:51:39 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:51:39 user nova-compute[72444]: INFO nova.compute.manager [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Took 5.79 seconds to spawn the instance on the hypervisor.
Aug 03 04:51:39 user nova-compute[72444]: DEBUG nova.compute.manager [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:51:39 user nova-compute[72444]: DEBUG nova.compute.manager [req-b2960a4e-4c6c-457e-bc3d-b7ca40441fdf req-88efaa3f-bb9e-4db3-a9ad-0ca559a80ca0 service nova] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Received event network-vif-plugged-62f68bc6-6c23-4a77-9000-46670e8312fa {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:51:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b2960a4e-4c6c-457e-bc3d-b7ca40441fdf req-88efaa3f-bb9e-4db3-a9ad-0ca559a80ca0 service nova] Acquiring lock "0214a998-5624-46f9-801e-c582b4a297e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b2960a4e-4c6c-457e-bc3d-b7ca40441fdf req-88efaa3f-bb9e-4db3-a9ad-0ca559a80ca0 service nova] Lock "0214a998-5624-46f9-801e-c582b4a297e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b2960a4e-4c6c-457e-bc3d-b7ca40441fdf req-88efaa3f-bb9e-4db3-a9ad-0ca559a80ca0 service nova] Lock "0214a998-5624-46f9-801e-c582b4a297e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:39 user nova-compute[72444]: DEBUG nova.compute.manager [req-b2960a4e-4c6c-457e-bc3d-b7ca40441fdf req-88efaa3f-bb9e-4db3-a9ad-0ca559a80ca0 service nova] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] No waiting events found dispatching network-vif-plugged-62f68bc6-6c23-4a77-9000-46670e8312fa {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:51:39 user nova-compute[72444]: WARNING nova.compute.manager [req-b2960a4e-4c6c-457e-bc3d-b7ca40441fdf req-88efaa3f-bb9e-4db3-a9ad-0ca559a80ca0 service nova] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Received unexpected event network-vif-plugged-62f68bc6-6c23-4a77-9000-46670e8312fa for instance with vm_state building and task_state spawning.
Aug 03 04:51:39 user nova-compute[72444]: INFO nova.compute.manager [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Took 6.58 seconds to build instance.
Aug 03 04:51:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-be5a4dde-006e-475d-a488-e2ba4a5b6a28 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "0214a998-5624-46f9-801e-c582b4a297e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.721s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:44 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:44 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:51:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:45 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:51:45 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 04:51:46 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:51:47 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:51:48 user nova-compute[72444]: DEBUG nova.compute.manager [req-7599a07f-0709-4963-828e-62307198841b req-a18faa84-9e09-4aef-a11c-c32873694427 service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Received event network-changed-269c2e0d-94ee-4084-985a-58c5afed4411 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:51:48 user nova-compute[72444]: DEBUG nova.compute.manager [req-7599a07f-0709-4963-828e-62307198841b req-a18faa84-9e09-4aef-a11c-c32873694427 service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Refreshing instance network info cache due to event network-changed-269c2e0d-94ee-4084-985a-58c5afed4411. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:51:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7599a07f-0709-4963-828e-62307198841b req-a18faa84-9e09-4aef-a11c-c32873694427 service nova] Acquiring lock "refresh_cache-e2859322-6f99-442d-bee1-65fe49ce6360" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:51:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7599a07f-0709-4963-828e-62307198841b req-a18faa84-9e09-4aef-a11c-c32873694427 service nova] Acquired lock "refresh_cache-e2859322-6f99-442d-bee1-65fe49ce6360" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:51:48 user nova-compute[72444]: DEBUG nova.network.neutron [req-7599a07f-0709-4963-828e-62307198841b req-a18faa84-9e09-4aef-a11c-c32873694427 service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Refreshing network info cache for port 269c2e0d-94ee-4084-985a-58c5afed4411 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:51:48 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:51:48 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:51:49 user nova-compute[72444]: DEBUG nova.network.neutron [req-7599a07f-0709-4963-828e-62307198841b req-a18faa84-9e09-4aef-a11c-c32873694427 service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Updated VIF entry in instance network info cache for port 269c2e0d-94ee-4084-985a-58c5afed4411. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:51:49 user nova-compute[72444]: DEBUG nova.network.neutron [req-7599a07f-0709-4963-828e-62307198841b req-a18faa84-9e09-4aef-a11c-c32873694427 service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Updating instance_info_cache with network_info: [{"id": "269c2e0d-94ee-4084-985a-58c5afed4411", "address": "fa:16:3e:bd:11:20", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap269c2e0d-94", "ovs_interfaceid": "269c2e0d-94ee-4084-985a-58c5afed4411", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:51:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7599a07f-0709-4963-828e-62307198841b req-a18faa84-9e09-4aef-a11c-c32873694427 service nova] Releasing lock "refresh_cache-e2859322-6f99-442d-bee1-65fe49ce6360" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:51:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:49 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:51:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:50 user nova-compute[72444]: DEBUG nova.compute.manager [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Stashing vm_state: active {{(pid=72444) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 03 04:51:50 user nova-compute[72444]: DEBUG nova.compute.manager [req-3f8aaabb-74c0-4a30-a5a1-93ca8ca48d69 req-f36cff23-c345-4999-bc18-c5ee7c09ddb0 service nova] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Received event network-changed-73526f5e-c0da-4686-b2ab-e3859a2d6c85 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:51:50 user nova-compute[72444]: DEBUG nova.compute.manager [req-3f8aaabb-74c0-4a30-a5a1-93ca8ca48d69 req-f36cff23-c345-4999-bc18-c5ee7c09ddb0 service nova] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Refreshing instance network info cache due to event network-changed-73526f5e-c0da-4686-b2ab-e3859a2d6c85. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:51:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3f8aaabb-74c0-4a30-a5a1-93ca8ca48d69 req-f36cff23-c345-4999-bc18-c5ee7c09ddb0 service nova] Acquiring lock "refresh_cache-c4af22f7-45f8-4777-83ee-5cf1481c9fe8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:51:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3f8aaabb-74c0-4a30-a5a1-93ca8ca48d69 req-f36cff23-c345-4999-bc18-c5ee7c09ddb0 service nova] Acquired lock "refresh_cache-c4af22f7-45f8-4777-83ee-5cf1481c9fe8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:51:50 user nova-compute[72444]: DEBUG nova.network.neutron [req-3f8aaabb-74c0-4a30-a5a1-93ca8ca48d69 req-f36cff23-c345-4999-bc18-c5ee7c09ddb0 service nova] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Refreshing network info cache for port 73526f5e-c0da-4686-b2ab-e3859a2d6c85 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:51:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:50 user nova-compute[72444]: DEBUG nova.objects.instance [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lazy-loading 'pci_requests' on Instance uuid c4af22f7-45f8-4777-83ee-5cf1481c9fe8 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:51:50 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 04:51:50 user nova-compute[72444]: INFO nova.compute.claims [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Claim successful on node user
Aug 03 04:51:50 user nova-compute[72444]: DEBUG nova.objects.instance [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lazy-loading 'resources' on Instance uuid c4af22f7-45f8-4777-83ee-5cf1481c9fe8 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:51:50 user nova-compute[72444]: DEBUG nova.objects.instance [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lazy-loading 'pci_devices' on Instance uuid c4af22f7-45f8-4777-83ee-5cf1481c9fe8 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:51:50 user nova-compute[72444]: INFO nova.compute.resource_tracker [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Updating resource usage from migration b853e16a-0cca-4c10-bd43-429f4612a605
Aug 03 04:51:50 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:51:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:50 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Refreshing inventories for resource provider b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 03 04:51:50 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Updating ProviderTree inventory for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 03 04:51:50 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Updating inventory in ProviderTree for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 03 04:51:51 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Refreshing aggregate associations for resource provider b624a913-bb6b-4a17-8cd7-7b0950cff161, aggregates: None {{(pid=72444) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 03 04:51:51 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Refreshing trait associations for resource provider b624a913-bb6b-4a17-8cd7-7b0950cff161, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=72444) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 03 04:51:51 user nova-compute[72444]: DEBUG nova.network.neutron [req-3f8aaabb-74c0-4a30-a5a1-93ca8ca48d69 req-f36cff23-c345-4999-bc18-c5ee7c09ddb0 service nova] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Updated VIF entry in instance network info cache for port 73526f5e-c0da-4686-b2ab-e3859a2d6c85. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:51:51 user nova-compute[72444]: DEBUG nova.network.neutron [req-3f8aaabb-74c0-4a30-a5a1-93ca8ca48d69 req-f36cff23-c345-4999-bc18-c5ee7c09ddb0 service nova] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Updating instance_info_cache with network_info: [{"id": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "address": "fa:16:3e:5e:64:b2", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73526f5e-c0", "ovs_interfaceid": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:51:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3f8aaabb-74c0-4a30-a5a1-93ca8ca48d69 req-f36cff23-c345-4999-bc18-c5ee7c09ddb0 service nova] Releasing lock "refresh_cache-c4af22f7-45f8-4777-83ee-5cf1481c9fe8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:51:51 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:51:51 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:51:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.669s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:51 user nova-compute[72444]: INFO nova.compute.manager [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Migrating
Aug 03 04:51:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:51:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:51:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.487s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:51 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 04:51:51 user nova-compute[72444]: INFO nova.compute.rpcapi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 03 04:51:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:51:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "refresh_cache-c4af22f7-45f8-4777-83ee-5cf1481c9fe8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:51:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquired lock "refresh_cache-c4af22f7-45f8-4777-83ee-5cf1481c9fe8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:51:51 user nova-compute[72444]: DEBUG nova.network.neutron [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:51:51 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:51:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:52 user nova-compute[72444]: DEBUG nova.network.neutron [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Updating instance_info_cache with network_info: [{"id": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "address": "fa:16:3e:5e:64:b2", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73526f5e-c0", "ovs_interfaceid": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:51:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Releasing lock "refresh_cache-c4af22f7-45f8-4777-83ee-5cf1481c9fe8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:51:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:52 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Starting migrate_disk_and_power_off {{(pid=72444) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 03 04:51:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json" returned: 0 in 0.342s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG nova.compute.manager [req-b688e6e2-2dca-4a07-86a1-f20c14938a66 req-fdf35ca9-848a-4c1f-9c26-fed0dcf73859 service nova] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Received event network-vif-unplugged-73526f5e-c0da-4686-b2ab-e3859a2d6c85 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b688e6e2-2dca-4a07-86a1-f20c14938a66 req-fdf35ca9-848a-4c1f-9c26-fed0dcf73859 service nova] Acquiring lock "c4af22f7-45f8-4777-83ee-5cf1481c9fe8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b688e6e2-2dca-4a07-86a1-f20c14938a66 req-fdf35ca9-848a-4c1f-9c26-fed0dcf73859 service nova] Lock "c4af22f7-45f8-4777-83ee-5cf1481c9fe8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b688e6e2-2dca-4a07-86a1-f20c14938a66 req-fdf35ca9-848a-4c1f-9c26-fed0dcf73859 service nova] Lock "c4af22f7-45f8-4777-83ee-5cf1481c9fe8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG nova.compute.manager [req-b688e6e2-2dca-4a07-86a1-f20c14938a66 req-fdf35ca9-848a-4c1f-9c26-fed0dcf73859 service nova] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] No waiting events found dispatching network-vif-unplugged-73526f5e-c0da-4686-b2ab-e3859a2d6c85 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:51:53 user nova-compute[72444]: WARNING nova.compute.manager [req-b688e6e2-2dca-4a07-86a1-f20c14938a66 req-fdf35ca9-848a-4c1f-9c26-fed0dcf73859 service nova] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Received unexpected event network-vif-unplugged-73526f5e-c0da-4686-b2ab-e3859a2d6c85 for instance with vm_state active and task_state resize_migrating.
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:53 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Instance destroyed successfully.
Aug 03 04:51:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:49:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-469217001',display_name='tempest-ServerActionsTestOtherA-server-469217001',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-469217001',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDRHy6esW1Y8XjdGq8kBFPOjS8VFKeCY2PZq9mP7iSJL6lEWXDaTZRjD+kixW9a+QL5lbang2hEmB7Vd5YkTr9lWHW5QxoFRm5vUQ48SZ1Yf+s27SIuqNanyEMadE17HUA==',key_name='tempest-keypair-1657293229',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:50:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='56d17468ddd64dfabba3a2c7b6df71ef',ramdisk_id='',reservation_id='r-s4u10w6o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1629114222',owner_user_name='tempest-ServerActionsTestOtherA-1629114222-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:51:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7120445361dc4363b4cc6c7671a2716e',uuid=c4af22f7-45f8-4777-83ee-5cf1481c9fe8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "address": "fa:16:3e:5e:64:b2", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-918052058-network", "vif_mac": "fa:16:3e:5e:64:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73526f5e-c0", "ovs_interfaceid": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Converting VIF {"id": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "address": "fa:16:3e:5e:64:b2", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-918052058-network", "vif_mac": "fa:16:3e:5e:64:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73526f5e-c0", "ovs_interfaceid": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:64:b2,bridge_name='br-int',has_traffic_filtering=True,id=73526f5e-c0da-4686-b2ab-e3859a2d6c85,network=Network(95b97be9-d6db-45e9-b0f1-a72fc90b69d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73526f5e-c0') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG os_vif [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:64:b2,bridge_name='br-int',has_traffic_filtering=True,id=73526f5e-c0da-4686-b2ab-e3859a2d6c85,network=Network(95b97be9-d6db-45e9-b0f1-a72fc90b69d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73526f5e-c0') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73526f5e-c0, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0214a998-5624-46f9-801e-c582b4a297e5/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:51:53 user nova-compute[72444]: INFO os_vif [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:64:b2,bridge_name='br-int',has_traffic_filtering=True,id=73526f5e-c0da-4686-b2ab-e3859a2d6c85,network=Network(95b97be9-d6db-45e9-b0f1-a72fc90b69d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73526f5e-c0')
Aug 03 04:51:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xJiGAEmX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:51:53 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:51:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[36af5f11-81c3-4422-aab6-cba48d32e57e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53ea8c2-85ab-48ca-9d11-8b282c381f5a]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:51:53 user nova-compute[72444]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:51:53 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:51:53 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:51:53 user nova-compute[72444]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:51:53 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:51:53 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30a0e28d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86'): ({'sdg'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Removing single pathed devices sdg {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ada50f7-7f34-4c03-b624-80122cdb2217]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a43a7ae-f9c5-4974-bcc2-49d6f25ed5e7]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Flushing IO for device /dev/sdg {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0214a998-5624-46f9-801e-c582b4a297e5/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0214a998-5624-46f9-801e-c582b4a297e5/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c61bfbc-143e-4455-8fca-9ec6dc751387]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.037s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe40fd48-a91c-4c2d-8f85-be49d348e0ad]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] SCSI volumes sdg have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26231323539363265', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_9848c521', '/dev/disk/by-id/scsi-1SCST_BIO9848c521-b125962edea826c2') {{(pid=84280) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[285d6e63-8394-4ee8-9fc7-69bcafd69f51]: (4, None) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ac1a1f-e5a8-455d-a841-1c1414a470be]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0214a998-5624-46f9-801e-c582b4a297e5/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2cf003-b901-400f-94fb-e575f251f1a8]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86, portal: 172.16.0.220,3260]
Aug 03 04:51:53 user nova-compute[72444]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86, portal: 172.16.0.220,3260] successful.
Aug 03 04:51:53 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d080b438-0ed7-45c5-8d39-691c7bddd5ea]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] <== disconnect_volume: return (383ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] skipping disk /dev/sdg (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk (vdb) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:51:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:54 user nova-compute[72444]: DEBUG nova.network.neutron [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Port 73526f5e-c0da-4686-b2ab-e3859a2d6c85 binding to destination host user is already ACTIVE {{(pid=72444) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 03 04:51:55 user nova-compute[72444]: DEBUG nova.compute.manager [req-7aa33c72-584e-493c-82fb-4a710af7bb23 req-46ad04df-6a44-4eb0-9fe1-9584396a8986 service nova] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Received event network-vif-plugged-73526f5e-c0da-4686-b2ab-e3859a2d6c85 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:51:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7aa33c72-584e-493c-82fb-4a710af7bb23 req-46ad04df-6a44-4eb0-9fe1-9584396a8986 service nova] Acquiring lock "c4af22f7-45f8-4777-83ee-5cf1481c9fe8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7aa33c72-584e-493c-82fb-4a710af7bb23 req-46ad04df-6a44-4eb0-9fe1-9584396a8986 service nova] Lock "c4af22f7-45f8-4777-83ee-5cf1481c9fe8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7aa33c72-584e-493c-82fb-4a710af7bb23 req-46ad04df-6a44-4eb0-9fe1-9584396a8986 service nova] Lock "c4af22f7-45f8-4777-83ee-5cf1481c9fe8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:55 user nova-compute[72444]: DEBUG nova.compute.manager [req-7aa33c72-584e-493c-82fb-4a710af7bb23 req-46ad04df-6a44-4eb0-9fe1-9584396a8986 service nova] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] No waiting events found dispatching network-vif-plugged-73526f5e-c0da-4686-b2ab-e3859a2d6c85 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:51:55 user nova-compute[72444]: WARNING nova.compute.manager [req-7aa33c72-584e-493c-82fb-4a710af7bb23 req-46ad04df-6a44-4eb0-9fe1-9584396a8986 service nova] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Received unexpected event network-vif-plugged-73526f5e-c0da-4686-b2ab-e3859a2d6c85 for instance with vm_state active and task_state resize_migrating.
Aug 03 04:51:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "c4af22f7-45f8-4777-83ee-5cf1481c9fe8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "c4af22f7-45f8-4777-83ee-5cf1481c9fe8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "c4af22f7-45f8-4777-83ee-5cf1481c9fe8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:55 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:51:55 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:51:55 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=7390MB free_disk=25.554248809814453GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 04:51:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:51:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:51:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "refresh_cache-c4af22f7-45f8-4777-83ee-5cf1481c9fe8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:51:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquired lock "refresh_cache-c4af22f7-45f8-4777-83ee-5cf1481c9fe8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:51:55 user nova-compute[72444]: DEBUG nova.network.neutron [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:51:55 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Applying migration context for instance c4af22f7-45f8-4777-83ee-5cf1481c9fe8 as it has an incoming, in-progress migration b853e16a-0cca-4c10-bd43-429f4612a605. Migration status is post-migrating {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 03 04:51:55 user nova-compute[72444]: INFO nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Updating resource usage from migration b853e16a-0cca-4c10-bd43-429f4612a605
Aug 03 04:51:55 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:51:55 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 81725845-6158-4e34-bedb-6e41219bc227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:51:55 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance b6ed9c42-fa6e-4a0d-8312-588471e157f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:51:55 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance e2859322-6f99-442d-bee1-65fe49ce6360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:51:55 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:51:55 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 0b219bf3-a3b6-44b5-946e-c10e7498e1d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:51:55 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance c77e96da-6411-4ae9-af05-8e9bb3c432c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:51:55 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance c94f537a-b1a1-4cea-996d-e1a88a2c9dac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:51:55 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 0214a998-5624-46f9-801e-c582b4a297e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:51:55 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Migration b853e16a-0cca-4c10-bd43-429f4612a605 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 03 04:51:55 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance c4af22f7-45f8-4777-83ee-5cf1481c9fe8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:51:55 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 04:51:55 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 04:51:56 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:51:56 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:51:56 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 04:51:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.658s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:51:56 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:51:56 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72444) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 03 04:51:56 user nova-compute[72444]: DEBUG nova.network.neutron [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Updating instance_info_cache with network_info: [{"id": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "address": "fa:16:3e:5e:64:b2", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73526f5e-c0", "ovs_interfaceid": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:51:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Releasing lock "refresh_cache-c4af22f7-45f8-4777-83ee-5cf1481c9fe8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:51:56 user nova-compute[72444]: DEBUG os_brick.utils [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:51:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:56 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d80592b-de34-4c59-a33d-aa4d9dc40392]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:56 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8dd31e5-2d32-4d41-a279-d780eaad238c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:51:56 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ac668e-d304-4ae8-a353-ca96fa8a085e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:56 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c9bde2-f676-4f2f-932d-cc5896be9cd0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:51:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 04:51:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:51:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:51:56 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 04:51:56 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6510cb66-ede5-4d26-bcd8-4c97c0a62ffc]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:51:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 04:51:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 04:51:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 04:51:56 user nova-compute[72444]: DEBUG os_brick.utils [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:51:57 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:51:57 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 04:51:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-b6ed9c42-fa6e-4a0d-8312-588471e157f7" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:51:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-b6ed9c42-fa6e-4a0d-8312-588471e157f7" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:51:57 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 04:51:57 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:58 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Updating instance_info_cache with network_info: [{"id": "bd9827e6-3c6f-4bb3-8889-1ae45107f6f0", "address": "fa:16:3e:61:54:b7", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd9827e6-3c", "ovs_interfaceid": "bd9827e6-3c6f-4bb3-8889-1ae45107f6f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:51:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-b6ed9c42-fa6e-4a0d-8312-588471e157f7" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:51:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 04:51:58 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:51:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:51:59 user nova-compute[72444]: DEBUG nova.compute.manager [req-a54bf32a-2935-4092-bed2-86ccff5dc788 req-5b5bd533-3775-4c42-ad2a-a9efaa435fc7 service nova] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Received event network-changed-b1d5afe6-1a33-4b79-a06b-79f4ea86652a {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:51:59 user nova-compute[72444]: DEBUG nova.compute.manager [req-a54bf32a-2935-4092-bed2-86ccff5dc788 req-5b5bd533-3775-4c42-ad2a-a9efaa435fc7 service nova] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Refreshing instance network info cache due to event network-changed-b1d5afe6-1a33-4b79-a06b-79f4ea86652a. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:51:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a54bf32a-2935-4092-bed2-86ccff5dc788 req-5b5bd533-3775-4c42-ad2a-a9efaa435fc7 service nova] Acquiring lock "refresh_cache-c94f537a-b1a1-4cea-996d-e1a88a2c9dac" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:51:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a54bf32a-2935-4092-bed2-86ccff5dc788 req-5b5bd533-3775-4c42-ad2a-a9efaa435fc7 service nova] Acquired lock "refresh_cache-c94f537a-b1a1-4cea-996d-e1a88a2c9dac" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:51:59 user nova-compute[72444]: DEBUG nova.network.neutron [req-a54bf32a-2935-4092-bed2-86ccff5dc788 req-5b5bd533-3775-4c42-ad2a-a9efaa435fc7 service nova] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Refreshing network info cache for port b1d5afe6-1a33-4b79-a06b-79f4ea86652a {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:52:00 user nova-compute[72444]: DEBUG nova.network.neutron [req-a54bf32a-2935-4092-bed2-86ccff5dc788 req-5b5bd533-3775-4c42-ad2a-a9efaa435fc7 service nova] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Updated VIF entry in instance network info cache for port b1d5afe6-1a33-4b79-a06b-79f4ea86652a. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:52:00 user nova-compute[72444]: DEBUG nova.network.neutron [req-a54bf32a-2935-4092-bed2-86ccff5dc788 req-5b5bd533-3775-4c42-ad2a-a9efaa435fc7 service nova] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Updating instance_info_cache with network_info: [{"id": "b1d5afe6-1a33-4b79-a06b-79f4ea86652a", "address": "fa:16:3e:7f:5d:57", "network": {"id": "912c9d5f-3b43-4977-a056-cf05688bee52", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1503012962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9730911c84c0fa38568d481753766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1d5afe6-1a", "ovs_interfaceid": "b1d5afe6-1a33-4b79-a06b-79f4ea86652a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:52:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a54bf32a-2935-4092-bed2-86ccff5dc788 req-5b5bd533-3775-4c42-ad2a-a9efaa435fc7 service nova] Releasing lock "refresh_cache-c94f537a-b1a1-4cea-996d-e1a88a2c9dac" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:52:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Acquiring lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:52:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:52:04 user nova-compute[72444]: DEBUG nova.objects.instance [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lazy-loading 'flavor' on Instance uuid c94f537a-b1a1-4cea-996d-e1a88a2c9dac {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:52:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:52:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Acquiring lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:52:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:52:04 user nova-compute[72444]: INFO nova.compute.manager [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Attaching volume 98581bab-0a05-403a-a15f-6458eb7ba2d3 to /dev/vdb
Aug 03 04:52:04 user nova-compute[72444]: DEBUG os_brick.utils [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:52:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:04 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2e0ab9-603f-4b65-852f-43c81070240e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:04 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2967b7-4b1d-4bb1-a6b5-38cef4fddc9a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:04 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[769cd5ee-e878-45dc-baf5-47bd510d442f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:04 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec24795-7b4c-470b-ade2-a32c1d8afcf8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:52:04 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 04:52:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:52:04 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 04:52:04 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d59fbb-a626-407d-bd98-dcb2b3d0fc14]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:04 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 04:52:04 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 04:52:04 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 04:52:04 user nova-compute[72444]: DEBUG os_brick.utils [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:52:04 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Updating existing volume attachment record: 2125f766-65aa-4a91-96d2-710eb04031bf {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 04:52:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:08 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691038313.3425944, c4af22f7-45f8-4777-83ee-5cf1481c9fe8 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:52:08 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] VM Stopped (Lifecycle Event)
Aug 03 04:52:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:08 user nova-compute[72444]: DEBUG nova.compute.manager [None req-8ee48b12-dfdd-43cf-ac0b-96571005538c None None] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:52:08 user nova-compute[72444]: DEBUG nova.compute.manager [None req-8ee48b12-dfdd-43cf-ac0b-96571005538c None None] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:52:08 user nova-compute[72444]: INFO nova.compute.manager [None req-8ee48b12-dfdd-43cf-ac0b-96571005538c None None] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 03 04:52:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dYNxAjtS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:52:14 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:52:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.005s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:52:14 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:52:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:52:14 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:52:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d09f28-c3fd-428a-be20-b3fa0832db36]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 04:52:14 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[653b715f-8061-4998-8e58-8f30d1272d16]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3] added
Aug 03 04:52:14 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[564bdbce-df1a-4350-9882-a4251b55ec66]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9652c075-a297-4a2c-8262-67443830d904]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dYNxAjtS {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dYNxAjtS" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d83b668-8cce-43d2-a23a-2ec98be72ead]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dYNxAjtS'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1b69f3-93ca-426f-877f-23f0294ed039]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[db63c171-613b-4f15-a9e2-3fef467733a7]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:52:14 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:52:14 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:52:14 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:52:14 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e6510b-32de-46c7-80e7-576723f2b4be]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3, portal: 172.16.0.220,3260]
Aug 03 04:52:14 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3, portal: 172.16.0.220,3260] successful.
Aug 03 04:52:14 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db4fd18-3f0a-4bb7-a762-66627359feba]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8928d5-4e69-4002-aa3f-595ff6da09fb]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:52:14 user nova-compute[72444]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 (non-flash)
Aug 03 04:52:14 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:52:14 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:52:14 user nova-compute[72444]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 (non-flash)
Aug 03 04:52:14 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:52:14 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[003096ce-b0e4-46e6-988b-d0d5e30392a8]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:52:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dYNxAjtS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:52:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:52:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '23336616230663838', 'path': '/dev/sdc'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:52:15 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336616230663838', 'path': '/dev/sdc'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:52:15 user nova-compute[72444]: DEBUG nova.objects.instance [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lazy-loading 'flavor' on Instance uuid c94f537a-b1a1-4cea-996d-e1a88a2c9dac {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:52:15 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 04:52:15 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:52:15 user nova-compute[72444]:   <source dev="/dev/sdc"/>
Aug 03 04:52:15 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:52:15 user nova-compute[72444]:   <serial>98581bab-0a05-403a-a15f-6458eb7ba2d3</serial>
Aug 03 04:52:15 user nova-compute[72444]: </disk>
Aug 03 04:52:15 user nova-compute[72444]:  {{(pid=72444) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 04:52:15 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:52:15 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:52:15 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] No VIF found with MAC fa:16:3e:7f:5d:57, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:52:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b5c1a640-57f1-42cb-8746-05ce83c4135b tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.492s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:52:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "863f0679-c64c-4a13-8028-4cb194f8f99f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:52:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "863f0679-c64c-4a13-8028-4cb194f8f99f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:52:16 user nova-compute[72444]: DEBUG nova.compute.manager [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 04:52:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:52:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:52:16 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 04:52:16 user nova-compute[72444]: INFO nova.compute.claims [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Claim successful on node user
Aug 03 04:52:17 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:52:17 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:52:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.613s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:52:17 user nova-compute[72444]: DEBUG nova.compute.manager [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 04:52:17 user nova-compute[72444]: DEBUG nova.compute.manager [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 04:52:17 user nova-compute[72444]: DEBUG nova.network.neutron [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 04:52:17 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 04:52:17 user nova-compute[72444]: DEBUG nova.compute.manager [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 04:52:17 user nova-compute[72444]: DEBUG nova.policy [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ceede92aa3a74060a7f57d29d0d97aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '929fd4a3127b475282426d4412e58def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 04:52:17 user nova-compute[72444]: INFO nova.virt.block_device [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Booting with volume-backed-image 9a69e530-bd68-45b7-bffb-f7168139ceb0 at /dev/vda
Aug 03 04:52:18 user nova-compute[72444]: DEBUG nova.network.neutron [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Successfully created port: 74465661-452c-4dba-b207-94f35c3fa50d {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:52:18 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:19 user nova-compute[72444]: DEBUG nova.network.neutron [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Successfully updated port: 74465661-452c-4dba-b207-94f35c3fa50d {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:52:19 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "refresh_cache-863f0679-c64c-4a13-8028-4cb194f8f99f" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:52:19 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquired lock "refresh_cache-863f0679-c64c-4a13-8028-4cb194f8f99f" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:52:19 user nova-compute[72444]: DEBUG nova.network.neutron [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:52:19 user nova-compute[72444]: DEBUG nova.compute.manager [req-1b3eadc4-9952-44e2-a9f6-978ce75ac9ec req-86bd5bfa-84c2-4115-97ba-4442d6e34102 service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Received event network-changed-74465661-452c-4dba-b207-94f35c3fa50d {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:52:19 user nova-compute[72444]: DEBUG nova.compute.manager [req-1b3eadc4-9952-44e2-a9f6-978ce75ac9ec req-86bd5bfa-84c2-4115-97ba-4442d6e34102 service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Refreshing instance network info cache due to event network-changed-74465661-452c-4dba-b207-94f35c3fa50d. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:52:19 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-1b3eadc4-9952-44e2-a9f6-978ce75ac9ec req-86bd5bfa-84c2-4115-97ba-4442d6e34102 service nova] Acquiring lock "refresh_cache-863f0679-c64c-4a13-8028-4cb194f8f99f" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:52:19 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:19 user nova-compute[72444]: DEBUG nova.network.neutron [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:52:19 user nova-compute[72444]: DEBUG nova.network.neutron [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Updating instance_info_cache with network_info: [{"id": "74465661-452c-4dba-b207-94f35c3fa50d", "address": "fa:16:3e:ea:30:b2", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74465661-45", "ovs_interfaceid": "74465661-452c-4dba-b207-94f35c3fa50d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:52:19 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Releasing lock "refresh_cache-863f0679-c64c-4a13-8028-4cb194f8f99f" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:52:19 user nova-compute[72444]: DEBUG nova.compute.manager [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Instance network_info: |[{"id": "74465661-452c-4dba-b207-94f35c3fa50d", "address": "fa:16:3e:ea:30:b2", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74465661-45", "ovs_interfaceid": "74465661-452c-4dba-b207-94f35c3fa50d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 04:52:19 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-1b3eadc4-9952-44e2-a9f6-978ce75ac9ec req-86bd5bfa-84c2-4115-97ba-4442d6e34102 service nova] Acquired lock "refresh_cache-863f0679-c64c-4a13-8028-4cb194f8f99f" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:52:19 user nova-compute[72444]: DEBUG nova.network.neutron [req-1b3eadc4-9952-44e2-a9f6-978ce75ac9ec req-86bd5bfa-84c2-4115-97ba-4442d6e34102 service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Refreshing network info cache for port 74465661-452c-4dba-b207-94f35c3fa50d {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:52:20 user nova-compute[72444]: DEBUG nova.network.neutron [req-1b3eadc4-9952-44e2-a9f6-978ce75ac9ec req-86bd5bfa-84c2-4115-97ba-4442d6e34102 service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Updated VIF entry in instance network info cache for port 74465661-452c-4dba-b207-94f35c3fa50d. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:52:20 user nova-compute[72444]: DEBUG nova.network.neutron [req-1b3eadc4-9952-44e2-a9f6-978ce75ac9ec req-86bd5bfa-84c2-4115-97ba-4442d6e34102 service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Updating instance_info_cache with network_info: [{"id": "74465661-452c-4dba-b207-94f35c3fa50d", "address": "fa:16:3e:ea:30:b2", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74465661-45", "ovs_interfaceid": "74465661-452c-4dba-b207-94f35c3fa50d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:52:20 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-1b3eadc4-9952-44e2-a9f6-978ce75ac9ec req-86bd5bfa-84c2-4115-97ba-4442d6e34102 service nova] Releasing lock "refresh_cache-863f0679-c64c-4a13-8028-4cb194f8f99f" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:52:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Starting finish_migration {{(pid=72444) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Instance directory exists: not creating {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 03 04:52:25 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Creating image(s)
Aug 03 04:52:25 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Did not create local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Ensure instance console log exists: /opt/stack/data/nova/instances/c4af22f7-45f8-4777-83ee-5cf1481c9fe8/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Start _get_guest_xml network_info=[{"id": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "address": "fa:16:3e:5e:64:b2", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-918052058-network", "vif_mac": "fa:16:3e:5e:64:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73526f5e-c0", "ovs_interfaceid": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xJiGAEmX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'c4af22f7-45f8-4777-83ee-5cf1481c9fe8', 'attached_at': '2023-08-03T04:52:25.000000', 'detached_at': '', 'volume_id': 'a14d792b-d953-43f8-8af2-c2ac8f765b86', 'serial': 'a14d792b-d953-43f8-8af2-c2ac8f765b86'}, 'disk_bus': 'virtio', 'attachment_id': 'df650986-7640-4e7e-b2c3-7815d90bfb41', 'guest_format': None, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:52:25 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:52:25 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:52:25 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG nova.objects.instance [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lazy-loading 'vcpu_model' on Instance uuid c4af22f7-45f8-4777-83ee-5cf1481c9fe8 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xJiGAEmX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:52:25 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:52:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:52:25 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:52:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:52:25 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:52:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2252c1d5-7bec-4726-824a-5122944154a5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 04:52:25 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec47981e-be72-4c01-87ad-c4c4710abe46]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86] added
Aug 03 04:52:25 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f131a391-2b13-463e-9b1e-6120058ddab3]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e02b421-6172-44d9-9dd2-4b28b2cd3cba]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xJiGAEmX {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xJiGAEmX" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8a9808-2d73-4c5d-a14c-3345bdd2f539]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xJiGAEmX'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7854540-304e-46a9-b613-a754e4183211]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb40af4-d277-4c50-9ef4-a576ab8fc9c0]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:52:25 user nova-compute[72444]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 (non-flash)
Aug 03 04:52:25 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:52:25 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:52:25 user nova-compute[72444]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 (non-flash)
Aug 03 04:52:25 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:52:25 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0209d6ad-3ff0-461c-beab-8961063d772a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86, portal: 172.16.0.220,3260]
Aug 03 04:52:25 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86, portal: 172.16.0.220,3260] successful.
Aug 03 04:52:25 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[869517af-85dc-4c85-ad50-ef548c54b13b]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd93d7d-f85e-44e3-ba74-229f00088f2e]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:52:25 user nova-compute[72444]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 (non-flash)
Aug 03 04:52:25 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:52:25 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:52:25 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:52:25 user nova-compute[72444]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 (non-flash)
Aug 03 04:52:25 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:52:25 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:52:25 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4cbabd-91c3-4476-b78e-70b8dab68d9e]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:25 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: None {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:52:26 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:52:26 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xJiGAEmX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:52:26 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:52:26 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '26231323539363265', 'path': '/dev/sdd'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:52:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231323539363265', 'path': '/dev/sdd'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:52:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:49:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-469217001',display_name='tempest-ServerActionsTestOtherA-server-469217001',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-469217001',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDRHy6esW1Y8XjdGq8kBFPOjS8VFKeCY2PZq9mP7iSJL6lEWXDaTZRjD+kixW9a+QL5lbang2hEmB7Vd5YkTr9lWHW5QxoFRm5vUQ48SZ1Yf+s27SIuqNanyEMadE17HUA==',key_name='tempest-keypair-1657293229',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:50:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='56d17468ddd64dfabba3a2c7b6df71ef',ramdisk_id='',reservation_id='r-s4u10w6o',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1629114222',owner_user_name='tempest-ServerActionsTestOtherA-1629114222-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:51:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7120445361dc4363b4cc6c7671a2716e',uuid=c4af22f7-45f8-4777-83ee-5cf1481c9fe8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "address": "fa:16:3e:5e:64:b2", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-918052058-network", "vif_mac": "fa:16:3e:5e:64:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73526f5e-c0", "ovs_interfaceid": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:52:26 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Converting VIF {"id": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "address": "fa:16:3e:5e:64:b2", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-918052058-network", "vif_mac": "fa:16:3e:5e:64:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73526f5e-c0", "ovs_interfaceid": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:52:26 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:64:b2,bridge_name='br-int',has_traffic_filtering=True,id=73526f5e-c0da-4686-b2ab-e3859a2d6c85,network=Network(95b97be9-d6db-45e9-b0f1-a72fc90b69d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73526f5e-c0') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:52:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:52:26 user nova-compute[72444]:   <uuid>c4af22f7-45f8-4777-83ee-5cf1481c9fe8</uuid>
Aug 03 04:52:26 user nova-compute[72444]:   <name>instance-00000019</name>
Aug 03 04:52:26 user nova-compute[72444]:   <memory>2097152</memory>
Aug 03 04:52:26 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:52:26 user nova-compute[72444]:   <metadata>
Aug 03 04:52:26 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:52:26 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:52:26 user nova-compute[72444]:       <nova:name>tempest-ServerActionsTestOtherA-server-469217001</nova:name>
Aug 03 04:52:26 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:52:25</nova:creationTime>
Aug 03 04:52:26 user nova-compute[72444]:       <nova:flavor name="m1.small">
Aug 03 04:52:26 user nova-compute[72444]:         <nova:memory>2048</nova:memory>
Aug 03 04:52:26 user nova-compute[72444]:         <nova:disk>20</nova:disk>
Aug 03 04:52:26 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:52:26 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:52:26 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:52:26 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:52:26 user nova-compute[72444]:       <nova:owner>
Aug 03 04:52:26 user nova-compute[72444]:         <nova:user uuid="7120445361dc4363b4cc6c7671a2716e">tempest-ServerActionsTestOtherA-1629114222-project-member</nova:user>
Aug 03 04:52:26 user nova-compute[72444]:         <nova:project uuid="56d17468ddd64dfabba3a2c7b6df71ef">tempest-ServerActionsTestOtherA-1629114222</nova:project>
Aug 03 04:52:26 user nova-compute[72444]:       </nova:owner>
Aug 03 04:52:26 user nova-compute[72444]:       <nova:ports>
Aug 03 04:52:26 user nova-compute[72444]:         <nova:port uuid="73526f5e-c0da-4686-b2ab-e3859a2d6c85">
Aug 03 04:52:26 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 03 04:52:26 user nova-compute[72444]:         </nova:port>
Aug 03 04:52:26 user nova-compute[72444]:       </nova:ports>
Aug 03 04:52:26 user nova-compute[72444]:     </nova:instance>
Aug 03 04:52:26 user nova-compute[72444]:   </metadata>
Aug 03 04:52:26 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:52:26 user nova-compute[72444]:     <system>
Aug 03 04:52:26 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:52:26 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:52:26 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:52:26 user nova-compute[72444]:       <entry name="serial">c4af22f7-45f8-4777-83ee-5cf1481c9fe8</entry>
Aug 03 04:52:26 user nova-compute[72444]:       <entry name="uuid">c4af22f7-45f8-4777-83ee-5cf1481c9fe8</entry>
Aug 03 04:52:26 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:52:26 user nova-compute[72444]:     </system>
Aug 03 04:52:26 user nova-compute[72444]:   </sysinfo>
Aug 03 04:52:26 user nova-compute[72444]:   <os>
Aug 03 04:52:26 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:52:26 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:52:26 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:52:26 user nova-compute[72444]:   </os>
Aug 03 04:52:26 user nova-compute[72444]:   <features>
Aug 03 04:52:26 user nova-compute[72444]:     <acpi/>
Aug 03 04:52:26 user nova-compute[72444]:     <apic/>
Aug 03 04:52:26 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:52:26 user nova-compute[72444]:   </features>
Aug 03 04:52:26 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:52:26 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:52:26 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:52:26 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:52:26 user nova-compute[72444]:   </clock>
Aug 03 04:52:26 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:52:26 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:52:26 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:52:26 user nova-compute[72444]:   </cpu>
Aug 03 04:52:26 user nova-compute[72444]:   <devices>
Aug 03 04:52:26 user nova-compute[72444]:     <disk type="block" device="disk">
Aug 03 04:52:26 user nova-compute[72444]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:52:26 user nova-compute[72444]:       <source dev="/dev/sdd"/>
Aug 03 04:52:26 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:52:26 user nova-compute[72444]:       <serial>a14d792b-d953-43f8-8af2-c2ac8f765b86</serial>
Aug 03 04:52:26 user nova-compute[72444]:     </disk>
Aug 03 04:52:26 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:52:26 user nova-compute[72444]:       <mac address="fa:16:3e:5e:64:b2"/>
Aug 03 04:52:26 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:52:26 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:52:26 user nova-compute[72444]:       <target dev="tap73526f5e-c0"/>
Aug 03 04:52:26 user nova-compute[72444]:     </interface>
Aug 03 04:52:26 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:52:26 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/c4af22f7-45f8-4777-83ee-5cf1481c9fe8/console.log" append="off"/>
Aug 03 04:52:26 user nova-compute[72444]:     </serial>
Aug 03 04:52:26 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:52:26 user nova-compute[72444]:     <video>
Aug 03 04:52:26 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:52:26 user nova-compute[72444]:     </video>
Aug 03 04:52:26 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:52:26 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:52:26 user nova-compute[72444]:     </rng>
Aug 03 04:52:26 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:52:26 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:52:26 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:52:26 user nova-compute[72444]:     </memballoon>
Aug 03 04:52:26 user nova-compute[72444]:   </devices>
Aug 03 04:52:26 user nova-compute[72444]: </domain>
Aug 03 04:52:26 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:52:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:49:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-469217001',display_name='tempest-ServerActionsTestOtherA-server-469217001',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-469217001',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDRHy6esW1Y8XjdGq8kBFPOjS8VFKeCY2PZq9mP7iSJL6lEWXDaTZRjD+kixW9a+QL5lbang2hEmB7Vd5YkTr9lWHW5QxoFRm5vUQ48SZ1Yf+s27SIuqNanyEMadE17HUA==',key_name='tempest-keypair-1657293229',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:50:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='56d17468ddd64dfabba3a2c7b6df71ef',ramdisk_id='',reservation_id='r-s4u10w6o',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1629114222',owner_user_name='tempest-ServerActionsTestOtherA-1629114222-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:51:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7120445361dc4363b4cc6c7671a2716e',uuid=c4af22f7-45f8-4777-83ee-5cf1481c9fe8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "address": "fa:16:3e:5e:64:b2", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-918052058-network", "vif_mac": "fa:16:3e:5e:64:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73526f5e-c0", "ovs_interfaceid": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:52:26 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Converting VIF {"id": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "address": "fa:16:3e:5e:64:b2", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-918052058-network", "vif_mac": "fa:16:3e:5e:64:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73526f5e-c0", "ovs_interfaceid": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:52:26 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:64:b2,bridge_name='br-int',has_traffic_filtering=True,id=73526f5e-c0da-4686-b2ab-e3859a2d6c85,network=Network(95b97be9-d6db-45e9-b0f1-a72fc90b69d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73526f5e-c0') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:52:26 user nova-compute[72444]: DEBUG os_vif [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:64:b2,bridge_name='br-int',has_traffic_filtering=True,id=73526f5e-c0da-4686-b2ab-e3859a2d6c85,network=Network(95b97be9-d6db-45e9-b0f1-a72fc90b69d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73526f5e-c0') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:52:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:52:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:52:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73526f5e-c0, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:52:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap73526f5e-c0, col_values=(('external_ids', {'iface-id': '73526f5e-c0da-4686-b2ab-e3859a2d6c85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:64:b2', 'vm-uuid': 'c4af22f7-45f8-4777-83ee-5cf1481c9fe8'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:52:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:52:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:26 user nova-compute[72444]: INFO os_vif [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:64:b2,bridge_name='br-int',has_traffic_filtering=True,id=73526f5e-c0da-4686-b2ab-e3859a2d6c85,network=Network(95b97be9-d6db-45e9-b0f1-a72fc90b69d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73526f5e-c0')
Aug 03 04:52:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:52:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] No VIF found with MAC fa:16:3e:5e:64:b2, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:52:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:28 user nova-compute[72444]: DEBUG os_brick.utils [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:52:28 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:28 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:28 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d6f6d5-ab32-4292-bdc5-7a295ed49dd6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:28 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:28 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:28 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4e19b6-41ab-45de-b546-24d42cda7147]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:28 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:28 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:28 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[666a8294-0ae0-4b58-8a05-5543b49f9e48]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:28 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06f8499-5907-40fc-a5b8-1bb358e17b48]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:28 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:28 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:52:28 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 04:52:28 user nova-compute[72444]: DEBUG nova.compute.manager [req-94609d63-1901-47ae-9134-ba32936782f7 req-d89943f7-987a-43c4-bfaf-95e9bc638f15 service nova] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Received event network-vif-plugged-73526f5e-c0da-4686-b2ab-e3859a2d6c85 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:52:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-94609d63-1901-47ae-9134-ba32936782f7 req-d89943f7-987a-43c4-bfaf-95e9bc638f15 service nova] Acquiring lock "c4af22f7-45f8-4777-83ee-5cf1481c9fe8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:52:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-94609d63-1901-47ae-9134-ba32936782f7 req-d89943f7-987a-43c4-bfaf-95e9bc638f15 service nova] Lock "c4af22f7-45f8-4777-83ee-5cf1481c9fe8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:52:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-94609d63-1901-47ae-9134-ba32936782f7 req-d89943f7-987a-43c4-bfaf-95e9bc638f15 service nova] Lock "c4af22f7-45f8-4777-83ee-5cf1481c9fe8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:52:28 user nova-compute[72444]: DEBUG nova.compute.manager [req-94609d63-1901-47ae-9134-ba32936782f7 req-d89943f7-987a-43c4-bfaf-95e9bc638f15 service nova] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] No waiting events found dispatching network-vif-plugged-73526f5e-c0da-4686-b2ab-e3859a2d6c85 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:52:28 user nova-compute[72444]: WARNING nova.compute.manager [req-94609d63-1901-47ae-9134-ba32936782f7 req-d89943f7-987a-43c4-bfaf-95e9bc638f15 service nova] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Received unexpected event network-vif-plugged-73526f5e-c0da-4686-b2ab-e3859a2d6c85 for instance with vm_state active and task_state resize_finish.
Aug 03 04:52:28 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:28 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:52:28 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 04:52:28 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b034ec6-9722-4fe4-923d-2192d255db57]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:28 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 04:52:28 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 04:52:28 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 04:52:28 user nova-compute[72444]: DEBUG os_brick.utils [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:52:28 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Updating existing volume attachment record: d30a3dc2-bff3-4986-9e96-91e1d116a1fc {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 04:52:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:29 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:30 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038350.4115505, c4af22f7-45f8-4777-83ee-5cf1481c9fe8 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:52:30 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] VM Resumed (Lifecycle Event)
Aug 03 04:52:30 user nova-compute[72444]: DEBUG nova.compute.manager [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:52:30 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Instance running successfully.
Aug 03 04:52:30 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Failed to set time: agent not configured {{(pid=72444) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 03 04:52:30 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5ed3a39a-6862-47a3-82fc-19dd6ab0b52c tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] finish_migration finished successfully. {{(pid=72444) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 03 04:52:30 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:52:30 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:52:30 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 03 04:52:30 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038350.4145823, c4af22f7-45f8-4777-83ee-5cf1481c9fe8 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:52:30 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] VM Started (Lifecycle Event)
Aug 03 04:52:30 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:52:30 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:52:30 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 03 04:52:30 user nova-compute[72444]: DEBUG nova.compute.manager [req-2b448db8-ab9f-4e4c-90fd-173815271de8 req-c6f23068-18c1-42a0-b3fc-1b155dfa3b8e service nova] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Received event network-vif-plugged-73526f5e-c0da-4686-b2ab-e3859a2d6c85 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:52:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2b448db8-ab9f-4e4c-90fd-173815271de8 req-c6f23068-18c1-42a0-b3fc-1b155dfa3b8e service nova] Acquiring lock "c4af22f7-45f8-4777-83ee-5cf1481c9fe8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:52:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2b448db8-ab9f-4e4c-90fd-173815271de8 req-c6f23068-18c1-42a0-b3fc-1b155dfa3b8e service nova] Lock "c4af22f7-45f8-4777-83ee-5cf1481c9fe8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:52:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2b448db8-ab9f-4e4c-90fd-173815271de8 req-c6f23068-18c1-42a0-b3fc-1b155dfa3b8e service nova] Lock "c4af22f7-45f8-4777-83ee-5cf1481c9fe8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:52:30 user nova-compute[72444]: DEBUG nova.compute.manager [req-2b448db8-ab9f-4e4c-90fd-173815271de8 req-c6f23068-18c1-42a0-b3fc-1b155dfa3b8e service nova] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] No waiting events found dispatching network-vif-plugged-73526f5e-c0da-4686-b2ab-e3859a2d6c85 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:52:30 user nova-compute[72444]: WARNING nova.compute.manager [req-2b448db8-ab9f-4e4c-90fd-173815271de8 req-c6f23068-18c1-42a0-b3fc-1b155dfa3b8e service nova] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Received unexpected event network-vif-plugged-73526f5e-c0da-4686-b2ab-e3859a2d6c85 for instance with vm_state active and task_state resize_finish.
Aug 03 04:52:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG nova.compute.manager [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 04:52:38 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Creating image(s)
Aug 03 04:52:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Did not create local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Ensure instance console log exists: /opt/stack/data/nova/instances/863f0679-c64c-4a13-8028-4cb194f8f99f/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Start _get_guest_xml network_info=[{"id": "74465661-452c-4dba-b207-94f35c3fa50d", "address": "fa:16:3e:ea:30:b2", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74465661-45", "ovs_interfaceid": "74465661-452c-4dba-b207-94f35c3fa50d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pumHUtGc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '863f0679-c64c-4a13-8028-4cb194f8f99f', 'attached_at': '', 'detached_at': '', 'volume_id': '9e9476a5-82bf-4497-8f44-a7d6a95b0da3', 'serial': '9e9476a5-82bf-4497-8f44-a7d6a95b0da3'}, 'disk_bus': 'virtio', 'attachment_id': 'd30a3dc2-bff3-4986-9e96-91e1d116a1fc', 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:52:38 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:52:38 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:52:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pumHUtGc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:52:38 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:52:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:52:38 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:52:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:52:38 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:52:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdf574a-99aa-4b79-ac10-99f083cc1f04]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 04:52:38 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[22df270a-3fcc-4a5e-b937-343b68f575ef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3] added
Aug 03 04:52:38 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbec4a6-76bd-490a-910f-4f106a15d5c4]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85b3cf3-3736-485c-8fb4-641f8a705fce]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pumHUtGc {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pumHUtGc" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33f0210-c2c4-4c27-93d7-4907591cd8ef]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pumHUtGc'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa8961a-e2f2-4f18-bd61-5073f1b110b6]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1920bb-c5b7-4cb2-93ac-d12c829e0b57]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:52:38 user nova-compute[72444]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 (non-flash)
Aug 03 04:52:38 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:52:38 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:52:38 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:52:38 user nova-compute[72444]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 (non-flash)
Aug 03 04:52:38 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:52:38 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:52:38 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:52:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:39 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91442f5-074d-426c-aaa0-6ae62848073b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3, portal: 172.16.0.220,3260]
Aug 03 04:52:39 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3, portal: 172.16.0.220,3260] successful.
Aug 03 04:52:39 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:52:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:39 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a62b7c-016b-4ae7-b2bd-0ed6ecd86d6a]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:52:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:39 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc83e59c-7c6a-42ab-8635-fd2bbf6144ab]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:52:39 user nova-compute[72444]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 (non-flash)
Aug 03 04:52:39 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:52:39 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:52:39 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:52:39 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:52:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:52:39 user nova-compute[72444]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 (non-flash)
Aug 03 04:52:39 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:52:39 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:52:39 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:52:39 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:52:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:52:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:52:39 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:52:39 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:52:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:39 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca13c7c-8798-4302-bab7-1c48ddd71c85]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:39 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:52:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pumHUtGc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:52:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:40 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:52:40 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '23832373834353933', 'path': '/dev/sde'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:52:40 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832373834353933', 'path': '/dev/sde'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:52:40 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:52:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1691297042',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1691297042',id=28,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='929fd4a3127b475282426d4412e58def',ramdisk_id='',reservation_id='r-c97ymyhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1082770125',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:52:18Z,user_data=None,user_id='ceede92aa3a74060a7f57d29d0d97aee',uuid=863f0679-c64c-4a13-8028-4cb194f8f99f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74465661-452c-4dba-b207-94f35c3fa50d", "address": "fa:16:3e:ea:30:b2", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74465661-45", "ovs_interfaceid": "74465661-452c-4dba-b207-94f35c3fa50d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:52:40 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Converting VIF {"id": "74465661-452c-4dba-b207-94f35c3fa50d", "address": "fa:16:3e:ea:30:b2", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74465661-45", "ovs_interfaceid": "74465661-452c-4dba-b207-94f35c3fa50d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:52:40 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:30:b2,bridge_name='br-int',has_traffic_filtering=True,id=74465661-452c-4dba-b207-94f35c3fa50d,network=Network(0e8b3ddd-e35a-45eb-a34c-614654c25549),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74465661-45') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:52:40 user nova-compute[72444]: DEBUG nova.objects.instance [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lazy-loading 'pci_devices' on Instance uuid 863f0679-c64c-4a13-8028-4cb194f8f99f {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:52:40 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:52:40 user nova-compute[72444]:   <uuid>863f0679-c64c-4a13-8028-4cb194f8f99f</uuid>
Aug 03 04:52:40 user nova-compute[72444]:   <name>instance-0000001c</name>
Aug 03 04:52:40 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:52:40 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:52:40 user nova-compute[72444]:   <metadata>
Aug 03 04:52:40 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:52:40 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:52:40 user nova-compute[72444]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1691297042</nova:name>
Aug 03 04:52:40 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:52:38</nova:creationTime>
Aug 03 04:52:40 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:52:40 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:52:40 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:52:40 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:52:40 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:52:40 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:52:40 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:52:40 user nova-compute[72444]:       <nova:owner>
Aug 03 04:52:40 user nova-compute[72444]:         <nova:user uuid="ceede92aa3a74060a7f57d29d0d97aee">tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member</nova:user>
Aug 03 04:52:40 user nova-compute[72444]:         <nova:project uuid="929fd4a3127b475282426d4412e58def">tempest-ServerBootFromVolumeStableRescueTest-1082770125</nova:project>
Aug 03 04:52:40 user nova-compute[72444]:       </nova:owner>
Aug 03 04:52:40 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:52:40 user nova-compute[72444]:       <nova:ports>
Aug 03 04:52:40 user nova-compute[72444]:         <nova:port uuid="74465661-452c-4dba-b207-94f35c3fa50d">
Aug 03 04:52:40 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 03 04:52:40 user nova-compute[72444]:         </nova:port>
Aug 03 04:52:40 user nova-compute[72444]:       </nova:ports>
Aug 03 04:52:40 user nova-compute[72444]:     </nova:instance>
Aug 03 04:52:40 user nova-compute[72444]:   </metadata>
Aug 03 04:52:40 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:52:40 user nova-compute[72444]:     <system>
Aug 03 04:52:40 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:52:40 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:52:40 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:52:40 user nova-compute[72444]:       <entry name="serial">863f0679-c64c-4a13-8028-4cb194f8f99f</entry>
Aug 03 04:52:40 user nova-compute[72444]:       <entry name="uuid">863f0679-c64c-4a13-8028-4cb194f8f99f</entry>
Aug 03 04:52:40 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:52:40 user nova-compute[72444]:     </system>
Aug 03 04:52:40 user nova-compute[72444]:   </sysinfo>
Aug 03 04:52:40 user nova-compute[72444]:   <os>
Aug 03 04:52:40 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:52:40 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:52:40 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:52:40 user nova-compute[72444]:   </os>
Aug 03 04:52:40 user nova-compute[72444]:   <features>
Aug 03 04:52:40 user nova-compute[72444]:     <acpi/>
Aug 03 04:52:40 user nova-compute[72444]:     <apic/>
Aug 03 04:52:40 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:52:40 user nova-compute[72444]:   </features>
Aug 03 04:52:40 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:52:40 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:52:40 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:52:40 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:52:40 user nova-compute[72444]:   </clock>
Aug 03 04:52:40 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:52:40 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:52:40 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:52:40 user nova-compute[72444]:   </cpu>
Aug 03 04:52:40 user nova-compute[72444]:   <devices>
Aug 03 04:52:40 user nova-compute[72444]:     <disk type="block" device="disk">
Aug 03 04:52:40 user nova-compute[72444]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:52:40 user nova-compute[72444]:       <source dev="/dev/sde"/>
Aug 03 04:52:40 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:52:40 user nova-compute[72444]:       <serial>9e9476a5-82bf-4497-8f44-a7d6a95b0da3</serial>
Aug 03 04:52:40 user nova-compute[72444]:     </disk>
Aug 03 04:52:40 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:52:40 user nova-compute[72444]:       <mac address="fa:16:3e:ea:30:b2"/>
Aug 03 04:52:40 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:52:40 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:52:40 user nova-compute[72444]:       <target dev="tap74465661-45"/>
Aug 03 04:52:40 user nova-compute[72444]:     </interface>
Aug 03 04:52:40 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:52:40 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/863f0679-c64c-4a13-8028-4cb194f8f99f/console.log" append="off"/>
Aug 03 04:52:40 user nova-compute[72444]:     </serial>
Aug 03 04:52:40 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:52:40 user nova-compute[72444]:     <video>
Aug 03 04:52:40 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:52:40 user nova-compute[72444]:     </video>
Aug 03 04:52:40 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:52:40 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:52:40 user nova-compute[72444]:     </rng>
Aug 03 04:52:40 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:52:40 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:52:40 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:52:40 user nova-compute[72444]:     </memballoon>
Aug 03 04:52:40 user nova-compute[72444]:   </devices>
Aug 03 04:52:40 user nova-compute[72444]: </domain>
Aug 03 04:52:40 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:52:40 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:52:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1691297042',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1691297042',id=28,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='929fd4a3127b475282426d4412e58def',ramdisk_id='',reservation_id='r-c97ymyhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1082770125',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:52:18Z,user_data=None,user_id='ceede92aa3a74060a7f57d29d0d97aee',uuid=863f0679-c64c-4a13-8028-4cb194f8f99f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74465661-452c-4dba-b207-94f35c3fa50d", "address": "fa:16:3e:ea:30:b2", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74465661-45", "ovs_interfaceid": "74465661-452c-4dba-b207-94f35c3fa50d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:52:40 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Converting VIF {"id": "74465661-452c-4dba-b207-94f35c3fa50d", "address": "fa:16:3e:ea:30:b2", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74465661-45", "ovs_interfaceid": "74465661-452c-4dba-b207-94f35c3fa50d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:52:40 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:30:b2,bridge_name='br-int',has_traffic_filtering=True,id=74465661-452c-4dba-b207-94f35c3fa50d,network=Network(0e8b3ddd-e35a-45eb-a34c-614654c25549),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74465661-45') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:52:40 user nova-compute[72444]: DEBUG os_vif [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:30:b2,bridge_name='br-int',has_traffic_filtering=True,id=74465661-452c-4dba-b207-94f35c3fa50d,network=Network(0e8b3ddd-e35a-45eb-a34c-614654c25549),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74465661-45') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:52:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:52:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:52:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74465661-45, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:52:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap74465661-45, col_values=(('external_ids', {'iface-id': '74465661-452c-4dba-b207-94f35c3fa50d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:30:b2', 'vm-uuid': '863f0679-c64c-4a13-8028-4cb194f8f99f'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:52:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:52:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:40 user nova-compute[72444]: INFO os_vif [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:30:b2,bridge_name='br-int',has_traffic_filtering=True,id=74465661-452c-4dba-b207-94f35c3fa50d,network=Network(0e8b3ddd-e35a-45eb-a34c-614654c25549),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74465661-45')
Aug 03 04:52:40 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:52:40 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] No VIF found with MAC fa:16:3e:ea:30:b2, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:52:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:43 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:44 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:44 user nova-compute[72444]: DEBUG nova.compute.manager [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:52:44 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 04:52:44 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038364.5065446, 863f0679-c64c-4a13-8028-4cb194f8f99f => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:52:44 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] VM Resumed (Lifecycle Event)
Aug 03 04:52:44 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Instance spawned successfully.
Aug 03 04:52:44 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 04:52:44 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:52:44 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:52:44 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:52:44 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:52:44 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:52:44 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:52:44 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:52:44 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:52:44 user nova-compute[72444]: DEBUG nova.compute.manager [req-057a1c41-fe33-4fe4-8fbd-4eb55cf342c8 req-17b63351-baa8-4e09-8cec-6e7ac02e4df0 service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Received event network-vif-plugged-74465661-452c-4dba-b207-94f35c3fa50d {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:52:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-057a1c41-fe33-4fe4-8fbd-4eb55cf342c8 req-17b63351-baa8-4e09-8cec-6e7ac02e4df0 service nova] Acquiring lock "863f0679-c64c-4a13-8028-4cb194f8f99f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:52:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-057a1c41-fe33-4fe4-8fbd-4eb55cf342c8 req-17b63351-baa8-4e09-8cec-6e7ac02e4df0 service nova] Lock "863f0679-c64c-4a13-8028-4cb194f8f99f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:52:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-057a1c41-fe33-4fe4-8fbd-4eb55cf342c8 req-17b63351-baa8-4e09-8cec-6e7ac02e4df0 service nova] Lock "863f0679-c64c-4a13-8028-4cb194f8f99f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:52:44 user nova-compute[72444]: DEBUG nova.compute.manager [req-057a1c41-fe33-4fe4-8fbd-4eb55cf342c8 req-17b63351-baa8-4e09-8cec-6e7ac02e4df0 service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] No waiting events found dispatching network-vif-plugged-74465661-452c-4dba-b207-94f35c3fa50d {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:52:44 user nova-compute[72444]: WARNING nova.compute.manager [req-057a1c41-fe33-4fe4-8fbd-4eb55cf342c8 req-17b63351-baa8-4e09-8cec-6e7ac02e4df0 service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Received unexpected event network-vif-plugged-74465661-452c-4dba-b207-94f35c3fa50d for instance with vm_state building and task_state spawning.
Aug 03 04:52:44 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:52:44 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038364.5066886, 863f0679-c64c-4a13-8028-4cb194f8f99f => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:52:44 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] VM Started (Lifecycle Event)
Aug 03 04:52:44 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:52:44 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:52:44 user nova-compute[72444]: INFO nova.compute.manager [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Took 6.02 seconds to spawn the instance on the hypervisor.
Aug 03 04:52:44 user nova-compute[72444]: DEBUG nova.compute.manager [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:52:44 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:52:44 user nova-compute[72444]: INFO nova.compute.manager [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Took 28.11 seconds to build instance.
Aug 03 04:52:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-debdc818-2f1b-420d-90d9-7a0fa77bc130 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "863f0679-c64c-4a13-8028-4cb194f8f99f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.232s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:52:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Acquiring lock "c5b50062-b965-4686-beea-63537d9f1eda" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:52:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Lock "c5b50062-b965-4686-beea-63537d9f1eda" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:52:45 user nova-compute[72444]: DEBUG nova.compute.manager [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 04:52:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:52:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:52:45 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 04:52:45 user nova-compute[72444]: INFO nova.compute.claims [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Claim successful on node user
Aug 03 04:52:45 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:52:45 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:52:45 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:52:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.687s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:52:46 user nova-compute[72444]: DEBUG nova.compute.manager [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 04:52:46 user nova-compute[72444]: DEBUG nova.compute.manager [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 04:52:46 user nova-compute[72444]: DEBUG nova.network.neutron [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 04:52:46 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 04:52:46 user nova-compute[72444]: DEBUG nova.compute.manager [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 04:52:46 user nova-compute[72444]: INFO nova.virt.block_device [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Booting with volume d99161a6-916a-44e5-8815-0f0df9d29727 at /dev/vda
Aug 03 04:52:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Acquiring lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:52:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:52:46 user nova-compute[72444]: DEBUG nova.compute.manager [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 04:52:46 user nova-compute[72444]: DEBUG nova.policy [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '26901807745b4c748dd3358068d07983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c053965223cd48eab71fe19c2dcb3856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 04:52:46 user nova-compute[72444]: DEBUG os_brick.utils [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:52:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[280eaaa2-9274-43e5-8659-05534e76b45c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b960b816-dc98-4412-a9ff-4f853ac4665f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:52:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:52:46 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 04:52:46 user nova-compute[72444]: INFO nova.compute.claims [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Claim successful on node user
Aug 03 04:52:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a936438c-90ea-4253-a966-9d4438994946]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb78e287-bfa7-42b5-b6e7-80750a41a722]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:52:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 04:52:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:52:46 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 04:52:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e9e30a-c5f1-4ee3-87d9-2d90bdb7581e]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 04:52:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 04:52:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 04:52:46 user nova-compute[72444]: DEBUG os_brick.utils [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] <== get_connector_properties: return (182ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:52:46 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Updating existing volume attachment record: 55f847b6-6ebb-43ef-a58f-e11ec89e482f {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 04:52:46 user nova-compute[72444]: DEBUG nova.compute.manager [req-2d33321d-7a30-400e-a3b5-1535930012e9 req-fd07f815-e4ad-466f-b74c-daf4d560813c service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Received event network-vif-plugged-74465661-452c-4dba-b207-94f35c3fa50d {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:52:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2d33321d-7a30-400e-a3b5-1535930012e9 req-fd07f815-e4ad-466f-b74c-daf4d560813c service nova] Acquiring lock "863f0679-c64c-4a13-8028-4cb194f8f99f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:52:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2d33321d-7a30-400e-a3b5-1535930012e9 req-fd07f815-e4ad-466f-b74c-daf4d560813c service nova] Lock "863f0679-c64c-4a13-8028-4cb194f8f99f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:52:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2d33321d-7a30-400e-a3b5-1535930012e9 req-fd07f815-e4ad-466f-b74c-daf4d560813c service nova] Lock "863f0679-c64c-4a13-8028-4cb194f8f99f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:52:46 user nova-compute[72444]: DEBUG nova.compute.manager [req-2d33321d-7a30-400e-a3b5-1535930012e9 req-fd07f815-e4ad-466f-b74c-daf4d560813c service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] No waiting events found dispatching network-vif-plugged-74465661-452c-4dba-b207-94f35c3fa50d {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:52:46 user nova-compute[72444]: WARNING nova.compute.manager [req-2d33321d-7a30-400e-a3b5-1535930012e9 req-fd07f815-e4ad-466f-b74c-daf4d560813c service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Received unexpected event network-vif-plugged-74465661-452c-4dba-b207-94f35c3fa50d for instance with vm_state active and task_state None.
Aug 03 04:52:47 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:52:47 user nova-compute[72444]: DEBUG nova.network.neutron [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Successfully created port: 4015917d-392d-4101-a347-15b1a37dc252 {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:52:47 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:52:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.852s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:52:47 user nova-compute[72444]: DEBUG nova.compute.manager [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 04:52:47 user nova-compute[72444]: DEBUG nova.compute.manager [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 04:52:47 user nova-compute[72444]: DEBUG nova.network.neutron [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 04:52:47 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 04:52:47 user nova-compute[72444]: DEBUG nova.compute.manager [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 04:52:47 user nova-compute[72444]: DEBUG nova.policy [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0747a6dda85f48ddbcc4564bc5980b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08ed53988ee44a081db4223ad0a9264', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 04:52:47 user nova-compute[72444]: DEBUG nova.compute.manager [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 04:52:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 04:52:47 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Creating image(s)
Aug 03 04:52:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Acquiring lock "/opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:52:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lock "/opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:52:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lock "/opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:52:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:47 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:52:47 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:52:47 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 04:52:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.180s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:52:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:52:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.189s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:48 user nova-compute[72444]: DEBUG nova.network.neutron [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Successfully created port: fe941d99-e8f6-42bd-939e-d2955caed33d {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:52:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk 1073741824" returned: 0 in 0.061s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:52:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.201s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:48 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Checking if we can resize image /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 04:52:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:48 user nova-compute[72444]: DEBUG nova.network.neutron [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Successfully created port: 7a41fc62-2272-4198-99cb-19d77d1dc193 {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:52:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:48 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Cannot resize image /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 04:52:48 user nova-compute[72444]: DEBUG nova.objects.instance [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lazy-loading 'migration_context' on Instance uuid 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:52:48 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 04:52:48 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Ensure instance console log exists: /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 04:52:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:52:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:52:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:52:48 user nova-compute[72444]: DEBUG nova.network.neutron [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Successfully created port: df356454-4b89-4b15-955c-6d4d41688490 {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:52:49 user nova-compute[72444]: DEBUG nova.network.neutron [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Successfully updated port: 7a41fc62-2272-4198-99cb-19d77d1dc193 {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:52:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Acquiring lock "refresh_cache-27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:52:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Acquired lock "refresh_cache-27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:52:49 user nova-compute[72444]: DEBUG nova.network.neutron [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:52:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:49 user nova-compute[72444]: DEBUG nova.compute.manager [req-b035421c-6fe7-4408-aebf-ad0b0efa4b64 req-55e0deb1-9a65-4091-a53f-1ae95e863fe0 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Received event network-changed-7a41fc62-2272-4198-99cb-19d77d1dc193 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:52:49 user nova-compute[72444]: DEBUG nova.compute.manager [req-b035421c-6fe7-4408-aebf-ad0b0efa4b64 req-55e0deb1-9a65-4091-a53f-1ae95e863fe0 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Refreshing instance network info cache due to event network-changed-7a41fc62-2272-4198-99cb-19d77d1dc193. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:52:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b035421c-6fe7-4408-aebf-ad0b0efa4b64 req-55e0deb1-9a65-4091-a53f-1ae95e863fe0 service nova] Acquiring lock "refresh_cache-27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:52:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-71c067ff-31d0-4f4f-b64b-f3d92f02b5de tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Acquiring lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:52:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-71c067ff-31d0-4f4f-b64b-f3d92f02b5de tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:52:49 user nova-compute[72444]: INFO nova.compute.manager [None req-71c067ff-31d0-4f4f-b64b-f3d92f02b5de tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Detaching volume 98581bab-0a05-403a-a15f-6458eb7ba2d3
Aug 03 04:52:49 user nova-compute[72444]: DEBUG nova.network.neutron [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:52:49 user nova-compute[72444]: INFO nova.virt.block_device [None req-71c067ff-31d0-4f4f-b64b-f3d92f02b5de tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Attempting to driver detach volume 98581bab-0a05-403a-a15f-6458eb7ba2d3 from mountpoint /dev/vdb
Aug 03 04:52:49 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-71c067ff-31d0-4f4f-b64b-f3d92f02b5de tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Attempting to detach device vdb from instance c94f537a-b1a1-4cea-996d-e1a88a2c9dac from the persistent domain config. {{(pid=72444) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 04:52:49 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-71c067ff-31d0-4f4f-b64b-f3d92f02b5de tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 04:52:49 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:52:49 user nova-compute[72444]:   <source dev="/dev/sdc"/>
Aug 03 04:52:49 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:52:49 user nova-compute[72444]:   <serial>98581bab-0a05-403a-a15f-6458eb7ba2d3</serial>
Aug 03 04:52:49 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 04:52:49 user nova-compute[72444]: </disk>
Aug 03 04:52:49 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:52:49 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-71c067ff-31d0-4f4f-b64b-f3d92f02b5de tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Successfully detached device vdb from instance c94f537a-b1a1-4cea-996d-e1a88a2c9dac from the persistent domain config.
Aug 03 04:52:49 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-71c067ff-31d0-4f4f-b64b-f3d92f02b5de tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c94f537a-b1a1-4cea-996d-e1a88a2c9dac from the live domain config. {{(pid=72444) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 04:52:49 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-71c067ff-31d0-4f4f-b64b-f3d92f02b5de tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 04:52:49 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:52:49 user nova-compute[72444]:   <source dev="/dev/sdc"/>
Aug 03 04:52:49 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:52:49 user nova-compute[72444]:   <serial>98581bab-0a05-403a-a15f-6458eb7ba2d3</serial>
Aug 03 04:52:49 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 04:52:49 user nova-compute[72444]: </disk>
Aug 03 04:52:49 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:52:49 user nova-compute[72444]: DEBUG nova.network.neutron [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Successfully created port: 6e47393c-8b6c-4008-a802-8a728b3a7a6c {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:52:49 user nova-compute[72444]: DEBUG nova.network.neutron [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Updating instance_info_cache with network_info: [{"id": "7a41fc62-2272-4198-99cb-19d77d1dc193", "address": "fa:16:3e:68:ec:25", "network": {"id": "d132f1d9-d7bd-4630-bd3d-e911f43d14bb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1090455023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08ed53988ee44a081db4223ad0a9264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a41fc62-22", "ovs_interfaceid": "7a41fc62-2272-4198-99cb-19d77d1dc193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:52:49 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:52:49 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:52:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Releasing lock "refresh_cache-27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:52:49 user nova-compute[72444]: DEBUG nova.compute.manager [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Instance network_info: |[{"id": "7a41fc62-2272-4198-99cb-19d77d1dc193", "address": "fa:16:3e:68:ec:25", "network": {"id": "d132f1d9-d7bd-4630-bd3d-e911f43d14bb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1090455023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08ed53988ee44a081db4223ad0a9264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a41fc62-22", "ovs_interfaceid": "7a41fc62-2272-4198-99cb-19d77d1dc193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 04:52:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b035421c-6fe7-4408-aebf-ad0b0efa4b64 req-55e0deb1-9a65-4091-a53f-1ae95e863fe0 service nova] Acquired lock "refresh_cache-27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:52:49 user nova-compute[72444]: DEBUG nova.network.neutron [req-b035421c-6fe7-4408-aebf-ad0b0efa4b64 req-55e0deb1-9a65-4091-a53f-1ae95e863fe0 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Refreshing network info cache for port 7a41fc62-2272-4198-99cb-19d77d1dc193 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:52:49 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Start _get_guest_xml network_info=[{"id": "7a41fc62-2272-4198-99cb-19d77d1dc193", "address": "fa:16:3e:68:ec:25", "network": {"id": "d132f1d9-d7bd-4630-bd3d-e911f43d14bb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1090455023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08ed53988ee44a081db4223ad0a9264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a41fc62-22", "ovs_interfaceid": "7a41fc62-2272-4198-99cb-19d77d1dc193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:52:49 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:52:49 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:52:49 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:52:49 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:52:49 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:52:49 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:52:49 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:52:49 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:52:49 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:52:49 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:52:49 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:52:49 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:52:49 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:52:49 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:52:49 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:52:49 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:52:49 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:52:49 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:52:49 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:52:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1025958151',display_name='tempest-ServerStableDeviceRescueTest-server-1025958151',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1025958151',id=30,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4jDFxvmvEZS4Z7JXz0hT1lDcLp6u3gZwEbKEc2hoK4M3fMHWAWzjuuHOscgaraFZ39VjXIwo94mfkQIR25KIRAWCbmQSZmJCp9YRgX8UCvMh39yqLkLrbMM3cXGBxglg==',key_name='tempest-keypair-1152104865',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c08ed53988ee44a081db4223ad0a9264',ramdisk_id='',reservation_id='r-tum413w7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-849887263',owner_user_name='tempest-ServerStableDeviceRescueTest-849887263-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:52:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0747a6dda85f48ddbcc4564bc5980b99',uuid=27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a41fc62-2272-4198-99cb-19d77d1dc193", "address": "fa:16:3e:68:ec:25", "network": {"id": "d132f1d9-d7bd-4630-bd3d-e911f43d14bb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1090455023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08ed53988ee44a081db4223ad0a9264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a41fc62-22", "ovs_interfaceid": "7a41fc62-2272-4198-99cb-19d77d1dc193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:52:49 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Converting VIF {"id": "7a41fc62-2272-4198-99cb-19d77d1dc193", "address": "fa:16:3e:68:ec:25", "network": {"id": "d132f1d9-d7bd-4630-bd3d-e911f43d14bb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1090455023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08ed53988ee44a081db4223ad0a9264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a41fc62-22", "ovs_interfaceid": "7a41fc62-2272-4198-99cb-19d77d1dc193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:ec:25,bridge_name='br-int',has_traffic_filtering=True,id=7a41fc62-2272-4198-99cb-19d77d1dc193,network=Network(d132f1d9-d7bd-4630-bd3d-e911f43d14bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a41fc62-22') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG nova.objects.instance [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lazy-loading 'pci_devices' on Instance uuid 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:52:50 user nova-compute[72444]:   <uuid>27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0</uuid>
Aug 03 04:52:50 user nova-compute[72444]:   <name>instance-0000001e</name>
Aug 03 04:52:50 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:52:50 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:52:50 user nova-compute[72444]:   <metadata>
Aug 03 04:52:50 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:52:50 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:52:50 user nova-compute[72444]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1025958151</nova:name>
Aug 03 04:52:50 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:52:49</nova:creationTime>
Aug 03 04:52:50 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:52:50 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:52:50 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:52:50 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:52:50 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:52:50 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:52:50 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:52:50 user nova-compute[72444]:       <nova:owner>
Aug 03 04:52:50 user nova-compute[72444]:         <nova:user uuid="0747a6dda85f48ddbcc4564bc5980b99">tempest-ServerStableDeviceRescueTest-849887263-project-member</nova:user>
Aug 03 04:52:50 user nova-compute[72444]:         <nova:project uuid="c08ed53988ee44a081db4223ad0a9264">tempest-ServerStableDeviceRescueTest-849887263</nova:project>
Aug 03 04:52:50 user nova-compute[72444]:       </nova:owner>
Aug 03 04:52:50 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:52:50 user nova-compute[72444]:       <nova:ports>
Aug 03 04:52:50 user nova-compute[72444]:         <nova:port uuid="7a41fc62-2272-4198-99cb-19d77d1dc193">
Aug 03 04:52:50 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 03 04:52:50 user nova-compute[72444]:         </nova:port>
Aug 03 04:52:50 user nova-compute[72444]:       </nova:ports>
Aug 03 04:52:50 user nova-compute[72444]:     </nova:instance>
Aug 03 04:52:50 user nova-compute[72444]:   </metadata>
Aug 03 04:52:50 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:52:50 user nova-compute[72444]:     <system>
Aug 03 04:52:50 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:52:50 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:52:50 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:52:50 user nova-compute[72444]:       <entry name="serial">27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0</entry>
Aug 03 04:52:50 user nova-compute[72444]:       <entry name="uuid">27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0</entry>
Aug 03 04:52:50 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:52:50 user nova-compute[72444]:     </system>
Aug 03 04:52:50 user nova-compute[72444]:   </sysinfo>
Aug 03 04:52:50 user nova-compute[72444]:   <os>
Aug 03 04:52:50 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:52:50 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:52:50 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:52:50 user nova-compute[72444]:   </os>
Aug 03 04:52:50 user nova-compute[72444]:   <features>
Aug 03 04:52:50 user nova-compute[72444]:     <acpi/>
Aug 03 04:52:50 user nova-compute[72444]:     <apic/>
Aug 03 04:52:50 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:52:50 user nova-compute[72444]:   </features>
Aug 03 04:52:50 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:52:50 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:52:50 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:52:50 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:52:50 user nova-compute[72444]:   </clock>
Aug 03 04:52:50 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:52:50 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:52:50 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:52:50 user nova-compute[72444]:   </cpu>
Aug 03 04:52:50 user nova-compute[72444]:   <devices>
Aug 03 04:52:50 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:52:50 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:52:50 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk"/>
Aug 03 04:52:50 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:52:50 user nova-compute[72444]:     </disk>
Aug 03 04:52:50 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:52:50 user nova-compute[72444]:       <mac address="fa:16:3e:68:ec:25"/>
Aug 03 04:52:50 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:52:50 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:52:50 user nova-compute[72444]:       <target dev="tap7a41fc62-22"/>
Aug 03 04:52:50 user nova-compute[72444]:     </interface>
Aug 03 04:52:50 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:52:50 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/console.log" append="off"/>
Aug 03 04:52:50 user nova-compute[72444]:     </serial>
Aug 03 04:52:50 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:52:50 user nova-compute[72444]:     <video>
Aug 03 04:52:50 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:52:50 user nova-compute[72444]:     </video>
Aug 03 04:52:50 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:52:50 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:52:50 user nova-compute[72444]:     </rng>
Aug 03 04:52:50 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:52:50 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:52:50 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:52:50 user nova-compute[72444]:     </memballoon>
Aug 03 04:52:50 user nova-compute[72444]:   </devices>
Aug 03 04:52:50 user nova-compute[72444]: </domain>
Aug 03 04:52:50 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:52:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1025958151',display_name='tempest-ServerStableDeviceRescueTest-server-1025958151',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1025958151',id=30,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4jDFxvmvEZS4Z7JXz0hT1lDcLp6u3gZwEbKEc2hoK4M3fMHWAWzjuuHOscgaraFZ39VjXIwo94mfkQIR25KIRAWCbmQSZmJCp9YRgX8UCvMh39yqLkLrbMM3cXGBxglg==',key_name='tempest-keypair-1152104865',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c08ed53988ee44a081db4223ad0a9264',ramdisk_id='',reservation_id='r-tum413w7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-849887263',owner_user_name='tempest-ServerStableDeviceRescueTest-849887263-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:52:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0747a6dda85f48ddbcc4564bc5980b99',uuid=27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a41fc62-2272-4198-99cb-19d77d1dc193", "address": "fa:16:3e:68:ec:25", "network": {"id": "d132f1d9-d7bd-4630-bd3d-e911f43d14bb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1090455023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08ed53988ee44a081db4223ad0a9264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a41fc62-22", "ovs_interfaceid": "7a41fc62-2272-4198-99cb-19d77d1dc193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Converting VIF {"id": "7a41fc62-2272-4198-99cb-19d77d1dc193", "address": "fa:16:3e:68:ec:25", "network": {"id": "d132f1d9-d7bd-4630-bd3d-e911f43d14bb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1090455023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08ed53988ee44a081db4223ad0a9264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a41fc62-22", "ovs_interfaceid": "7a41fc62-2272-4198-99cb-19d77d1dc193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:ec:25,bridge_name='br-int',has_traffic_filtering=True,id=7a41fc62-2272-4198-99cb-19d77d1dc193,network=Network(d132f1d9-d7bd-4630-bd3d-e911f43d14bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a41fc62-22') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG os_vif [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:ec:25,bridge_name='br-int',has_traffic_filtering=True,id=7a41fc62-2272-4198-99cb-19d77d1dc193,network=Network(d132f1d9-d7bd-4630-bd3d-e911f43d14bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a41fc62-22') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a41fc62-22, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7a41fc62-22, col_values=(('external_ids', {'iface-id': '7a41fc62-2272-4198-99cb-19d77d1dc193', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:ec:25', 'vm-uuid': '27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:50 user nova-compute[72444]: INFO os_vif [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:ec:25,bridge_name='br-int',has_traffic_filtering=True,id=7a41fc62-2272-4198-99cb-19d77d1dc193,network=Network(d132f1d9-d7bd-4630-bd3d-e911f43d14bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a41fc62-22')
Aug 03 04:52:50 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] No VIF found with MAC fa:16:3e:68:ec:25, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Received event <DeviceRemovedEvent: 1691038370.250502, c94f537a-b1a1-4cea-996d-e1a88a2c9dac => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72444) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-71c067ff-31d0-4f4f-b64b-f3d92f02b5de tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c94f537a-b1a1-4cea-996d-e1a88a2c9dac {{(pid=72444) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 04:52:50 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-71c067ff-31d0-4f4f-b64b-f3d92f02b5de tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Successfully detached device vdb from instance c94f537a-b1a1-4cea-996d-e1a88a2c9dac from the live domain config.
Aug 03 04:52:50 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71c067ff-31d0-4f4f-b64b-f3d92f02b5de tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c067ff-31d0-4f4f-b64b-f3d92f02b5de tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dYNxAjtS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:52:50 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-71c067ff-31d0-4f4f-b64b-f3d92f02b5de tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:52:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-71c067ff-31d0-4f4f-b64b-f3d92f02b5de tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-71c067ff-31d0-4f4f-b64b-f3d92f02b5de tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c067ff-31d0-4f4f-b64b-f3d92f02b5de tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0422b4b-74ba-466c-bdff-c5171aee738c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a53242a-ba37-46b6-a041-324b49a7b202]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c067ff-31d0-4f4f-b64b-f3d92f02b5de tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:52:50 user nova-compute[72444]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 (non-flash)
Aug 03 04:52:50 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:52:50 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:52:50 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:52:50 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c067ff-31d0-4f4f-b64b-f3d92f02b5de tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:52:50 user nova-compute[72444]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 (non-flash)
Aug 03 04:52:50 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:52:50 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:52:50 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:52:50 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c067ff-31d0-4f4f-b64b-f3d92f02b5de tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308c3e84c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3'): ({'sdc'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-71c067ff-31d0-4f4f-b64b-f3d92f02b5de tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Removing single pathed devices sdc {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdbeb61-9bc1-425e-bc65-f22e857ec415]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.030s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeffb63e-10ac-476c-9e9f-1fe3c05ef6bf]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-71c067ff-31d0-4f4f-b64b-f3d92f02b5de tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Flushing IO for device /dev/sdc {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2123f30b-15be-4a17-9609-a16a413e697f]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-71c067ff-31d0-4f4f-b64b-f3d92f02b5de tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[64231d97-5d8e-4aa1-99bd-8b1f455ad0dc]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-71c067ff-31d0-4f4f-b64b-f3d92f02b5de tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-71c067ff-31d0-4f4f-b64b-f3d92f02b5de tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] SCSI volumes sdc have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c067ff-31d0-4f4f-b64b-f3d92f02b5de tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[49043838-2e36-4cf9-b2a7-1314a62849fb]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c067ff-31d0-4f4f-b64b-f3d92f02b5de tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e76aa5-074b-47ae-853d-c6ffdbc4c1b3]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c067ff-31d0-4f4f-b64b-f3d92f02b5de tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3, portal: 172.16.0.220,3260]
Aug 03 04:52:50 user nova-compute[72444]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3, portal: 172.16.0.220,3260] successful.
Aug 03 04:52:50 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98581bab-0a05-403a-a15f-6458eb7ba2d3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cc91b5-2c87-4711-8199-0283019da0da]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c067ff-31d0-4f4f-b64b-f3d92f02b5de tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-71c067ff-31d0-4f4f-b64b-f3d92f02b5de tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c067ff-31d0-4f4f-b64b-f3d92f02b5de tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] <== disconnect_volume: return (352ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71c067ff-31d0-4f4f-b64b-f3d92f02b5de tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG nova.network.neutron [req-b035421c-6fe7-4408-aebf-ad0b0efa4b64 req-55e0deb1-9a65-4091-a53f-1ae95e863fe0 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Updated VIF entry in instance network info cache for port 7a41fc62-2272-4198-99cb-19d77d1dc193. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG nova.network.neutron [req-b035421c-6fe7-4408-aebf-ad0b0efa4b64 req-55e0deb1-9a65-4091-a53f-1ae95e863fe0 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Updating instance_info_cache with network_info: [{"id": "7a41fc62-2272-4198-99cb-19d77d1dc193", "address": "fa:16:3e:68:ec:25", "network": {"id": "d132f1d9-d7bd-4630-bd3d-e911f43d14bb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1090455023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08ed53988ee44a081db4223ad0a9264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a41fc62-22", "ovs_interfaceid": "7a41fc62-2272-4198-99cb-19d77d1dc193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b035421c-6fe7-4408-aebf-ad0b0efa4b64 req-55e0deb1-9a65-4091-a53f-1ae95e863fe0 service nova] Releasing lock "refresh_cache-27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:52:50 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:52:51 user nova-compute[72444]: DEBUG nova.network.neutron [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Successfully created port: 9fb86964-076c-439e-84fa-7893c15e8871 {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:52:51 user nova-compute[72444]: DEBUG nova.objects.instance [None req-71c067ff-31d0-4f4f-b64b-f3d92f02b5de tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lazy-loading 'flavor' on Instance uuid c94f537a-b1a1-4cea-996d-e1a88a2c9dac {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:52:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-71c067ff-31d0-4f4f-b64b-f3d92f02b5de tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.035s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:52:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:51 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:52:51 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:52:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:52:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:52:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:52:51 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 04:52:52 user nova-compute[72444]: DEBUG nova.compute.manager [req-86518688-b509-4e39-8b0d-d0f712de73e6 req-ef4b6039-34bd-4a24-9c85-0ee947a91889 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Received event network-vif-plugged-7a41fc62-2272-4198-99cb-19d77d1dc193 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:52:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-86518688-b509-4e39-8b0d-d0f712de73e6 req-ef4b6039-34bd-4a24-9c85-0ee947a91889 service nova] Acquiring lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:52:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-86518688-b509-4e39-8b0d-d0f712de73e6 req-ef4b6039-34bd-4a24-9c85-0ee947a91889 service nova] Lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:52:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-86518688-b509-4e39-8b0d-d0f712de73e6 req-ef4b6039-34bd-4a24-9c85-0ee947a91889 service nova] Lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:52:52 user nova-compute[72444]: DEBUG nova.compute.manager [req-86518688-b509-4e39-8b0d-d0f712de73e6 req-ef4b6039-34bd-4a24-9c85-0ee947a91889 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] No waiting events found dispatching network-vif-plugged-7a41fc62-2272-4198-99cb-19d77d1dc193 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:52:52 user nova-compute[72444]: WARNING nova.compute.manager [req-86518688-b509-4e39-8b0d-d0f712de73e6 req-ef4b6039-34bd-4a24-9c85-0ee947a91889 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Received unexpected event network-vif-plugged-7a41fc62-2272-4198-99cb-19d77d1dc193 for instance with vm_state building and task_state spawning.
Aug 03 04:52:52 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:52:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:52 user nova-compute[72444]: DEBUG nova.network.neutron [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Successfully updated port: 4015917d-392d-4101-a347-15b1a37dc252 {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:52:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:52 user nova-compute[72444]: DEBUG nova.compute.manager [req-8e9b9f62-793c-45b3-b232-03673c39981b req-a1d713bc-3b60-47f7-9c4b-dba3e7657009 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-changed-4015917d-392d-4101-a347-15b1a37dc252 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:52:52 user nova-compute[72444]: DEBUG nova.compute.manager [req-8e9b9f62-793c-45b3-b232-03673c39981b req-a1d713bc-3b60-47f7-9c4b-dba3e7657009 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Refreshing instance network info cache due to event network-changed-4015917d-392d-4101-a347-15b1a37dc252. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:52:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8e9b9f62-793c-45b3-b232-03673c39981b req-a1d713bc-3b60-47f7-9c4b-dba3e7657009 service nova] Acquiring lock "refresh_cache-c5b50062-b965-4686-beea-63537d9f1eda" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:52:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8e9b9f62-793c-45b3-b232-03673c39981b req-a1d713bc-3b60-47f7-9c4b-dba3e7657009 service nova] Acquired lock "refresh_cache-c5b50062-b965-4686-beea-63537d9f1eda" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:52:52 user nova-compute[72444]: DEBUG nova.network.neutron [req-8e9b9f62-793c-45b3-b232-03673c39981b req-a1d713bc-3b60-47f7-9c4b-dba3e7657009 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Refreshing network info cache for port 4015917d-392d-4101-a347-15b1a37dc252 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:52:52 user nova-compute[72444]: DEBUG nova.network.neutron [req-8e9b9f62-793c-45b3-b232-03673c39981b req-a1d713bc-3b60-47f7-9c4b-dba3e7657009 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:52:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:53 user nova-compute[72444]: DEBUG nova.network.neutron [req-8e9b9f62-793c-45b3-b232-03673c39981b req-a1d713bc-3b60-47f7-9c4b-dba3e7657009 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:52:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8e9b9f62-793c-45b3-b232-03673c39981b req-a1d713bc-3b60-47f7-9c4b-dba3e7657009 service nova] Releasing lock "refresh_cache-c5b50062-b965-4686-beea-63537d9f1eda" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:52:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:54 user nova-compute[72444]: DEBUG nova.network.neutron [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Successfully updated port: 978bd88d-0401-4456-b332-7494cbebe1f2 {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:52:54 user nova-compute[72444]: DEBUG nova.compute.manager [req-1cda2367-f322-4e4c-86df-4485f9cdb716 req-b2d41454-ebdc-45de-926e-9db3413fc7e5 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Received event network-vif-plugged-7a41fc62-2272-4198-99cb-19d77d1dc193 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:52:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-1cda2367-f322-4e4c-86df-4485f9cdb716 req-b2d41454-ebdc-45de-926e-9db3413fc7e5 service nova] Acquiring lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:52:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-1cda2367-f322-4e4c-86df-4485f9cdb716 req-b2d41454-ebdc-45de-926e-9db3413fc7e5 service nova] Lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:52:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-1cda2367-f322-4e4c-86df-4485f9cdb716 req-b2d41454-ebdc-45de-926e-9db3413fc7e5 service nova] Lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:52:54 user nova-compute[72444]: DEBUG nova.compute.manager [req-1cda2367-f322-4e4c-86df-4485f9cdb716 req-b2d41454-ebdc-45de-926e-9db3413fc7e5 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] No waiting events found dispatching network-vif-plugged-7a41fc62-2272-4198-99cb-19d77d1dc193 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:52:54 user nova-compute[72444]: WARNING nova.compute.manager [req-1cda2367-f322-4e4c-86df-4485f9cdb716 req-b2d41454-ebdc-45de-926e-9db3413fc7e5 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Received unexpected event network-vif-plugged-7a41fc62-2272-4198-99cb-19d77d1dc193 for instance with vm_state building and task_state spawning.
Aug 03 04:52:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0214a998-5624-46f9-801e-c582b4a297e5/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:54 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038374.618412, 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:52:54 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] VM Resumed (Lifecycle Event)
Aug 03 04:52:54 user nova-compute[72444]: DEBUG nova.compute.manager [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:52:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 04:52:54 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Instance spawned successfully.
Aug 03 04:52:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 04:52:54 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:52:54 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:52:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:52:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:52:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:52:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:52:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:52:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:52:54 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:52:54 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038374.6293633, 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:52:54 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] VM Started (Lifecycle Event)
Aug 03 04:52:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0214a998-5624-46f9-801e-c582b4a297e5/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0214a998-5624-46f9-801e-c582b4a297e5/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:54 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:52:54 user nova-compute[72444]: INFO nova.compute.manager [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Took 7.09 seconds to spawn the instance on the hypervisor.
Aug 03 04:52:54 user nova-compute[72444]: DEBUG nova.compute.manager [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:52:54 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:52:54 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:52:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0214a998-5624-46f9-801e-c582b4a297e5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:52:54 user nova-compute[72444]: DEBUG nova.compute.manager [req-76bb3001-8c1f-40b2-bdd4-b0673ef1ebcf req-833ce73d-60a9-4063-b05c-309e5f1307cc service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-changed-978bd88d-0401-4456-b332-7494cbebe1f2 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:52:54 user nova-compute[72444]: DEBUG nova.compute.manager [req-76bb3001-8c1f-40b2-bdd4-b0673ef1ebcf req-833ce73d-60a9-4063-b05c-309e5f1307cc service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Refreshing instance network info cache due to event network-changed-978bd88d-0401-4456-b332-7494cbebe1f2. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:52:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-76bb3001-8c1f-40b2-bdd4-b0673ef1ebcf req-833ce73d-60a9-4063-b05c-309e5f1307cc service nova] Acquiring lock "refresh_cache-c5b50062-b965-4686-beea-63537d9f1eda" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:52:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-76bb3001-8c1f-40b2-bdd4-b0673ef1ebcf req-833ce73d-60a9-4063-b05c-309e5f1307cc service nova] Acquired lock "refresh_cache-c5b50062-b965-4686-beea-63537d9f1eda" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:52:54 user nova-compute[72444]: DEBUG nova.network.neutron [req-76bb3001-8c1f-40b2-bdd4-b0673ef1ebcf req-833ce73d-60a9-4063-b05c-309e5f1307cc service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Refreshing network info cache for port 978bd88d-0401-4456-b332-7494cbebe1f2 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:52:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:55 user nova-compute[72444]: INFO nova.compute.manager [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Took 8.58 seconds to build instance.
Aug 03 04:52:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:55 user nova-compute[72444]: DEBUG nova.network.neutron [req-76bb3001-8c1f-40b2-bdd4-b0673ef1ebcf req-833ce73d-60a9-4063-b05c-309e5f1307cc service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:52:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-fff58a75-2404-4771-ab0f-a5271f87a20d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.731s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:52:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk (vdb) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:52:55 user nova-compute[72444]: DEBUG nova.network.neutron [req-76bb3001-8c1f-40b2-bdd4-b0673ef1ebcf req-833ce73d-60a9-4063-b05c-309e5f1307cc service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:52:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-76bb3001-8c1f-40b2-bdd4-b0673ef1ebcf req-833ce73d-60a9-4063-b05c-309e5f1307cc service nova] Releasing lock "refresh_cache-c5b50062-b965-4686-beea-63537d9f1eda" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:52:55 user nova-compute[72444]: DEBUG nova.network.neutron [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Successfully updated port: 98143be5-d207-4206-a9fb-39bd8b05822e {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:52:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:56 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:52:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:56 user nova-compute[72444]: DEBUG nova.network.neutron [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Successfully updated port: fe941d99-e8f6-42bd-939e-d2955caed33d {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:52:56 user nova-compute[72444]: DEBUG nova.compute.manager [req-0b1e9301-f21f-4ac4-b0f2-4c533fb3e500 req-3b40327f-d90a-482a-8a17-e719f00f1c8c service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-changed-98143be5-d207-4206-a9fb-39bd8b05822e {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:52:56 user nova-compute[72444]: DEBUG nova.compute.manager [req-0b1e9301-f21f-4ac4-b0f2-4c533fb3e500 req-3b40327f-d90a-482a-8a17-e719f00f1c8c service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Refreshing instance network info cache due to event network-changed-98143be5-d207-4206-a9fb-39bd8b05822e. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:52:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0b1e9301-f21f-4ac4-b0f2-4c533fb3e500 req-3b40327f-d90a-482a-8a17-e719f00f1c8c service nova] Acquiring lock "refresh_cache-c5b50062-b965-4686-beea-63537d9f1eda" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:52:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0b1e9301-f21f-4ac4-b0f2-4c533fb3e500 req-3b40327f-d90a-482a-8a17-e719f00f1c8c service nova] Acquired lock "refresh_cache-c5b50062-b965-4686-beea-63537d9f1eda" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:52:56 user nova-compute[72444]: DEBUG nova.network.neutron [req-0b1e9301-f21f-4ac4-b0f2-4c533fb3e500 req-3b40327f-d90a-482a-8a17-e719f00f1c8c service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Refreshing network info cache for port 98143be5-d207-4206-a9fb-39bd8b05822e {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:52:57 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:52:57 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:52:57 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=7175MB free_disk=25.498947143554688GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:52:57 user nova-compute[72444]: INFO nova.virt.block_device [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Booting with volume 3b58f424-a14b-4c41-8991-fa4fa11d7e55 at /dev/vdb
Aug 03 04:52:57 user nova-compute[72444]: DEBUG nova.network.neutron [req-0b1e9301-f21f-4ac4-b0f2-4c533fb3e500 req-3b40327f-d90a-482a-8a17-e719f00f1c8c service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Applying migration context for instance c4af22f7-45f8-4777-83ee-5cf1481c9fe8 as it has an incoming, in-progress migration b853e16a-0cca-4c10-bd43-429f4612a605. Migration status is finished {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 03 04:52:57 user nova-compute[72444]: INFO nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Updating resource usage from migration b853e16a-0cca-4c10-bd43-429f4612a605
Aug 03 04:52:57 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 81725845-6158-4e34-bedb-6e41219bc227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance b6ed9c42-fa6e-4a0d-8312-588471e157f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance e2859322-6f99-442d-bee1-65fe49ce6360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 0b219bf3-a3b6-44b5-946e-c10e7498e1d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance c77e96da-6411-4ae9-af05-8e9bb3c432c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance c94f537a-b1a1-4cea-996d-e1a88a2c9dac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 0214a998-5624-46f9-801e-c582b4a297e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Migration b853e16a-0cca-4c10-bd43-429f4612a605 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance c4af22f7-45f8-4777-83ee-5cf1481c9fe8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 863f0679-c64c-4a13-8028-4cb194f8f99f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance c5b50062-b965-4686-beea-63537d9f1eda actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG os_brick.utils [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb3f563-db61-40c7-9899-c6e1d2707677]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdcee01-3216-47f7-9a2a-b85d5ba3bcba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91334cd-51b8-4451-9707-7f4f21317d24]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d32b76-92b1-44e5-884c-ea694b11a415]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:52:57 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 04:52:57 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ef9d5c-e347-4d7b-9b9f-88812cc0e479]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG os_brick.utils [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] <== get_connector_properties: return (193ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Updating existing volume attachment record: 22ff4a23-fbe9-476a-8ccf-9c96a594dbfe {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG nova.network.neutron [req-0b1e9301-f21f-4ac4-b0f2-4c533fb3e500 req-3b40327f-d90a-482a-8a17-e719f00f1c8c service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0b1e9301-f21f-4ac4-b0f2-4c533fb3e500 req-3b40327f-d90a-482a-8a17-e719f00f1c8c service nova] Releasing lock "refresh_cache-c5b50062-b965-4686-beea-63537d9f1eda" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG nova.compute.manager [req-0b1e9301-f21f-4ac4-b0f2-4c533fb3e500 req-3b40327f-d90a-482a-8a17-e719f00f1c8c service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-changed-fe941d99-e8f6-42bd-939e-d2955caed33d {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG nova.compute.manager [req-0b1e9301-f21f-4ac4-b0f2-4c533fb3e500 req-3b40327f-d90a-482a-8a17-e719f00f1c8c service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Refreshing instance network info cache due to event network-changed-fe941d99-e8f6-42bd-939e-d2955caed33d. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0b1e9301-f21f-4ac4-b0f2-4c533fb3e500 req-3b40327f-d90a-482a-8a17-e719f00f1c8c service nova] Acquiring lock "refresh_cache-c5b50062-b965-4686-beea-63537d9f1eda" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0b1e9301-f21f-4ac4-b0f2-4c533fb3e500 req-3b40327f-d90a-482a-8a17-e719f00f1c8c service nova] Acquired lock "refresh_cache-c5b50062-b965-4686-beea-63537d9f1eda" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG nova.network.neutron [req-0b1e9301-f21f-4ac4-b0f2-4c533fb3e500 req-3b40327f-d90a-482a-8a17-e719f00f1c8c service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Refreshing network info cache for port fe941d99-e8f6-42bd-939e-d2955caed33d {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG nova.network.neutron [req-0b1e9301-f21f-4ac4-b0f2-4c533fb3e500 req-3b40327f-d90a-482a-8a17-e719f00f1c8c service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.832s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:52:57 user nova-compute[72444]: DEBUG nova.network.neutron [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Successfully updated port: df356454-4b89-4b15-955c-6d4d41688490 {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:52:58 user nova-compute[72444]: DEBUG nova.network.neutron [req-0b1e9301-f21f-4ac4-b0f2-4c533fb3e500 req-3b40327f-d90a-482a-8a17-e719f00f1c8c service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:52:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0b1e9301-f21f-4ac4-b0f2-4c533fb3e500 req-3b40327f-d90a-482a-8a17-e719f00f1c8c service nova] Releasing lock "refresh_cache-c5b50062-b965-4686-beea-63537d9f1eda" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:52:58 user nova-compute[72444]: DEBUG nova.network.neutron [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Successfully updated port: 6e47393c-8b6c-4008-a802-8a728b3a7a6c {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:52:59 user nova-compute[72444]: DEBUG nova.compute.manager [req-2c32c13d-26fd-4a03-987a-25c91d26b79a req-b5fa0b80-7eba-4c4b-83ed-6cf88363b66d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-changed-df356454-4b89-4b15-955c-6d4d41688490 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:52:59 user nova-compute[72444]: DEBUG nova.compute.manager [req-2c32c13d-26fd-4a03-987a-25c91d26b79a req-b5fa0b80-7eba-4c4b-83ed-6cf88363b66d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Refreshing instance network info cache due to event network-changed-df356454-4b89-4b15-955c-6d4d41688490. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:52:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2c32c13d-26fd-4a03-987a-25c91d26b79a req-b5fa0b80-7eba-4c4b-83ed-6cf88363b66d service nova] Acquiring lock "refresh_cache-c5b50062-b965-4686-beea-63537d9f1eda" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:52:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2c32c13d-26fd-4a03-987a-25c91d26b79a req-b5fa0b80-7eba-4c4b-83ed-6cf88363b66d service nova] Acquired lock "refresh_cache-c5b50062-b965-4686-beea-63537d9f1eda" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:52:59 user nova-compute[72444]: DEBUG nova.network.neutron [req-2c32c13d-26fd-4a03-987a-25c91d26b79a req-b5fa0b80-7eba-4c4b-83ed-6cf88363b66d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Refreshing network info cache for port df356454-4b89-4b15-955c-6d4d41688490 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:52:59 user nova-compute[72444]: DEBUG nova.network.neutron [req-2c32c13d-26fd-4a03-987a-25c91d26b79a req-b5fa0b80-7eba-4c4b-83ed-6cf88363b66d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:52:59 user nova-compute[72444]: DEBUG nova.network.neutron [req-2c32c13d-26fd-4a03-987a-25c91d26b79a req-b5fa0b80-7eba-4c4b-83ed-6cf88363b66d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:52:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2c32c13d-26fd-4a03-987a-25c91d26b79a req-b5fa0b80-7eba-4c4b-83ed-6cf88363b66d service nova] Releasing lock "refresh_cache-c5b50062-b965-4686-beea-63537d9f1eda" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:52:59 user nova-compute[72444]: DEBUG nova.compute.manager [req-2c32c13d-26fd-4a03-987a-25c91d26b79a req-b5fa0b80-7eba-4c4b-83ed-6cf88363b66d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-changed-6e47393c-8b6c-4008-a802-8a728b3a7a6c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:52:59 user nova-compute[72444]: DEBUG nova.compute.manager [req-2c32c13d-26fd-4a03-987a-25c91d26b79a req-b5fa0b80-7eba-4c4b-83ed-6cf88363b66d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Refreshing instance network info cache due to event network-changed-6e47393c-8b6c-4008-a802-8a728b3a7a6c. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:52:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2c32c13d-26fd-4a03-987a-25c91d26b79a req-b5fa0b80-7eba-4c4b-83ed-6cf88363b66d service nova] Acquiring lock "refresh_cache-c5b50062-b965-4686-beea-63537d9f1eda" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:52:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2c32c13d-26fd-4a03-987a-25c91d26b79a req-b5fa0b80-7eba-4c4b-83ed-6cf88363b66d service nova] Acquired lock "refresh_cache-c5b50062-b965-4686-beea-63537d9f1eda" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:52:59 user nova-compute[72444]: DEBUG nova.network.neutron [req-2c32c13d-26fd-4a03-987a-25c91d26b79a req-b5fa0b80-7eba-4c4b-83ed-6cf88363b66d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Refreshing network info cache for port 6e47393c-8b6c-4008-a802-8a728b3a7a6c {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:52:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:52:59 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:52:59 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 04:53:00 user nova-compute[72444]: DEBUG nova.network.neutron [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Successfully updated port: 9fb86964-076c-439e-84fa-7893c15e8871 {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:53:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:00 user nova-compute[72444]: DEBUG nova.network.neutron [req-2c32c13d-26fd-4a03-987a-25c91d26b79a req-b5fa0b80-7eba-4c4b-83ed-6cf88363b66d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:53:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Acquiring lock "refresh_cache-c5b50062-b965-4686-beea-63537d9f1eda" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:53:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Acquiring lock "ae41789a-ebd1-4265-a903-32d2006e66d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:53:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "ae41789a-ebd1-4265-a903-32d2006e66d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:53:00 user nova-compute[72444]: DEBUG nova.compute.manager [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 04:53:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-e2859322-6f99-442d-bee1-65fe49ce6360" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:53:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-e2859322-6f99-442d-bee1-65fe49ce6360" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:53:00 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 04:53:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:53:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:53:00 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 04:53:00 user nova-compute[72444]: INFO nova.compute.claims [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Claim successful on node user
Aug 03 04:53:00 user nova-compute[72444]: DEBUG nova.network.neutron [req-2c32c13d-26fd-4a03-987a-25c91d26b79a req-b5fa0b80-7eba-4c4b-83ed-6cf88363b66d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:53:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2c32c13d-26fd-4a03-987a-25c91d26b79a req-b5fa0b80-7eba-4c4b-83ed-6cf88363b66d service nova] Releasing lock "refresh_cache-c5b50062-b965-4686-beea-63537d9f1eda" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:53:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Acquired lock "refresh_cache-c5b50062-b965-4686-beea-63537d9f1eda" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:53:00 user nova-compute[72444]: DEBUG nova.network.neutron [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:53:00 user nova-compute[72444]: DEBUG nova.network.neutron [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:53:01 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Updating instance_info_cache with network_info: [{"id": "269c2e0d-94ee-4084-985a-58c5afed4411", "address": "fa:16:3e:bd:11:20", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap269c2e0d-94", "ovs_interfaceid": "269c2e0d-94ee-4084-985a-58c5afed4411", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:53:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-e2859322-6f99-442d-bee1-65fe49ce6360" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:53:01 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 04:53:01 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:53:01 user nova-compute[72444]: DEBUG nova.compute.manager [req-74ef319b-49ea-4e68-b05e-a91e8af84bb8 req-a365e89e-7f0f-4ae3-9dc0-13b33d796381 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-changed-9fb86964-076c-439e-84fa-7893c15e8871 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:53:01 user nova-compute[72444]: DEBUG nova.compute.manager [req-74ef319b-49ea-4e68-b05e-a91e8af84bb8 req-a365e89e-7f0f-4ae3-9dc0-13b33d796381 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Refreshing instance network info cache due to event network-changed-9fb86964-076c-439e-84fa-7893c15e8871. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:53:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-74ef319b-49ea-4e68-b05e-a91e8af84bb8 req-a365e89e-7f0f-4ae3-9dc0-13b33d796381 service nova] Acquiring lock "refresh_cache-c5b50062-b965-4686-beea-63537d9f1eda" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:53:01 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:53:01 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:53:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.597s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:53:01 user nova-compute[72444]: DEBUG nova.compute.manager [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 04:53:01 user nova-compute[72444]: DEBUG nova.compute.manager [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 04:53:01 user nova-compute[72444]: DEBUG nova.network.neutron [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 04:53:01 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 04:53:01 user nova-compute[72444]: DEBUG nova.compute.manager [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 04:53:01 user nova-compute[72444]: DEBUG nova.policy [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cfb2412d135d4e45b5b1c2edf63a560c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd114efe1dfc1424299621df67bf00863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 04:53:01 user nova-compute[72444]: DEBUG nova.compute.manager [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 04:53:01 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 04:53:01 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Creating image(s)
Aug 03 04:53:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:53:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "/opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:53:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "/opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:53:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.154s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:53:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:53:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.196s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk 1073741824" returned: 0 in 0.058s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:53:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.157s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:02 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 04:53:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:02 user nova-compute[72444]: DEBUG nova.network.neutron [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Successfully created port: 37b60bd1-1877-4cd1-833b-4db852dbe1f8 {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:53:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:02 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Cannot resize image /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 04:53:02 user nova-compute[72444]: DEBUG nova.objects.instance [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lazy-loading 'migration_context' on Instance uuid ae41789a-ebd1-4265-a903-32d2006e66d1 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:53:02 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 04:53:02 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Ensure instance console log exists: /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 04:53:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:53:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:53:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:53:03 user nova-compute[72444]: DEBUG nova.network.neutron [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Updating instance_info_cache with network_info: [{"id": "4015917d-392d-4101-a347-15b1a37dc252", "address": "fa:16:3e:2f:8b:e3", "network": {"id": "0dfdee8f-99ee-4369-af46-a2f1d097cf8c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-316229813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4015917d-39", "ovs_interfaceid": "4015917d-392d-4101-a347-15b1a37dc252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "978bd88d-0401-4456-b332-7494cbebe1f2", "address": "fa:16:3e:66:09:aa", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap978bd88d-04", "ovs_interfaceid": "978bd88d-0401-4456-b332-7494cbebe1f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "98143be5-d207-4206-a9fb-39bd8b05822e", "address": "fa:16:3e:68:a8:5f", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98143be5-d2", "ovs_interfaceid": "98143be5-d207-4206-a9fb-39bd8b05822e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fe941d99-e8f6-42bd-939e-d2955caed33d", "address": "fa:16:3e:94:2f:3a", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe941d99-e8", "ovs_interfaceid": "fe941d99-e8f6-42bd-939e-d2955caed33d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "df356454-4b89-4b15-955c-6d4d41688490", "address": "fa:16:3e:5d:b1:8b", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf356454-4b", "ovs_interfaceid": "df356454-4b89-4b15-955c-6d4d41688490", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6e47393c-8b6c-4008-a802-8a728b3a7a6c", "address": "fa:16:3e:1d:3a:74", "network": {"id": "bc31bf9c-5e34-4a68-91e8-6a79eb2e0cdf", "bridge": "br-int", "label": "tempest-device-tagging-net2-117214369", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e47393c-8b", "ovs_interfaceid": "6e47393c-8b6c-4008-a802-8a728b3a7a6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9fb86964-076c-439e-84fa-7893c15e8871", "address": "fa:16:3e:5b:33:4e", "network": {"id": "bc31bf9c-5e34-4a68-91e8-6a79eb2e0cdf", "bridge": "br-int", "label": "tempest-device-tagging-net2-117214369", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb86964-07", "ovs_interfaceid": "9fb86964-076c-439e-84fa-7893c15e8871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:53:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Releasing lock "refresh_cache-c5b50062-b965-4686-beea-63537d9f1eda" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:53:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Instance network_info: |[{"id": "4015917d-392d-4101-a347-15b1a37dc252", "address": "fa:16:3e:2f:8b:e3", "network": {"id": "0dfdee8f-99ee-4369-af46-a2f1d097cf8c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-316229813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4015917d-39", "ovs_interfaceid": "4015917d-392d-4101-a347-15b1a37dc252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "978bd88d-0401-4456-b332-7494cbebe1f2", "address": "fa:16:3e:66:09:aa", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap978bd88d-04", "ovs_interfaceid": "978bd88d-0401-4456-b332-7494cbebe1f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "98143be5-d207-4206-a9fb-39bd8b05822e", "address": "fa:16:3e:68:a8:5f", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98143be5-d2", "ovs_interfaceid": "98143be5-d207-4206-a9fb-39bd8b05822e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fe941d99-e8f6-42bd-939e-d2955caed33d", "address": "fa:16:3e:94:2f:3a", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe941d99-e8", "ovs_interfaceid": "fe941d99-e8f6-42bd-939e-d2955caed33d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "df356454-4b89-4b15-955c-6d4d41688490", "address": "fa:16:3e:5d:b1:8b", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf356454-4b", "ovs_interfaceid": "df356454-4b89-4b15-955c-6d4d41688490", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6e47393c-8b6c-4008-a802-8a728b3a7a6c", "address": "fa:16:3e:1d:3a:74", "network": {"id": "bc31bf9c-5e34-4a68-91e8-6a79eb2e0cdf", "bridge": "br-int", "label": "tempest-device-tagging-net2-117214369", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e47393c-8b", "ovs_interfaceid": "6e47393c-8b6c-4008-a802-8a728b3a7a6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9fb86964-076c-439e-84fa-7893c15e8871", "address": "fa:16:3e:5b:33:4e", "network": {"id": "bc31bf9c-5e34-4a68-91e8-6a79eb2e0cdf", "bridge": "br-int", "label": "tempest-device-tagging-net2-117214369", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb86964-07", "ovs_interfaceid": "9fb86964-076c-439e-84fa-7893c15e8871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 04:53:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-74ef319b-49ea-4e68-b05e-a91e8af84bb8 req-a365e89e-7f0f-4ae3-9dc0-13b33d796381 service nova] Acquired lock "refresh_cache-c5b50062-b965-4686-beea-63537d9f1eda" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:53:03 user nova-compute[72444]: DEBUG nova.network.neutron [req-74ef319b-49ea-4e68-b05e-a91e8af84bb8 req-a365e89e-7f0f-4ae3-9dc0-13b33d796381 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Refreshing network info cache for port 9fb86964-076c-439e-84fa-7893c15e8871 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:53:03 user nova-compute[72444]: DEBUG nova.network.neutron [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Successfully updated port: 37b60bd1-1877-4cd1-833b-4db852dbe1f8 {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:53:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Acquiring lock "refresh_cache-ae41789a-ebd1-4265-a903-32d2006e66d1" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:53:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Acquired lock "refresh_cache-ae41789a-ebd1-4265-a903-32d2006e66d1" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:53:03 user nova-compute[72444]: DEBUG nova.network.neutron [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:53:03 user nova-compute[72444]: DEBUG nova.compute.manager [req-ef1449d1-da5a-4df2-9152-0e8823d88e84 req-a63dbbce-91da-4cbc-a81f-63ae10f71f2f service nova] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Received event network-changed-37b60bd1-1877-4cd1-833b-4db852dbe1f8 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:53:03 user nova-compute[72444]: DEBUG nova.compute.manager [req-ef1449d1-da5a-4df2-9152-0e8823d88e84 req-a63dbbce-91da-4cbc-a81f-63ae10f71f2f service nova] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Refreshing instance network info cache due to event network-changed-37b60bd1-1877-4cd1-833b-4db852dbe1f8. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:53:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ef1449d1-da5a-4df2-9152-0e8823d88e84 req-a63dbbce-91da-4cbc-a81f-63ae10f71f2f service nova] Acquiring lock "refresh_cache-ae41789a-ebd1-4265-a903-32d2006e66d1" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:53:03 user nova-compute[72444]: DEBUG nova.network.neutron [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:53:03 user nova-compute[72444]: DEBUG nova.network.neutron [req-74ef319b-49ea-4e68-b05e-a91e8af84bb8 req-a365e89e-7f0f-4ae3-9dc0-13b33d796381 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Updated VIF entry in instance network info cache for port 9fb86964-076c-439e-84fa-7893c15e8871. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:53:03 user nova-compute[72444]: DEBUG nova.network.neutron [req-74ef319b-49ea-4e68-b05e-a91e8af84bb8 req-a365e89e-7f0f-4ae3-9dc0-13b33d796381 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Updating instance_info_cache with network_info: [{"id": "4015917d-392d-4101-a347-15b1a37dc252", "address": "fa:16:3e:2f:8b:e3", "network": {"id": "0dfdee8f-99ee-4369-af46-a2f1d097cf8c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-316229813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4015917d-39", "ovs_interfaceid": "4015917d-392d-4101-a347-15b1a37dc252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "978bd88d-0401-4456-b332-7494cbebe1f2", "address": "fa:16:3e:66:09:aa", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap978bd88d-04", "ovs_interfaceid": "978bd88d-0401-4456-b332-7494cbebe1f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "98143be5-d207-4206-a9fb-39bd8b05822e", "address": "fa:16:3e:68:a8:5f", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98143be5-d2", "ovs_interfaceid": "98143be5-d207-4206-a9fb-39bd8b05822e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fe941d99-e8f6-42bd-939e-d2955caed33d", "address": "fa:16:3e:94:2f:3a", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe941d99-e8", "ovs_interfaceid": "fe941d99-e8f6-42bd-939e-d2955caed33d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "df356454-4b89-4b15-955c-6d4d41688490", "address": "fa:16:3e:5d:b1:8b", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf356454-4b", "ovs_interfaceid": "df356454-4b89-4b15-955c-6d4d41688490", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6e47393c-8b6c-4008-a802-8a728b3a7a6c", "address": "fa:16:3e:1d:3a:74", "network": {"id": "bc31bf9c-5e34-4a68-91e8-6a79eb2e0cdf", "bridge": "br-int", "label": "tempest-device-tagging-net2-117214369", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e47393c-8b", "ovs_interfaceid": "6e47393c-8b6c-4008-a802-8a728b3a7a6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9fb86964-076c-439e-84fa-7893c15e8871", "address": "fa:16:3e:5b:33:4e", "network": {"id": "bc31bf9c-5e34-4a68-91e8-6a79eb2e0cdf", "bridge": "br-int", "label": "tempest-device-tagging-net2-117214369", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb86964-07", "ovs_interfaceid": "9fb86964-076c-439e-84fa-7893c15e8871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:53:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-74ef319b-49ea-4e68-b05e-a91e8af84bb8 req-a365e89e-7f0f-4ae3-9dc0-13b33d796381 service nova] Releasing lock "refresh_cache-c5b50062-b965-4686-beea-63537d9f1eda" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:53:03 user nova-compute[72444]: DEBUG nova.network.neutron [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Updating instance_info_cache with network_info: [{"id": "37b60bd1-1877-4cd1-833b-4db852dbe1f8", "address": "fa:16:3e:a9:bc:76", "network": {"id": "bb35bc76-087b-4468-ba0c-3637873207f8", "bridge": "br-int", "label": "tempest-TestStampPattern-620416114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d114efe1dfc1424299621df67bf00863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b60bd1-18", "ovs_interfaceid": "37b60bd1-1877-4cd1-833b-4db852dbe1f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Releasing lock "refresh_cache-ae41789a-ebd1-4265-a903-32d2006e66d1" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG nova.compute.manager [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Instance network_info: |[{"id": "37b60bd1-1877-4cd1-833b-4db852dbe1f8", "address": "fa:16:3e:a9:bc:76", "network": {"id": "bb35bc76-087b-4468-ba0c-3637873207f8", "bridge": "br-int", "label": "tempest-TestStampPattern-620416114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d114efe1dfc1424299621df67bf00863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b60bd1-18", "ovs_interfaceid": "37b60bd1-1877-4cd1-833b-4db852dbe1f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ef1449d1-da5a-4df2-9152-0e8823d88e84 req-a63dbbce-91da-4cbc-a81f-63ae10f71f2f service nova] Acquired lock "refresh_cache-ae41789a-ebd1-4265-a903-32d2006e66d1" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG nova.network.neutron [req-ef1449d1-da5a-4df2-9152-0e8823d88e84 req-a63dbbce-91da-4cbc-a81f-63ae10f71f2f service nova] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Refreshing network info cache for port 37b60bd1-1877-4cd1-833b-4db852dbe1f8 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Start _get_guest_xml network_info=[{"id": "37b60bd1-1877-4cd1-833b-4db852dbe1f8", "address": "fa:16:3e:a9:bc:76", "network": {"id": "bb35bc76-087b-4468-ba0c-3637873207f8", "bridge": "br-int", "label": "tempest-TestStampPattern-620416114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d114efe1dfc1424299621df67bf00863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b60bd1-18", "ovs_interfaceid": "37b60bd1-1877-4cd1-833b-4db852dbe1f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:53:04 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:53:04 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:53:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:52:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1428763732',display_name='tempest-TestStampPattern-server-1428763732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1428763732',id=31,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0MFXjSU5PJXVROOnqeclCBxvU1Uyrwrp4WGd6L7LODOpU9OooUOpH73m523qz3COWVGWjrJJsa98O/ExJkhRZGY7wvCQTS/3+V2FidnkreOl/H1zHbvv0lhsewf7GMag==',key_name='tempest-TestStampPattern-164301022',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d114efe1dfc1424299621df67bf00863',ramdisk_id='',reservation_id='r-bbk5plvj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-786118238',owner_user_name='tempest-TestStampPattern-786118238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:53:01Z,user_data=None,user_id='cfb2412d135d4e45b5b1c2edf63a560c',uuid=ae41789a-ebd1-4265-a903-32d2006e66d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37b60bd1-1877-4cd1-833b-4db852dbe1f8", "address": "fa:16:3e:a9:bc:76", "network": {"id": "bb35bc76-087b-4468-ba0c-3637873207f8", "bridge": "br-int", "label": "tempest-TestStampPattern-620416114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d114efe1dfc1424299621df67bf00863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b60bd1-18", "ovs_interfaceid": "37b60bd1-1877-4cd1-833b-4db852dbe1f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Converting VIF {"id": "37b60bd1-1877-4cd1-833b-4db852dbe1f8", "address": "fa:16:3e:a9:bc:76", "network": {"id": "bb35bc76-087b-4468-ba0c-3637873207f8", "bridge": "br-int", "label": "tempest-TestStampPattern-620416114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d114efe1dfc1424299621df67bf00863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b60bd1-18", "ovs_interfaceid": "37b60bd1-1877-4cd1-833b-4db852dbe1f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:bc:76,bridge_name='br-int',has_traffic_filtering=True,id=37b60bd1-1877-4cd1-833b-4db852dbe1f8,network=Network(bb35bc76-087b-4468-ba0c-3637873207f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37b60bd1-18') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG nova.objects.instance [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lazy-loading 'pci_devices' on Instance uuid ae41789a-ebd1-4265-a903-32d2006e66d1 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:53:04 user nova-compute[72444]:   <uuid>ae41789a-ebd1-4265-a903-32d2006e66d1</uuid>
Aug 03 04:53:04 user nova-compute[72444]:   <name>instance-0000001f</name>
Aug 03 04:53:04 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:53:04 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:53:04 user nova-compute[72444]:   <metadata>
Aug 03 04:53:04 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:53:04 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:53:04 user nova-compute[72444]:       <nova:name>tempest-TestStampPattern-server-1428763732</nova:name>
Aug 03 04:53:04 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:53:04</nova:creationTime>
Aug 03 04:53:04 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:53:04 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:53:04 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:53:04 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:53:04 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:53:04 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:53:04 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:53:04 user nova-compute[72444]:       <nova:owner>
Aug 03 04:53:04 user nova-compute[72444]:         <nova:user uuid="cfb2412d135d4e45b5b1c2edf63a560c">tempest-TestStampPattern-786118238-project-member</nova:user>
Aug 03 04:53:04 user nova-compute[72444]:         <nova:project uuid="d114efe1dfc1424299621df67bf00863">tempest-TestStampPattern-786118238</nova:project>
Aug 03 04:53:04 user nova-compute[72444]:       </nova:owner>
Aug 03 04:53:04 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:53:04 user nova-compute[72444]:       <nova:ports>
Aug 03 04:53:04 user nova-compute[72444]:         <nova:port uuid="37b60bd1-1877-4cd1-833b-4db852dbe1f8">
Aug 03 04:53:04 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 03 04:53:04 user nova-compute[72444]:         </nova:port>
Aug 03 04:53:04 user nova-compute[72444]:       </nova:ports>
Aug 03 04:53:04 user nova-compute[72444]:     </nova:instance>
Aug 03 04:53:04 user nova-compute[72444]:   </metadata>
Aug 03 04:53:04 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:53:04 user nova-compute[72444]:     <system>
Aug 03 04:53:04 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:53:04 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:53:04 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:53:04 user nova-compute[72444]:       <entry name="serial">ae41789a-ebd1-4265-a903-32d2006e66d1</entry>
Aug 03 04:53:04 user nova-compute[72444]:       <entry name="uuid">ae41789a-ebd1-4265-a903-32d2006e66d1</entry>
Aug 03 04:53:04 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:53:04 user nova-compute[72444]:     </system>
Aug 03 04:53:04 user nova-compute[72444]:   </sysinfo>
Aug 03 04:53:04 user nova-compute[72444]:   <os>
Aug 03 04:53:04 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:53:04 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:53:04 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:53:04 user nova-compute[72444]:   </os>
Aug 03 04:53:04 user nova-compute[72444]:   <features>
Aug 03 04:53:04 user nova-compute[72444]:     <acpi/>
Aug 03 04:53:04 user nova-compute[72444]:     <apic/>
Aug 03 04:53:04 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:53:04 user nova-compute[72444]:   </features>
Aug 03 04:53:04 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:53:04 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:53:04 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:53:04 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:53:04 user nova-compute[72444]:   </clock>
Aug 03 04:53:04 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:53:04 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:53:04 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:53:04 user nova-compute[72444]:   </cpu>
Aug 03 04:53:04 user nova-compute[72444]:   <devices>
Aug 03 04:53:04 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:53:04 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:53:04 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk"/>
Aug 03 04:53:04 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:53:04 user nova-compute[72444]:     </disk>
Aug 03 04:53:04 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:53:04 user nova-compute[72444]:       <mac address="fa:16:3e:a9:bc:76"/>
Aug 03 04:53:04 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:53:04 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:53:04 user nova-compute[72444]:       <target dev="tap37b60bd1-18"/>
Aug 03 04:53:04 user nova-compute[72444]:     </interface>
Aug 03 04:53:04 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:53:04 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/console.log" append="off"/>
Aug 03 04:53:04 user nova-compute[72444]:     </serial>
Aug 03 04:53:04 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:53:04 user nova-compute[72444]:     <video>
Aug 03 04:53:04 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:53:04 user nova-compute[72444]:     </video>
Aug 03 04:53:04 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:53:04 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:53:04 user nova-compute[72444]:     </rng>
Aug 03 04:53:04 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:53:04 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:53:04 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:53:04 user nova-compute[72444]:     </memballoon>
Aug 03 04:53:04 user nova-compute[72444]:   </devices>
Aug 03 04:53:04 user nova-compute[72444]: </domain>
Aug 03 04:53:04 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:52:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1428763732',display_name='tempest-TestStampPattern-server-1428763732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1428763732',id=31,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0MFXjSU5PJXVROOnqeclCBxvU1Uyrwrp4WGd6L7LODOpU9OooUOpH73m523qz3COWVGWjrJJsa98O/ExJkhRZGY7wvCQTS/3+V2FidnkreOl/H1zHbvv0lhsewf7GMag==',key_name='tempest-TestStampPattern-164301022',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d114efe1dfc1424299621df67bf00863',ramdisk_id='',reservation_id='r-bbk5plvj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-786118238',owner_user_name='tempest-TestStampPattern-786118238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:53:01Z,user_data=None,user_id='cfb2412d135d4e45b5b1c2edf63a560c',uuid=ae41789a-ebd1-4265-a903-32d2006e66d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37b60bd1-1877-4cd1-833b-4db852dbe1f8", "address": "fa:16:3e:a9:bc:76", "network": {"id": "bb35bc76-087b-4468-ba0c-3637873207f8", "bridge": "br-int", "label": "tempest-TestStampPattern-620416114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d114efe1dfc1424299621df67bf00863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b60bd1-18", "ovs_interfaceid": "37b60bd1-1877-4cd1-833b-4db852dbe1f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Converting VIF {"id": "37b60bd1-1877-4cd1-833b-4db852dbe1f8", "address": "fa:16:3e:a9:bc:76", "network": {"id": "bb35bc76-087b-4468-ba0c-3637873207f8", "bridge": "br-int", "label": "tempest-TestStampPattern-620416114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d114efe1dfc1424299621df67bf00863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b60bd1-18", "ovs_interfaceid": "37b60bd1-1877-4cd1-833b-4db852dbe1f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:bc:76,bridge_name='br-int',has_traffic_filtering=True,id=37b60bd1-1877-4cd1-833b-4db852dbe1f8,network=Network(bb35bc76-087b-4468-ba0c-3637873207f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37b60bd1-18') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG os_vif [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:bc:76,bridge_name='br-int',has_traffic_filtering=True,id=37b60bd1-1877-4cd1-833b-4db852dbe1f8,network=Network(bb35bc76-087b-4468-ba0c-3637873207f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37b60bd1-18') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37b60bd1-18, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap37b60bd1-18, col_values=(('external_ids', {'iface-id': '37b60bd1-1877-4cd1-833b-4db852dbe1f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:bc:76', 'vm-uuid': 'ae41789a-ebd1-4265-a903-32d2006e66d1'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:04 user nova-compute[72444]: INFO os_vif [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:bc:76,bridge_name='br-int',has_traffic_filtering=True,id=37b60bd1-1877-4cd1-833b-4db852dbe1f8,network=Network(bb35bc76-087b-4468-ba0c-3637873207f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37b60bd1-18')
Aug 03 04:53:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] No VIF found with MAC fa:16:3e:a9:bc:76, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG nova.network.neutron [req-ef1449d1-da5a-4df2-9152-0e8823d88e84 req-a63dbbce-91da-4cbc-a81f-63ae10f71f2f service nova] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Updated VIF entry in instance network info cache for port 37b60bd1-1877-4cd1-833b-4db852dbe1f8. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG nova.network.neutron [req-ef1449d1-da5a-4df2-9152-0e8823d88e84 req-a63dbbce-91da-4cbc-a81f-63ae10f71f2f service nova] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Updating instance_info_cache with network_info: [{"id": "37b60bd1-1877-4cd1-833b-4db852dbe1f8", "address": "fa:16:3e:a9:bc:76", "network": {"id": "bb35bc76-087b-4468-ba0c-3637873207f8", "bridge": "br-int", "label": "tempest-TestStampPattern-620416114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d114efe1dfc1424299621df67bf00863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b60bd1-18", "ovs_interfaceid": "37b60bd1-1877-4cd1-833b-4db852dbe1f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ef1449d1-da5a-4df2-9152-0e8823d88e84 req-a63dbbce-91da-4cbc-a81f-63ae10f71f2f service nova] Releasing lock "refresh_cache-ae41789a-ebd1-4265-a903-32d2006e66d1" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:53:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:05 user nova-compute[72444]: DEBUG nova.compute.manager [req-94547740-3af5-4313-ae2e-d52c654a5b15 req-7378cc59-ef0d-45ae-af5d-d9adf7651c90 service nova] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Received event network-vif-plugged-37b60bd1-1877-4cd1-833b-4db852dbe1f8 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:53:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-94547740-3af5-4313-ae2e-d52c654a5b15 req-7378cc59-ef0d-45ae-af5d-d9adf7651c90 service nova] Acquiring lock "ae41789a-ebd1-4265-a903-32d2006e66d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:53:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-94547740-3af5-4313-ae2e-d52c654a5b15 req-7378cc59-ef0d-45ae-af5d-d9adf7651c90 service nova] Lock "ae41789a-ebd1-4265-a903-32d2006e66d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:53:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-94547740-3af5-4313-ae2e-d52c654a5b15 req-7378cc59-ef0d-45ae-af5d-d9adf7651c90 service nova] Lock "ae41789a-ebd1-4265-a903-32d2006e66d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:53:05 user nova-compute[72444]: DEBUG nova.compute.manager [req-94547740-3af5-4313-ae2e-d52c654a5b15 req-7378cc59-ef0d-45ae-af5d-d9adf7651c90 service nova] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] No waiting events found dispatching network-vif-plugged-37b60bd1-1877-4cd1-833b-4db852dbe1f8 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:53:05 user nova-compute[72444]: WARNING nova.compute.manager [req-94547740-3af5-4313-ae2e-d52c654a5b15 req-7378cc59-ef0d-45ae-af5d-d9adf7651c90 service nova] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Received unexpected event network-vif-plugged-37b60bd1-1877-4cd1-833b-4db852dbe1f8 for instance with vm_state building and task_state spawning.
Aug 03 04:53:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:07 user nova-compute[72444]: INFO nova.virt.block_device [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Booting with volume 80ba9030-fb28-4918-a99c-7e333a003853 at /dev/vdc
Aug 03 04:53:07 user nova-compute[72444]: DEBUG os_brick.utils [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:53:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9ab3f4-f6c0-4bea-bfe5-e0fb066cedb6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5792cf-75ee-4b79-bbc9-f4b2ec2b66d1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d3c97c-54bb-4575-9414-d9393e46a014]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[969b395a-4fec-44be-bcd9-5ba4b769ad32]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:53:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 04:53:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:53:07 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 04:53:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85af326-03a5-4509-9975-ada2258744a0]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 04:53:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 04:53:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 04:53:07 user nova-compute[72444]: DEBUG os_brick.utils [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:53:07 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Updating existing volume attachment record: 1dc50e43-81ae-4ef6-b8fe-371c59932d00 {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 04:53:07 user nova-compute[72444]: DEBUG nova.compute.manager [req-e8009132-12d8-4023-a2f3-c14cb6793093 req-7adf9a7d-a983-448a-9794-594f34083ef1 service nova] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Received event network-vif-plugged-37b60bd1-1877-4cd1-833b-4db852dbe1f8 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:53:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e8009132-12d8-4023-a2f3-c14cb6793093 req-7adf9a7d-a983-448a-9794-594f34083ef1 service nova] Acquiring lock "ae41789a-ebd1-4265-a903-32d2006e66d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:53:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e8009132-12d8-4023-a2f3-c14cb6793093 req-7adf9a7d-a983-448a-9794-594f34083ef1 service nova] Lock "ae41789a-ebd1-4265-a903-32d2006e66d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:53:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e8009132-12d8-4023-a2f3-c14cb6793093 req-7adf9a7d-a983-448a-9794-594f34083ef1 service nova] Lock "ae41789a-ebd1-4265-a903-32d2006e66d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:53:07 user nova-compute[72444]: DEBUG nova.compute.manager [req-e8009132-12d8-4023-a2f3-c14cb6793093 req-7adf9a7d-a983-448a-9794-594f34083ef1 service nova] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] No waiting events found dispatching network-vif-plugged-37b60bd1-1877-4cd1-833b-4db852dbe1f8 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:53:07 user nova-compute[72444]: WARNING nova.compute.manager [req-e8009132-12d8-4023-a2f3-c14cb6793093 req-7adf9a7d-a983-448a-9794-594f34083ef1 service nova] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Received unexpected event network-vif-plugged-37b60bd1-1877-4cd1-833b-4db852dbe1f8 for instance with vm_state building and task_state spawning.
Aug 03 04:53:07 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038387.8406618, ae41789a-ebd1-4265-a903-32d2006e66d1 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:53:07 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] VM Resumed (Lifecycle Event)
Aug 03 04:53:07 user nova-compute[72444]: DEBUG nova.compute.manager [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:53:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 04:53:07 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Instance spawned successfully.
Aug 03 04:53:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 04:53:07 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:53:07 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:53:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:53:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:53:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:53:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:53:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:53:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:53:07 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:53:07 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038387.843174, ae41789a-ebd1-4265-a903-32d2006e66d1 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:53:07 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] VM Started (Lifecycle Event)
Aug 03 04:53:07 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:53:07 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:53:07 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:53:08 user nova-compute[72444]: INFO nova.compute.manager [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Took 6.41 seconds to spawn the instance on the hypervisor.
Aug 03 04:53:08 user nova-compute[72444]: DEBUG nova.compute.manager [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:53:08 user nova-compute[72444]: INFO nova.compute.manager [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Took 7.49 seconds to build instance.
Aug 03 04:53:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b031db56-10ab-4426-b3e0-1fdbb51c5247 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "ae41789a-ebd1-4265-a903-32d2006e66d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.694s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:53:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:15 user nova-compute[72444]: INFO nova.compute.manager [None req-7a20a12b-e0fa-45d3-8bd4-a173677cc784 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Unrescuing
Aug 03 04:53:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7a20a12b-e0fa-45d3-8bd4-a173677cc784 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "refresh_cache-c77e96da-6411-4ae9-af05-8e9bb3c432c6" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:53:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7a20a12b-e0fa-45d3-8bd4-a173677cc784 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquired lock "refresh_cache-c77e96da-6411-4ae9-af05-8e9bb3c432c6" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:53:15 user nova-compute[72444]: DEBUG nova.network.neutron [None req-7a20a12b-e0fa-45d3-8bd4-a173677cc784 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG nova.network.neutron [None req-7a20a12b-e0fa-45d3-8bd4-a173677cc784 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Updating instance_info_cache with network_info: [{"id": "90104ef6-fe9b-4347-8df6-934a276e077b", "address": "fa:16:3e:22:ec:e0", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90104ef6-fe", "ovs_interfaceid": "90104ef6-fe9b-4347-8df6-934a276e077b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7a20a12b-e0fa-45d3-8bd4-a173677cc784 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Releasing lock "refresh_cache-c77e96da-6411-4ae9-af05-8e9bb3c432c6" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG nova.objects.instance [None req-7a20a12b-e0fa-45d3-8bd4-a173677cc784 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lazy-loading 'flavor' on Instance uuid c77e96da-6411-4ae9-af05-8e9bb3c432c6 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG nova.compute.manager [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 04:53:16 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Creating image(s)
Aug 03 04:53:16 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Did not create local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Ensure instance console log exists: /opt/stack/data/nova/instances/c5b50062-b965-4686-beea-63537d9f1eda/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Start _get_guest_xml network_info=[{"id": "4015917d-392d-4101-a347-15b1a37dc252", "address": "fa:16:3e:2f:8b:e3", "network": {"id": "0dfdee8f-99ee-4369-af46-a2f1d097cf8c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-316229813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4015917d-39", "ovs_interfaceid": "4015917d-392d-4101-a347-15b1a37dc252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "978bd88d-0401-4456-b332-7494cbebe1f2", "address": "fa:16:3e:66:09:aa", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap978bd88d-04", "ovs_interfaceid": "978bd88d-0401-4456-b332-7494cbebe1f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "98143be5-d207-4206-a9fb-39bd8b05822e", "address": "fa:16:3e:68:a8:5f", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98143be5-d2", "ovs_interfaceid": "98143be5-d207-4206-a9fb-39bd8b05822e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fe941d99-e8f6-42bd-939e-d2955caed33d", "address": "fa:16:3e:94:2f:3a", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe941d99-e8", "ovs_interfaceid": "fe941d99-e8f6-42bd-939e-d2955caed33d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "df356454-4b89-4b15-955c-6d4d41688490", "address": "fa:16:3e:5d:b1:8b", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf356454-4b", "ovs_interfaceid": "df356454-4b89-4b15-955c-6d4d41688490", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6e47393c-8b6c-4008-a802-8a728b3a7a6c", "address": "fa:16:3e:1d:3a:74", "network": {"id": "bc31bf9c-5e34-4a68-91e8-6a79eb2e0cdf", "bridge": "br-int", "label": "tempest-device-tagging-net2-117214369", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e47393c-8b", "ovs_interfaceid": "6e47393c-8b6c-4008-a802-8a728b3a7a6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9fb86964-076c-439e-84fa-7893c15e8871", "address": "fa:16:3e:5b:33:4e", "network": {"id": "bc31bf9c-5e34-4a68-91e8-6a79eb2e0cdf", "bridge": "br-int", "label": "tempest-device-tagging-net2-117214369", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb86964-07", "ovs_interfaceid": "9fb86964-076c-439e-84fa-7893c15e8871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wMfbvstS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c5b50062-b965-4686-beea-63537d9f1eda', 'attached_at': '', 'detached_at': '', 'volume_id': 'd99161a6-916a-44e5-8815-0f0df9d29727', 'serial': 'd99161a6-916a-44e5-8815-0f0df9d29727'}, 'disk_bus': 'virtio', 'attachment_id': '55f847b6-6ebb-43ef-a58f-e11ec89e482f', 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None}, {'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YPiDSpjI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c5b50062-b965-4686-beea-63537d9f1eda', 'attached_at': '', 'detached_at': '', 'volume_id': '3b58f424-a14b-4c41-8991-fa4fa11d7e55', 'serial': '3b58f424-a14b-4c41-8991-fa4fa11d7e55'}, 'disk_bus': 'virtio', 'attachment_id': '22ff4a23-fbe9-476a-8ccf-9c96a594dbfe', 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None}, {'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'alKQHMOo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c5b50062-b965-4686-beea-63537d9f1eda', 'attached_at': '', 'detached_at': '', 'volume_id': '80ba9030-fb28-4918-a99c-7e333a003853', 'serial': '80ba9030-fb28-4918-a99c-7e333a003853'}, 'disk_bus': 'virtio', 'attachment_id': '1dc50e43-81ae-4ef6-b8fe-371c59932d00', 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:16 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:53:16 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:53:16 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wMfbvstS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:53:16 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:53:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:53:16 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:53:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:53:16 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:53:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65a08d5-dd75-43e5-8f9d-0bd77b512945]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 04:53:16 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[01169494-866c-457f-af79-af1d96060857]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727] added
Aug 03 04:53:16 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62c4ae8-7841-446d-aa4a-1ecd0c351e13]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cab8836-264f-403d-a6df-9ffcac97bfcd]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wMfbvstS {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wMfbvstS" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5148b5f2-822a-4181-8bae-6e7668c84633]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wMfbvstS'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f1a31b-15a4-47c6-8b40-e6003ee8b5d2]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6082206e-59d2-4f84-8914-bb6afd2508db]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:53:16 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:53:16 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:53:16 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:53:16 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:53:16 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:53:16 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:53:16 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:53:16 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG nova.compute.manager [req-58e42146-6245-4d75-9395-199daf0bfbdf req-be9d80e6-4077-4b7f-b7c3-8591a0ea4f15 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Received event network-vif-unplugged-90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-58e42146-6245-4d75-9395-199daf0bfbdf req-be9d80e6-4077-4b7f-b7c3-8591a0ea4f15 service nova] Acquiring lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-58e42146-6245-4d75-9395-199daf0bfbdf req-be9d80e6-4077-4b7f-b7c3-8591a0ea4f15 service nova] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-58e42146-6245-4d75-9395-199daf0bfbdf req-be9d80e6-4077-4b7f-b7c3-8591a0ea4f15 service nova] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG nova.compute.manager [req-58e42146-6245-4d75-9395-199daf0bfbdf req-be9d80e6-4077-4b7f-b7c3-8591a0ea4f15 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] No waiting events found dispatching network-vif-unplugged-90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:53:16 user nova-compute[72444]: WARNING nova.compute.manager [req-58e42146-6245-4d75-9395-199daf0bfbdf req-be9d80e6-4077-4b7f-b7c3-8591a0ea4f15 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Received unexpected event network-vif-unplugged-90104ef6-fe9b-4347-8df6-934a276e077b for instance with vm_state rescued and task_state unrescuing.
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf01253c-1f21-4098-b408-740ed570de19]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727, portal: 172.16.0.220,3260]
Aug 03 04:53:16 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727, portal: 172.16.0.220,3260] successful.
Aug 03 04:53:16 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f77e594-be52-4012-b633-00e0cd3bf617]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2d6421-032e-4d7c-ba96-5c87d2a0c73a]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:53:16 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:53:16 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:53:16 user nova-compute[72444]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)
Aug 03 04:53:16 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:53:16 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:53:16 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:53:16 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:53:16 user nova-compute[72444]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)
Aug 03 04:53:16 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:53:16 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.032s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b22c0be-5cf5-4152-8791-a0c3f8ad5777]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wMfbvstS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:16 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Instance destroyed successfully.
Aug 03 04:53:17 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:53:17 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23135356532636563', 'path': '/dev/sdc'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:53:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135356532636563', 'path': '/dev/sdc'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:53:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:53:17 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YPiDSpjI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:53:17 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:53:17 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:53:17 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:53:17 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:53:17 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:53:17 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:53:17 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:53:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:17 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a071fd4-a2d7-4d1d-9675-ee01df0c734f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:17 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 04:53:17 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:17 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2e32a2-b06e-4e65-ac1e-3e161027f6f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:17 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55] added
Aug 03 04:53:17 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:17 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[68951f1a-4845-4427-bba0-477e308080fd]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:17 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:17 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[147b5b81-3648-4d62-8417-2ec82c4a86b0]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:17 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YPiDSpjI {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YPiDSpjI" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:17 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[65aa60b9-b3c6-4bb2-bac7-3f665283a154]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:17 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YPiDSpjI'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:17 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5995b60f-666f-43fa-a001-86188f737851]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:17 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:17 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[25cea85c-dc17-4a8c-89c8-c32e1d4e9f0a]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:17 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:53:17 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:53:17 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:53:17 user nova-compute[72444]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)
Aug 03 04:53:17 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:53:17 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:53:17 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:53:17 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:53:17 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:53:17 user nova-compute[72444]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)
Aug 03 04:53:17 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:53:17 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:53:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:18 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f94d224-fb54-4c74-8163-5e9734362be6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55, portal: 172.16.0.220,3260]
Aug 03 04:53:18 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55, portal: 172.16.0.220,3260] successful.
Aug 03 04:53:18 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:18 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1f7e15-ca56-4621-acc5-990c6e34293b]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:18 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[92900a78-021b-4cde-9e65-4d2401cf92fd]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:53:18 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:53:18 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:53:18 user nova-compute[72444]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)
Aug 03 04:53:18 user nova-compute[72444]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)
Aug 03 04:53:18 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:53:18 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:53:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:53:18 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:53:18 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:53:18 user nova-compute[72444]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)
Aug 03 04:53:18 user nova-compute[72444]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)
Aug 03 04:53:18 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:53:18 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:53:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:53:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:53:18 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] HCTL ('38', '-', '-', 0) found on session 29 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:53:18 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:53:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:18 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[461ec551-8f0f-4d07-8191-3da904798f8d]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:18 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Searching for a device in session 29 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:53:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YPiDSpjI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:53:18 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:18 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:18 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:18 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:18 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:18 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:18 user nova-compute[72444]: DEBUG nova.compute.manager [req-2e096748-16ef-4f25-adc6-c31964ca22bb req-daeac573-7c48-40b7-a864-47faf87940ba service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Received event network-vif-plugged-90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:53:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2e096748-16ef-4f25-adc6-c31964ca22bb req-daeac573-7c48-40b7-a864-47faf87940ba service nova] Acquiring lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:53:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2e096748-16ef-4f25-adc6-c31964ca22bb req-daeac573-7c48-40b7-a864-47faf87940ba service nova] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:53:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2e096748-16ef-4f25-adc6-c31964ca22bb req-daeac573-7c48-40b7-a864-47faf87940ba service nova] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:53:18 user nova-compute[72444]: DEBUG nova.compute.manager [req-2e096748-16ef-4f25-adc6-c31964ca22bb req-daeac573-7c48-40b7-a864-47faf87940ba service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] No waiting events found dispatching network-vif-plugged-90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:53:18 user nova-compute[72444]: WARNING nova.compute.manager [req-2e096748-16ef-4f25-adc6-c31964ca22bb req-daeac573-7c48-40b7-a864-47faf87940ba service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Received unexpected event network-vif-plugged-90104ef6-fe9b-4347-8df6-934a276e077b for instance with vm_state rescued and task_state unrescuing.
Aug 03 04:53:18 user nova-compute[72444]: DEBUG nova.compute.manager [req-2e096748-16ef-4f25-adc6-c31964ca22bb req-daeac573-7c48-40b7-a864-47faf87940ba service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Received event network-vif-plugged-90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:53:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2e096748-16ef-4f25-adc6-c31964ca22bb req-daeac573-7c48-40b7-a864-47faf87940ba service nova] Acquiring lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:53:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2e096748-16ef-4f25-adc6-c31964ca22bb req-daeac573-7c48-40b7-a864-47faf87940ba service nova] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:53:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2e096748-16ef-4f25-adc6-c31964ca22bb req-daeac573-7c48-40b7-a864-47faf87940ba service nova] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:53:18 user nova-compute[72444]: DEBUG nova.compute.manager [req-2e096748-16ef-4f25-adc6-c31964ca22bb req-daeac573-7c48-40b7-a864-47faf87940ba service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] No waiting events found dispatching network-vif-plugged-90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:53:18 user nova-compute[72444]: WARNING nova.compute.manager [req-2e096748-16ef-4f25-adc6-c31964ca22bb req-daeac573-7c48-40b7-a864-47faf87940ba service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Received unexpected event network-vif-plugged-90104ef6-fe9b-4347-8df6-934a276e077b for instance with vm_state rescued and task_state unrescuing.
Aug 03 04:53:19 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '26430336366343039', 'path': '/dev/sdg'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430336366343039', 'path': '/dev/sdg'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'alKQHMOo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:53:19 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:53:19 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:53:19 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:53:19 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:53:19 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:53:19 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f142d7-53cd-43bf-8013-38237c3b905c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 04:53:19 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[20be4967-7c8f-4a92-9703-ff906224c5b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853] added
Aug 03 04:53:19 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60e48b4-0fac-480e-87ff-408bf91a29ed]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59ef55d-da79-4fba-83bc-9b4e5fe6e368]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v alKQHMOo {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v alKQHMOo" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c674211-fe86-4c91-917b-b925e1310a9d]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'alKQHMOo'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bef970-c6d2-4ed5-8ee6-aa0eece00bac]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa8cecc-d0b3-4498-870a-778e6f9cb395]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:53:19 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:53:19 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:53:19 user nova-compute[72444]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)
Aug 03 04:53:19 user nova-compute[72444]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)
Aug 03 04:53:19 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:53:19 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:53:19 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:53:19 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:53:19 user nova-compute[72444]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)
Aug 03 04:53:19 user nova-compute[72444]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)
Aug 03 04:53:19 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:53:19 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7c5a91-1385-4b44-9ac8-22976f14d0e5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853, portal: 172.16.0.220,3260]
Aug 03 04:53:19 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853, portal: 172.16.0.220,3260] successful.
Aug 03 04:53:19 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[55765df3-e851-4493-971d-6c2c9a825c9b]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c0dcb0-011f-4550-a7f7-adc75fd4e9f7]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:53:19 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:53:19 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:53:19 user nova-compute[72444]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)
Aug 03 04:53:19 user nova-compute[72444]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)
Aug 03 04:53:19 user nova-compute[72444]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)
Aug 03 04:53:19 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:53:19 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:53:19 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:53:19 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:53:19 user nova-compute[72444]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)
Aug 03 04:53:19 user nova-compute[72444]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)
Aug 03 04:53:19 user nova-compute[72444]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)
Aug 03 04:53:19 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:53:19 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] HCTL ('39', '-', '-', 0) found on session 30 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5076ad5-de60-4d42-9e9e-5a61764e23bb]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Searching for a device in session 30 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'alKQHMOo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:53:19 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '23231313031326666', 'path': '/dev/sdh'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231313031326666', 'path': '/dev/sdh'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Removed pending event for c77e96da-6411-4ae9-af05-8e9bb3c432c6 due to event {{(pid=72444) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038400.5360596, c77e96da-6411-4ae9-af05-8e9bb3c432c6 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:53:20 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] VM Resumed (Lifecycle Event)
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.compute.manager [None req-7a20a12b-e0fa-45d3-8bd4-a173677cc784 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:52:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886858126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886858126',id=29,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEInirpvC4T4EdVFVkrmObaHSSQyMUS/rI7EInKwyhK/lVP4Oj5AshO1QG8VPfD8Cs8eUr/uW0SLnoCIQ2vo52oAp/pq83mxnKrpxML5Ej9Ks6sFH7wB/rHNb5zZc9Ogg==',key_name='tempest-keypair-1178417223',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c053965223cd48eab71fe19c2dcb3856',ramdisk_id='',reservation_id='r-xesres5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1604326291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1604326291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:52:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26901807745b4c748dd3358068d07983',uuid=c5b50062-b965-4686-beea-63537d9f1eda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4015917d-392d-4101-a347-15b1a37dc252", "address": "fa:16:3e:2f:8b:e3", "network": {"id": "0dfdee8f-99ee-4369-af46-a2f1d097cf8c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-316229813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4015917d-39", "ovs_interfaceid": "4015917d-392d-4101-a347-15b1a37dc252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converting VIF {"id": "4015917d-392d-4101-a347-15b1a37dc252", "address": "fa:16:3e:2f:8b:e3", "network": {"id": "0dfdee8f-99ee-4369-af46-a2f1d097cf8c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-316229813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4015917d-39", "ovs_interfaceid": "4015917d-392d-4101-a347-15b1a37dc252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:8b:e3,bridge_name='br-int',has_traffic_filtering=True,id=4015917d-392d-4101-a347-15b1a37dc252,network=Network(0dfdee8f-99ee-4369-af46-a2f1d097cf8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4015917d-39') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:52:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886858126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886858126',id=29,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEInirpvC4T4EdVFVkrmObaHSSQyMUS/rI7EInKwyhK/lVP4Oj5AshO1QG8VPfD8Cs8eUr/uW0SLnoCIQ2vo52oAp/pq83mxnKrpxML5Ej9Ks6sFH7wB/rHNb5zZc9Ogg==',key_name='tempest-keypair-1178417223',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c053965223cd48eab71fe19c2dcb3856',ramdisk_id='',reservation_id='r-xesres5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1604326291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1604326291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:52:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26901807745b4c748dd3358068d07983',uuid=c5b50062-b965-4686-beea-63537d9f1eda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "978bd88d-0401-4456-b332-7494cbebe1f2", "address": "fa:16:3e:66:09:aa", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap978bd88d-04", "ovs_interfaceid": "978bd88d-0401-4456-b332-7494cbebe1f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converting VIF {"id": "978bd88d-0401-4456-b332-7494cbebe1f2", "address": "fa:16:3e:66:09:aa", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap978bd88d-04", "ovs_interfaceid": "978bd88d-0401-4456-b332-7494cbebe1f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:09:aa,bridge_name='br-int',has_traffic_filtering=True,id=978bd88d-0401-4456-b332-7494cbebe1f2,network=Network(24f0a98a-4787-4d04-a606-bad6281d2fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap978bd88d-04') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:52:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886858126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886858126',id=29,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEInirpvC4T4EdVFVkrmObaHSSQyMUS/rI7EInKwyhK/lVP4Oj5AshO1QG8VPfD8Cs8eUr/uW0SLnoCIQ2vo52oAp/pq83mxnKrpxML5Ej9Ks6sFH7wB/rHNb5zZc9Ogg==',key_name='tempest-keypair-1178417223',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c053965223cd48eab71fe19c2dcb3856',ramdisk_id='',reservation_id='r-xesres5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1604326291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1604326291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:52:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26901807745b4c748dd3358068d07983',uuid=c5b50062-b965-4686-beea-63537d9f1eda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98143be5-d207-4206-a9fb-39bd8b05822e", "address": "fa:16:3e:68:a8:5f", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98143be5-d2", "ovs_interfaceid": "98143be5-d207-4206-a9fb-39bd8b05822e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converting VIF {"id": "98143be5-d207-4206-a9fb-39bd8b05822e", "address": "fa:16:3e:68:a8:5f", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98143be5-d2", "ovs_interfaceid": "98143be5-d207-4206-a9fb-39bd8b05822e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:a8:5f,bridge_name='br-int',has_traffic_filtering=True,id=98143be5-d207-4206-a9fb-39bd8b05822e,network=Network(24f0a98a-4787-4d04-a606-bad6281d2fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap98143be5-d2') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:52:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886858126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886858126',id=29,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEInirpvC4T4EdVFVkrmObaHSSQyMUS/rI7EInKwyhK/lVP4Oj5AshO1QG8VPfD8Cs8eUr/uW0SLnoCIQ2vo52oAp/pq83mxnKrpxML5Ej9Ks6sFH7wB/rHNb5zZc9Ogg==',key_name='tempest-keypair-1178417223',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c053965223cd48eab71fe19c2dcb3856',ramdisk_id='',reservation_id='r-xesres5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1604326291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1604326291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:52:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26901807745b4c748dd3358068d07983',uuid=c5b50062-b965-4686-beea-63537d9f1eda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe941d99-e8f6-42bd-939e-d2955caed33d", "address": "fa:16:3e:94:2f:3a", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe941d99-e8", "ovs_interfaceid": "fe941d99-e8f6-42bd-939e-d2955caed33d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converting VIF {"id": "fe941d99-e8f6-42bd-939e-d2955caed33d", "address": "fa:16:3e:94:2f:3a", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe941d99-e8", "ovs_interfaceid": "fe941d99-e8f6-42bd-939e-d2955caed33d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:2f:3a,bridge_name='br-int',has_traffic_filtering=True,id=fe941d99-e8f6-42bd-939e-d2955caed33d,network=Network(24f0a98a-4787-4d04-a606-bad6281d2fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe941d99-e8') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:52:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886858126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886858126',id=29,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEInirpvC4T4EdVFVkrmObaHSSQyMUS/rI7EInKwyhK/lVP4Oj5AshO1QG8VPfD8Cs8eUr/uW0SLnoCIQ2vo52oAp/pq83mxnKrpxML5Ej9Ks6sFH7wB/rHNb5zZc9Ogg==',key_name='tempest-keypair-1178417223',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c053965223cd48eab71fe19c2dcb3856',ramdisk_id='',reservation_id='r-xesres5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1604326291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1604326291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:52:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26901807745b4c748dd3358068d07983',uuid=c5b50062-b965-4686-beea-63537d9f1eda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df356454-4b89-4b15-955c-6d4d41688490", "address": "fa:16:3e:5d:b1:8b", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf356454-4b", "ovs_interfaceid": "df356454-4b89-4b15-955c-6d4d41688490", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converting VIF {"id": "df356454-4b89-4b15-955c-6d4d41688490", "address": "fa:16:3e:5d:b1:8b", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf356454-4b", "ovs_interfaceid": "df356454-4b89-4b15-955c-6d4d41688490", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b1:8b,bridge_name='br-int',has_traffic_filtering=True,id=df356454-4b89-4b15-955c-6d4d41688490,network=Network(24f0a98a-4787-4d04-a606-bad6281d2fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf356454-4b') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:52:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886858126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886858126',id=29,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEInirpvC4T4EdVFVkrmObaHSSQyMUS/rI7EInKwyhK/lVP4Oj5AshO1QG8VPfD8Cs8eUr/uW0SLnoCIQ2vo52oAp/pq83mxnKrpxML5Ej9Ks6sFH7wB/rHNb5zZc9Ogg==',key_name='tempest-keypair-1178417223',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c053965223cd48eab71fe19c2dcb3856',ramdisk_id='',reservation_id='r-xesres5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1604326291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1604326291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:52:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26901807745b4c748dd3358068d07983',uuid=c5b50062-b965-4686-beea-63537d9f1eda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e47393c-8b6c-4008-a802-8a728b3a7a6c", "address": "fa:16:3e:1d:3a:74", "network": {"id": "bc31bf9c-5e34-4a68-91e8-6a79eb2e0cdf", "bridge": "br-int", "label": "tempest-device-tagging-net2-117214369", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e47393c-8b", "ovs_interfaceid": "6e47393c-8b6c-4008-a802-8a728b3a7a6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converting VIF {"id": "6e47393c-8b6c-4008-a802-8a728b3a7a6c", "address": "fa:16:3e:1d:3a:74", "network": {"id": "bc31bf9c-5e34-4a68-91e8-6a79eb2e0cdf", "bridge": "br-int", "label": "tempest-device-tagging-net2-117214369", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e47393c-8b", "ovs_interfaceid": "6e47393c-8b6c-4008-a802-8a728b3a7a6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:3a:74,bridge_name='br-int',has_traffic_filtering=True,id=6e47393c-8b6c-4008-a802-8a728b3a7a6c,network=Network(bc31bf9c-5e34-4a68-91e8-6a79eb2e0cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e47393c-8b') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:52:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886858126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886858126',id=29,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEInirpvC4T4EdVFVkrmObaHSSQyMUS/rI7EInKwyhK/lVP4Oj5AshO1QG8VPfD8Cs8eUr/uW0SLnoCIQ2vo52oAp/pq83mxnKrpxML5Ej9Ks6sFH7wB/rHNb5zZc9Ogg==',key_name='tempest-keypair-1178417223',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c053965223cd48eab71fe19c2dcb3856',ramdisk_id='',reservation_id='r-xesres5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1604326291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1604326291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:52:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26901807745b4c748dd3358068d07983',uuid=c5b50062-b965-4686-beea-63537d9f1eda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fb86964-076c-439e-84fa-7893c15e8871", "address": "fa:16:3e:5b:33:4e", "network": {"id": "bc31bf9c-5e34-4a68-91e8-6a79eb2e0cdf", "bridge": "br-int", "label": "tempest-device-tagging-net2-117214369", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb86964-07", "ovs_interfaceid": "9fb86964-076c-439e-84fa-7893c15e8871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converting VIF {"id": "9fb86964-076c-439e-84fa-7893c15e8871", "address": "fa:16:3e:5b:33:4e", "network": {"id": "bc31bf9c-5e34-4a68-91e8-6a79eb2e0cdf", "bridge": "br-int", "label": "tempest-device-tagging-net2-117214369", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb86964-07", "ovs_interfaceid": "9fb86964-076c-439e-84fa-7893c15e8871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:33:4e,bridge_name='br-int',has_traffic_filtering=True,id=9fb86964-076c-439e-84fa-7893c15e8871,network=Network(bc31bf9c-5e34-4a68-91e8-6a79eb2e0cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb86964-07') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.objects.instance [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Lazy-loading 'pci_devices' on Instance uuid c5b50062-b965-4686-beea-63537d9f1eda {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:53:20 user nova-compute[72444]:   <uuid>c5b50062-b965-4686-beea-63537d9f1eda</uuid>
Aug 03 04:53:20 user nova-compute[72444]:   <name>instance-0000001d</name>
Aug 03 04:53:20 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:53:20 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:53:20 user nova-compute[72444]:   <metadata>
Aug 03 04:53:20 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:53:20 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:53:20 user nova-compute[72444]:       <nova:name>tempest-device-tagging-server-1886858126</nova:name>
Aug 03 04:53:20 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:53:16</nova:creationTime>
Aug 03 04:53:20 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:53:20 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:53:20 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:53:20 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:53:20 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:53:20 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:53:20 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:53:20 user nova-compute[72444]:       <nova:owner>
Aug 03 04:53:20 user nova-compute[72444]:         <nova:user uuid="26901807745b4c748dd3358068d07983">tempest-TaggedBootDevicesTest_v242-1604326291-project-member</nova:user>
Aug 03 04:53:20 user nova-compute[72444]:         <nova:project uuid="c053965223cd48eab71fe19c2dcb3856">tempest-TaggedBootDevicesTest_v242-1604326291</nova:project>
Aug 03 04:53:20 user nova-compute[72444]:       </nova:owner>
Aug 03 04:53:20 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:53:20 user nova-compute[72444]:       <nova:ports>
Aug 03 04:53:20 user nova-compute[72444]:         <nova:port uuid="4015917d-392d-4101-a347-15b1a37dc252">
Aug 03 04:53:20 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 03 04:53:20 user nova-compute[72444]:         </nova:port>
Aug 03 04:53:20 user nova-compute[72444]:         <nova:port uuid="978bd88d-0401-4456-b332-7494cbebe1f2">
Aug 03 04:53:20 user nova-compute[72444]:           <nova:ip type="fixed" address="10.1.1.158" ipVersion="4"/>
Aug 03 04:53:20 user nova-compute[72444]:         </nova:port>
Aug 03 04:53:20 user nova-compute[72444]:         <nova:port uuid="98143be5-d207-4206-a9fb-39bd8b05822e">
Aug 03 04:53:20 user nova-compute[72444]:           <nova:ip type="fixed" address="10.1.1.224" ipVersion="4"/>
Aug 03 04:53:20 user nova-compute[72444]:         </nova:port>
Aug 03 04:53:20 user nova-compute[72444]:         <nova:port uuid="fe941d99-e8f6-42bd-939e-d2955caed33d">
Aug 03 04:53:20 user nova-compute[72444]:           <nova:ip type="fixed" address="10.1.1.68" ipVersion="4"/>
Aug 03 04:53:20 user nova-compute[72444]:         </nova:port>
Aug 03 04:53:20 user nova-compute[72444]:         <nova:port uuid="df356454-4b89-4b15-955c-6d4d41688490">
Aug 03 04:53:20 user nova-compute[72444]:           <nova:ip type="fixed" address="10.1.1.217" ipVersion="4"/>
Aug 03 04:53:20 user nova-compute[72444]:         </nova:port>
Aug 03 04:53:20 user nova-compute[72444]:         <nova:port uuid="6e47393c-8b6c-4008-a802-8a728b3a7a6c">
Aug 03 04:53:20 user nova-compute[72444]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 03 04:53:20 user nova-compute[72444]:         </nova:port>
Aug 03 04:53:20 user nova-compute[72444]:         <nova:port uuid="9fb86964-076c-439e-84fa-7893c15e8871">
Aug 03 04:53:20 user nova-compute[72444]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 03 04:53:20 user nova-compute[72444]:         </nova:port>
Aug 03 04:53:20 user nova-compute[72444]:       </nova:ports>
Aug 03 04:53:20 user nova-compute[72444]:     </nova:instance>
Aug 03 04:53:20 user nova-compute[72444]:   </metadata>
Aug 03 04:53:20 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:53:20 user nova-compute[72444]:     <system>
Aug 03 04:53:20 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:53:20 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:53:20 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:53:20 user nova-compute[72444]:       <entry name="serial">c5b50062-b965-4686-beea-63537d9f1eda</entry>
Aug 03 04:53:20 user nova-compute[72444]:       <entry name="uuid">c5b50062-b965-4686-beea-63537d9f1eda</entry>
Aug 03 04:53:20 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:53:20 user nova-compute[72444]:     </system>
Aug 03 04:53:20 user nova-compute[72444]:   </sysinfo>
Aug 03 04:53:20 user nova-compute[72444]:   <os>
Aug 03 04:53:20 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:53:20 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:53:20 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:53:20 user nova-compute[72444]:   </os>
Aug 03 04:53:20 user nova-compute[72444]:   <features>
Aug 03 04:53:20 user nova-compute[72444]:     <acpi/>
Aug 03 04:53:20 user nova-compute[72444]:     <apic/>
Aug 03 04:53:20 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:53:20 user nova-compute[72444]:   </features>
Aug 03 04:53:20 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:53:20 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:53:20 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:53:20 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:53:20 user nova-compute[72444]:   </clock>
Aug 03 04:53:20 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:53:20 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:53:20 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:53:20 user nova-compute[72444]:   </cpu>
Aug 03 04:53:20 user nova-compute[72444]:   <devices>
Aug 03 04:53:20 user nova-compute[72444]:     <disk type="file" device="cdrom">
Aug 03 04:53:20 user nova-compute[72444]:       <driver name="qemu" type="raw" cache="none"/>
Aug 03 04:53:20 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/c5b50062-b965-4686-beea-63537d9f1eda/disk.config"/>
Aug 03 04:53:20 user nova-compute[72444]:       <target dev="hda" bus="ide"/>
Aug 03 04:53:20 user nova-compute[72444]:     </disk>
Aug 03 04:53:20 user nova-compute[72444]:     <disk type="block" device="disk">
Aug 03 04:53:20 user nova-compute[72444]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:53:20 user nova-compute[72444]:       <source dev="/dev/sdc"/>
Aug 03 04:53:20 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:53:20 user nova-compute[72444]:       <serial>d99161a6-916a-44e5-8815-0f0df9d29727</serial>
Aug 03 04:53:20 user nova-compute[72444]:     </disk>
Aug 03 04:53:20 user nova-compute[72444]:     <disk type="block" device="disk">
Aug 03 04:53:20 user nova-compute[72444]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:53:20 user nova-compute[72444]:       <source dev="/dev/sdg"/>
Aug 03 04:53:20 user nova-compute[72444]:       <target dev="vdb" bus="virtio"/>
Aug 03 04:53:20 user nova-compute[72444]:       <serial>3b58f424-a14b-4c41-8991-fa4fa11d7e55</serial>
Aug 03 04:53:20 user nova-compute[72444]:     </disk>
Aug 03 04:53:20 user nova-compute[72444]:     <disk type="block" device="disk">
Aug 03 04:53:20 user nova-compute[72444]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:53:20 user nova-compute[72444]:       <source dev="/dev/sdh"/>
Aug 03 04:53:20 user nova-compute[72444]:       <target dev="vdc" bus="virtio"/>
Aug 03 04:53:20 user nova-compute[72444]:       <serial>80ba9030-fb28-4918-a99c-7e333a003853</serial>
Aug 03 04:53:20 user nova-compute[72444]:     </disk>
Aug 03 04:53:20 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:53:20 user nova-compute[72444]:       <mac address="fa:16:3e:2f:8b:e3"/>
Aug 03 04:53:20 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:53:20 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:53:20 user nova-compute[72444]:       <target dev="tap4015917d-39"/>
Aug 03 04:53:20 user nova-compute[72444]:     </interface>
Aug 03 04:53:20 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:53:20 user nova-compute[72444]:       <mac address="fa:16:3e:66:09:aa"/>
Aug 03 04:53:20 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:53:20 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:53:20 user nova-compute[72444]:       <target dev="tap978bd88d-04"/>
Aug 03 04:53:20 user nova-compute[72444]:     </interface>
Aug 03 04:53:20 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:53:20 user nova-compute[72444]:       <mac address="fa:16:3e:68:a8:5f"/>
Aug 03 04:53:20 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:53:20 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:53:20 user nova-compute[72444]:       <target dev="tap98143be5-d2"/>
Aug 03 04:53:20 user nova-compute[72444]:     </interface>
Aug 03 04:53:20 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:53:20 user nova-compute[72444]:       <mac address="fa:16:3e:94:2f:3a"/>
Aug 03 04:53:20 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:53:20 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:53:20 user nova-compute[72444]:       <target dev="tapfe941d99-e8"/>
Aug 03 04:53:20 user nova-compute[72444]:     </interface>
Aug 03 04:53:20 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:53:20 user nova-compute[72444]:       <mac address="fa:16:3e:5d:b1:8b"/>
Aug 03 04:53:20 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:53:20 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:53:20 user nova-compute[72444]:       <target dev="tapdf356454-4b"/>
Aug 03 04:53:20 user nova-compute[72444]:     </interface>
Aug 03 04:53:20 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:53:20 user nova-compute[72444]:       <mac address="fa:16:3e:1d:3a:74"/>
Aug 03 04:53:20 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:53:20 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:53:20 user nova-compute[72444]:       <target dev="tap6e47393c-8b"/>
Aug 03 04:53:20 user nova-compute[72444]:     </interface>
Aug 03 04:53:20 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:53:20 user nova-compute[72444]:       <mac address="fa:16:3e:5b:33:4e"/>
Aug 03 04:53:20 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:53:20 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:53:20 user nova-compute[72444]:       <target dev="tap9fb86964-07"/>
Aug 03 04:53:20 user nova-compute[72444]:     </interface>
Aug 03 04:53:20 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:53:20 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/c5b50062-b965-4686-beea-63537d9f1eda/console.log" append="off"/>
Aug 03 04:53:20 user nova-compute[72444]:     </serial>
Aug 03 04:53:20 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:53:20 user nova-compute[72444]:     <video>
Aug 03 04:53:20 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:53:20 user nova-compute[72444]:     </video>
Aug 03 04:53:20 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:53:20 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:53:20 user nova-compute[72444]:     </rng>
Aug 03 04:53:20 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:53:20 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:53:20 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:53:20 user nova-compute[72444]:     </memballoon>
Aug 03 04:53:20 user nova-compute[72444]:   </devices>
Aug 03 04:53:20 user nova-compute[72444]: </domain>
Aug 03 04:53:20 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:52:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886858126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886858126',id=29,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEInirpvC4T4EdVFVkrmObaHSSQyMUS/rI7EInKwyhK/lVP4Oj5AshO1QG8VPfD8Cs8eUr/uW0SLnoCIQ2vo52oAp/pq83mxnKrpxML5Ej9Ks6sFH7wB/rHNb5zZc9Ogg==',key_name='tempest-keypair-1178417223',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c053965223cd48eab71fe19c2dcb3856',ramdisk_id='',reservation_id='r-xesres5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1604326291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1604326291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:52:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26901807745b4c748dd3358068d07983',uuid=c5b50062-b965-4686-beea-63537d9f1eda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4015917d-392d-4101-a347-15b1a37dc252", "address": "fa:16:3e:2f:8b:e3", "network": {"id": "0dfdee8f-99ee-4369-af46-a2f1d097cf8c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-316229813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4015917d-39", "ovs_interfaceid": "4015917d-392d-4101-a347-15b1a37dc252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converting VIF {"id": "4015917d-392d-4101-a347-15b1a37dc252", "address": "fa:16:3e:2f:8b:e3", "network": {"id": "0dfdee8f-99ee-4369-af46-a2f1d097cf8c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-316229813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4015917d-39", "ovs_interfaceid": "4015917d-392d-4101-a347-15b1a37dc252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:8b:e3,bridge_name='br-int',has_traffic_filtering=True,id=4015917d-392d-4101-a347-15b1a37dc252,network=Network(0dfdee8f-99ee-4369-af46-a2f1d097cf8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4015917d-39') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG os_vif [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:8b:e3,bridge_name='br-int',has_traffic_filtering=True,id=4015917d-392d-4101-a347-15b1a37dc252,network=Network(0dfdee8f-99ee-4369-af46-a2f1d097cf8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4015917d-39') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:53:20 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038400.5376036, c77e96da-6411-4ae9-af05-8e9bb3c432c6 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:53:20 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] VM Started (Lifecycle Event)
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4015917d-39, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4015917d-39, col_values=(('external_ids', {'iface-id': '4015917d-392d-4101-a347-15b1a37dc252', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:8b:e3', 'vm-uuid': 'c5b50062-b965-4686-beea-63537d9f1eda'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:20 user nova-compute[72444]: INFO os_vif [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:8b:e3,bridge_name='br-int',has_traffic_filtering=True,id=4015917d-392d-4101-a347-15b1a37dc252,network=Network(0dfdee8f-99ee-4369-af46-a2f1d097cf8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4015917d-39')
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:52:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886858126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886858126',id=29,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEInirpvC4T4EdVFVkrmObaHSSQyMUS/rI7EInKwyhK/lVP4Oj5AshO1QG8VPfD8Cs8eUr/uW0SLnoCIQ2vo52oAp/pq83mxnKrpxML5Ej9Ks6sFH7wB/rHNb5zZc9Ogg==',key_name='tempest-keypair-1178417223',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c053965223cd48eab71fe19c2dcb3856',ramdisk_id='',reservation_id='r-xesres5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1604326291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1604326291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:52:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26901807745b4c748dd3358068d07983',uuid=c5b50062-b965-4686-beea-63537d9f1eda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "978bd88d-0401-4456-b332-7494cbebe1f2", "address": "fa:16:3e:66:09:aa", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap978bd88d-04", "ovs_interfaceid": "978bd88d-0401-4456-b332-7494cbebe1f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converting VIF {"id": "978bd88d-0401-4456-b332-7494cbebe1f2", "address": "fa:16:3e:66:09:aa", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap978bd88d-04", "ovs_interfaceid": "978bd88d-0401-4456-b332-7494cbebe1f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:09:aa,bridge_name='br-int',has_traffic_filtering=True,id=978bd88d-0401-4456-b332-7494cbebe1f2,network=Network(24f0a98a-4787-4d04-a606-bad6281d2fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap978bd88d-04') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG os_vif [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:09:aa,bridge_name='br-int',has_traffic_filtering=True,id=978bd88d-0401-4456-b332-7494cbebe1f2,network=Network(24f0a98a-4787-4d04-a606-bad6281d2fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap978bd88d-04') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap978bd88d-04, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap978bd88d-04, col_values=(('external_ids', {'iface-id': '978bd88d-0401-4456-b332-7494cbebe1f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:09:aa', 'vm-uuid': 'c5b50062-b965-4686-beea-63537d9f1eda'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:20 user nova-compute[72444]: INFO os_vif [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:09:aa,bridge_name='br-int',has_traffic_filtering=True,id=978bd88d-0401-4456-b332-7494cbebe1f2,network=Network(24f0a98a-4787-4d04-a606-bad6281d2fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap978bd88d-04')
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:52:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886858126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886858126',id=29,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEInirpvC4T4EdVFVkrmObaHSSQyMUS/rI7EInKwyhK/lVP4Oj5AshO1QG8VPfD8Cs8eUr/uW0SLnoCIQ2vo52oAp/pq83mxnKrpxML5Ej9Ks6sFH7wB/rHNb5zZc9Ogg==',key_name='tempest-keypair-1178417223',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c053965223cd48eab71fe19c2dcb3856',ramdisk_id='',reservation_id='r-xesres5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1604326291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1604326291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:52:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26901807745b4c748dd3358068d07983',uuid=c5b50062-b965-4686-beea-63537d9f1eda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98143be5-d207-4206-a9fb-39bd8b05822e", "address": "fa:16:3e:68:a8:5f", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98143be5-d2", "ovs_interfaceid": "98143be5-d207-4206-a9fb-39bd8b05822e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converting VIF {"id": "98143be5-d207-4206-a9fb-39bd8b05822e", "address": "fa:16:3e:68:a8:5f", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98143be5-d2", "ovs_interfaceid": "98143be5-d207-4206-a9fb-39bd8b05822e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:a8:5f,bridge_name='br-int',has_traffic_filtering=True,id=98143be5-d207-4206-a9fb-39bd8b05822e,network=Network(24f0a98a-4787-4d04-a606-bad6281d2fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap98143be5-d2') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG os_vif [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:a8:5f,bridge_name='br-int',has_traffic_filtering=True,id=98143be5-d207-4206-a9fb-39bd8b05822e,network=Network(24f0a98a-4787-4d04-a606-bad6281d2fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap98143be5-d2') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.compute.manager [req-8a98649b-b7f0-4d12-8378-a98d8d23558a req-d86f9dc1-33fa-476b-a421-0cdd7973d9b7 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Received event network-vif-plugged-90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8a98649b-b7f0-4d12-8378-a98d8d23558a req-d86f9dc1-33fa-476b-a421-0cdd7973d9b7 service nova] Acquiring lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8a98649b-b7f0-4d12-8378-a98d8d23558a req-d86f9dc1-33fa-476b-a421-0cdd7973d9b7 service nova] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8a98649b-b7f0-4d12-8378-a98d8d23558a req-d86f9dc1-33fa-476b-a421-0cdd7973d9b7 service nova] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.compute.manager [req-8a98649b-b7f0-4d12-8378-a98d8d23558a req-d86f9dc1-33fa-476b-a421-0cdd7973d9b7 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] No waiting events found dispatching network-vif-plugged-90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:53:20 user nova-compute[72444]: WARNING nova.compute.manager [req-8a98649b-b7f0-4d12-8378-a98d8d23558a req-d86f9dc1-33fa-476b-a421-0cdd7973d9b7 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Received unexpected event network-vif-plugged-90104ef6-fe9b-4347-8df6-934a276e077b for instance with vm_state active and task_state None.
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98143be5-d2, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap98143be5-d2, col_values=(('external_ids', {'iface-id': '98143be5-d207-4206-a9fb-39bd8b05822e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:a8:5f', 'vm-uuid': 'c5b50062-b965-4686-beea-63537d9f1eda'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:20 user nova-compute[72444]: INFO os_vif [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:a8:5f,bridge_name='br-int',has_traffic_filtering=True,id=98143be5-d207-4206-a9fb-39bd8b05822e,network=Network(24f0a98a-4787-4d04-a606-bad6281d2fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap98143be5-d2')
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:52:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886858126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886858126',id=29,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEInirpvC4T4EdVFVkrmObaHSSQyMUS/rI7EInKwyhK/lVP4Oj5AshO1QG8VPfD8Cs8eUr/uW0SLnoCIQ2vo52oAp/pq83mxnKrpxML5Ej9Ks6sFH7wB/rHNb5zZc9Ogg==',key_name='tempest-keypair-1178417223',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c053965223cd48eab71fe19c2dcb3856',ramdisk_id='',reservation_id='r-xesres5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1604326291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1604326291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:52:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26901807745b4c748dd3358068d07983',uuid=c5b50062-b965-4686-beea-63537d9f1eda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe941d99-e8f6-42bd-939e-d2955caed33d", "address": "fa:16:3e:94:2f:3a", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe941d99-e8", "ovs_interfaceid": "fe941d99-e8f6-42bd-939e-d2955caed33d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converting VIF {"id": "fe941d99-e8f6-42bd-939e-d2955caed33d", "address": "fa:16:3e:94:2f:3a", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe941d99-e8", "ovs_interfaceid": "fe941d99-e8f6-42bd-939e-d2955caed33d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:2f:3a,bridge_name='br-int',has_traffic_filtering=True,id=fe941d99-e8f6-42bd-939e-d2955caed33d,network=Network(24f0a98a-4787-4d04-a606-bad6281d2fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe941d99-e8') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG os_vif [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:2f:3a,bridge_name='br-int',has_traffic_filtering=True,id=fe941d99-e8f6-42bd-939e-d2955caed33d,network=Network(24f0a98a-4787-4d04-a606-bad6281d2fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe941d99-e8') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe941d99-e8, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfe941d99-e8, col_values=(('external_ids', {'iface-id': 'fe941d99-e8f6-42bd-939e-d2955caed33d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:2f:3a', 'vm-uuid': 'c5b50062-b965-4686-beea-63537d9f1eda'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:20 user nova-compute[72444]: INFO os_vif [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:2f:3a,bridge_name='br-int',has_traffic_filtering=True,id=fe941d99-e8f6-42bd-939e-d2955caed33d,network=Network(24f0a98a-4787-4d04-a606-bad6281d2fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe941d99-e8')
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:52:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886858126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886858126',id=29,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEInirpvC4T4EdVFVkrmObaHSSQyMUS/rI7EInKwyhK/lVP4Oj5AshO1QG8VPfD8Cs8eUr/uW0SLnoCIQ2vo52oAp/pq83mxnKrpxML5Ej9Ks6sFH7wB/rHNb5zZc9Ogg==',key_name='tempest-keypair-1178417223',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c053965223cd48eab71fe19c2dcb3856',ramdisk_id='',reservation_id='r-xesres5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1604326291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1604326291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:52:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26901807745b4c748dd3358068d07983',uuid=c5b50062-b965-4686-beea-63537d9f1eda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df356454-4b89-4b15-955c-6d4d41688490", "address": "fa:16:3e:5d:b1:8b", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf356454-4b", "ovs_interfaceid": "df356454-4b89-4b15-955c-6d4d41688490", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converting VIF {"id": "df356454-4b89-4b15-955c-6d4d41688490", "address": "fa:16:3e:5d:b1:8b", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf356454-4b", "ovs_interfaceid": "df356454-4b89-4b15-955c-6d4d41688490", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b1:8b,bridge_name='br-int',has_traffic_filtering=True,id=df356454-4b89-4b15-955c-6d4d41688490,network=Network(24f0a98a-4787-4d04-a606-bad6281d2fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf356454-4b') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG os_vif [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b1:8b,bridge_name='br-int',has_traffic_filtering=True,id=df356454-4b89-4b15-955c-6d4d41688490,network=Network(24f0a98a-4787-4d04-a606-bad6281d2fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf356454-4b') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf356454-4b, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdf356454-4b, col_values=(('external_ids', {'iface-id': 'df356454-4b89-4b15-955c-6d4d41688490', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:b1:8b', 'vm-uuid': 'c5b50062-b965-4686-beea-63537d9f1eda'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:20 user nova-compute[72444]: INFO os_vif [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b1:8b,bridge_name='br-int',has_traffic_filtering=True,id=df356454-4b89-4b15-955c-6d4d41688490,network=Network(24f0a98a-4787-4d04-a606-bad6281d2fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf356454-4b')
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:52:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886858126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886858126',id=29,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEInirpvC4T4EdVFVkrmObaHSSQyMUS/rI7EInKwyhK/lVP4Oj5AshO1QG8VPfD8Cs8eUr/uW0SLnoCIQ2vo52oAp/pq83mxnKrpxML5Ej9Ks6sFH7wB/rHNb5zZc9Ogg==',key_name='tempest-keypair-1178417223',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c053965223cd48eab71fe19c2dcb3856',ramdisk_id='',reservation_id='r-xesres5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1604326291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1604326291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:52:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26901807745b4c748dd3358068d07983',uuid=c5b50062-b965-4686-beea-63537d9f1eda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e47393c-8b6c-4008-a802-8a728b3a7a6c", "address": "fa:16:3e:1d:3a:74", "network": {"id": "bc31bf9c-5e34-4a68-91e8-6a79eb2e0cdf", "bridge": "br-int", "label": "tempest-device-tagging-net2-117214369", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e47393c-8b", "ovs_interfaceid": "6e47393c-8b6c-4008-a802-8a728b3a7a6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converting VIF {"id": "6e47393c-8b6c-4008-a802-8a728b3a7a6c", "address": "fa:16:3e:1d:3a:74", "network": {"id": "bc31bf9c-5e34-4a68-91e8-6a79eb2e0cdf", "bridge": "br-int", "label": "tempest-device-tagging-net2-117214369", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e47393c-8b", "ovs_interfaceid": "6e47393c-8b6c-4008-a802-8a728b3a7a6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:3a:74,bridge_name='br-int',has_traffic_filtering=True,id=6e47393c-8b6c-4008-a802-8a728b3a7a6c,network=Network(bc31bf9c-5e34-4a68-91e8-6a79eb2e0cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e47393c-8b') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG os_vif [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:3a:74,bridge_name='br-int',has_traffic_filtering=True,id=6e47393c-8b6c-4008-a802-8a728b3a7a6c,network=Network(bc31bf9c-5e34-4a68-91e8-6a79eb2e0cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e47393c-8b') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e47393c-8b, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6e47393c-8b, col_values=(('external_ids', {'iface-id': '6e47393c-8b6c-4008-a802-8a728b3a7a6c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:3a:74', 'vm-uuid': 'c5b50062-b965-4686-beea-63537d9f1eda'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:20 user nova-compute[72444]: INFO os_vif [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:3a:74,bridge_name='br-int',has_traffic_filtering=True,id=6e47393c-8b6c-4008-a802-8a728b3a7a6c,network=Network(bc31bf9c-5e34-4a68-91e8-6a79eb2e0cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e47393c-8b')
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:52:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886858126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886858126',id=29,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEInirpvC4T4EdVFVkrmObaHSSQyMUS/rI7EInKwyhK/lVP4Oj5AshO1QG8VPfD8Cs8eUr/uW0SLnoCIQ2vo52oAp/pq83mxnKrpxML5Ej9Ks6sFH7wB/rHNb5zZc9Ogg==',key_name='tempest-keypair-1178417223',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c053965223cd48eab71fe19c2dcb3856',ramdisk_id='',reservation_id='r-xesres5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1604326291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1604326291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:52:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26901807745b4c748dd3358068d07983',uuid=c5b50062-b965-4686-beea-63537d9f1eda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fb86964-076c-439e-84fa-7893c15e8871", "address": "fa:16:3e:5b:33:4e", "network": {"id": "bc31bf9c-5e34-4a68-91e8-6a79eb2e0cdf", "bridge": "br-int", "label": "tempest-device-tagging-net2-117214369", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb86964-07", "ovs_interfaceid": "9fb86964-076c-439e-84fa-7893c15e8871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converting VIF {"id": "9fb86964-076c-439e-84fa-7893c15e8871", "address": "fa:16:3e:5b:33:4e", "network": {"id": "bc31bf9c-5e34-4a68-91e8-6a79eb2e0cdf", "bridge": "br-int", "label": "tempest-device-tagging-net2-117214369", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb86964-07", "ovs_interfaceid": "9fb86964-076c-439e-84fa-7893c15e8871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:33:4e,bridge_name='br-int',has_traffic_filtering=True,id=9fb86964-076c-439e-84fa-7893c15e8871,network=Network(bc31bf9c-5e34-4a68-91e8-6a79eb2e0cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb86964-07') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG os_vif [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:33:4e,bridge_name='br-int',has_traffic_filtering=True,id=9fb86964-076c-439e-84fa-7893c15e8871,network=Network(bc31bf9c-5e34-4a68-91e8-6a79eb2e0cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb86964-07') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9fb86964-07, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9fb86964-07, col_values=(('external_ids', {'iface-id': '9fb86964-076c-439e-84fa-7893c15e8871', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:33:4e', 'vm-uuid': 'c5b50062-b965-4686-beea-63537d9f1eda'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:53:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:20 user nova-compute[72444]: INFO os_vif [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:33:4e,bridge_name='br-int',has_traffic_filtering=True,id=9fb86964-076c-439e-84fa-7893c15e8871,network=Network(bc31bf9c-5e34-4a68-91e8-6a79eb2e0cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb86964-07')
Aug 03 04:53:21 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] No BDM found with device name hda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:53:21 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:53:21 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] No VIF found with MAC fa:16:3e:2f:8b:e3, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:53:21 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] No VIF found with MAC fa:16:3e:5d:b1:8b, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:53:21 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Using config drive
Aug 03 04:53:21 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Creating config drive at /opt/stack/data/nova/instances/c5b50062-b965-4686-beea-63537d9f1eda/disk.config
Aug 03 04:53:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c5b50062-b965-4686-beea-63537d9f1eda/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpx_7p4d_z {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c5b50062-b965-4686-beea-63537d9f1eda/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpx_7p4d_z" returned: 0 in 0.067s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:22 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:22 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:22 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:22 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:23 user nova-compute[72444]: DEBUG nova.compute.manager [req-f5e8fbdf-a286-4533-bec0-965e56426e2f req-d4ed6e8d-6def-4eba-ba9a-f113749e424b service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-plugged-4015917d-392d-4101-a347-15b1a37dc252 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:53:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f5e8fbdf-a286-4533-bec0-965e56426e2f req-d4ed6e8d-6def-4eba-ba9a-f113749e424b service nova] Acquiring lock "c5b50062-b965-4686-beea-63537d9f1eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:53:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f5e8fbdf-a286-4533-bec0-965e56426e2f req-d4ed6e8d-6def-4eba-ba9a-f113749e424b service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:53:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f5e8fbdf-a286-4533-bec0-965e56426e2f req-d4ed6e8d-6def-4eba-ba9a-f113749e424b service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:53:23 user nova-compute[72444]: DEBUG nova.compute.manager [req-f5e8fbdf-a286-4533-bec0-965e56426e2f req-d4ed6e8d-6def-4eba-ba9a-f113749e424b service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] No waiting events found dispatching network-vif-plugged-4015917d-392d-4101-a347-15b1a37dc252 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:53:23 user nova-compute[72444]: WARNING nova.compute.manager [req-f5e8fbdf-a286-4533-bec0-965e56426e2f req-d4ed6e8d-6def-4eba-ba9a-f113749e424b service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received unexpected event network-vif-plugged-4015917d-392d-4101-a347-15b1a37dc252 for instance with vm_state building and task_state spawning.
Aug 03 04:53:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:24 user nova-compute[72444]: DEBUG nova.compute.manager [req-2de55d90-a540-460c-96ed-9888f43671a4 req-c88b4a14-f06d-42c4-a677-ce0f79d7f825 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-plugged-978bd88d-0401-4456-b332-7494cbebe1f2 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:53:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2de55d90-a540-460c-96ed-9888f43671a4 req-c88b4a14-f06d-42c4-a677-ce0f79d7f825 service nova] Acquiring lock "c5b50062-b965-4686-beea-63537d9f1eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:53:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2de55d90-a540-460c-96ed-9888f43671a4 req-c88b4a14-f06d-42c4-a677-ce0f79d7f825 service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:53:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2de55d90-a540-460c-96ed-9888f43671a4 req-c88b4a14-f06d-42c4-a677-ce0f79d7f825 service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:53:24 user nova-compute[72444]: DEBUG nova.compute.manager [req-2de55d90-a540-460c-96ed-9888f43671a4 req-c88b4a14-f06d-42c4-a677-ce0f79d7f825 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] No waiting events found dispatching network-vif-plugged-978bd88d-0401-4456-b332-7494cbebe1f2 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:53:24 user nova-compute[72444]: WARNING nova.compute.manager [req-2de55d90-a540-460c-96ed-9888f43671a4 req-c88b4a14-f06d-42c4-a677-ce0f79d7f825 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received unexpected event network-vif-plugged-978bd88d-0401-4456-b332-7494cbebe1f2 for instance with vm_state building and task_state spawning.
Aug 03 04:53:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:25 user nova-compute[72444]: DEBUG nova.compute.manager [req-9bf7f06c-4187-4dce-b06d-9a8328a8031c req-00cc562f-ac15-4983-9d63-91ad27ec9ddd service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-plugged-4015917d-392d-4101-a347-15b1a37dc252 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:53:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9bf7f06c-4187-4dce-b06d-9a8328a8031c req-00cc562f-ac15-4983-9d63-91ad27ec9ddd service nova] Acquiring lock "c5b50062-b965-4686-beea-63537d9f1eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:53:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9bf7f06c-4187-4dce-b06d-9a8328a8031c req-00cc562f-ac15-4983-9d63-91ad27ec9ddd service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:53:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9bf7f06c-4187-4dce-b06d-9a8328a8031c req-00cc562f-ac15-4983-9d63-91ad27ec9ddd service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:53:25 user nova-compute[72444]: DEBUG nova.compute.manager [req-9bf7f06c-4187-4dce-b06d-9a8328a8031c req-00cc562f-ac15-4983-9d63-91ad27ec9ddd service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] No waiting events found dispatching network-vif-plugged-4015917d-392d-4101-a347-15b1a37dc252 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:53:25 user nova-compute[72444]: WARNING nova.compute.manager [req-9bf7f06c-4187-4dce-b06d-9a8328a8031c req-00cc562f-ac15-4983-9d63-91ad27ec9ddd service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received unexpected event network-vif-plugged-4015917d-392d-4101-a347-15b1a37dc252 for instance with vm_state building and task_state spawning.
Aug 03 04:53:25 user nova-compute[72444]: DEBUG nova.compute.manager [req-9bf7f06c-4187-4dce-b06d-9a8328a8031c req-00cc562f-ac15-4983-9d63-91ad27ec9ddd service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-plugged-98143be5-d207-4206-a9fb-39bd8b05822e {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:53:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9bf7f06c-4187-4dce-b06d-9a8328a8031c req-00cc562f-ac15-4983-9d63-91ad27ec9ddd service nova] Acquiring lock "c5b50062-b965-4686-beea-63537d9f1eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:53:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9bf7f06c-4187-4dce-b06d-9a8328a8031c req-00cc562f-ac15-4983-9d63-91ad27ec9ddd service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:53:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9bf7f06c-4187-4dce-b06d-9a8328a8031c req-00cc562f-ac15-4983-9d63-91ad27ec9ddd service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:53:25 user nova-compute[72444]: DEBUG nova.compute.manager [req-9bf7f06c-4187-4dce-b06d-9a8328a8031c req-00cc562f-ac15-4983-9d63-91ad27ec9ddd service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] No waiting events found dispatching network-vif-plugged-98143be5-d207-4206-a9fb-39bd8b05822e {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:53:25 user nova-compute[72444]: WARNING nova.compute.manager [req-9bf7f06c-4187-4dce-b06d-9a8328a8031c req-00cc562f-ac15-4983-9d63-91ad27ec9ddd service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received unexpected event network-vif-plugged-98143be5-d207-4206-a9fb-39bd8b05822e for instance with vm_state building and task_state spawning.
Aug 03 04:53:25 user nova-compute[72444]: DEBUG nova.compute.manager [req-9bf7f06c-4187-4dce-b06d-9a8328a8031c req-00cc562f-ac15-4983-9d63-91ad27ec9ddd service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-plugged-98143be5-d207-4206-a9fb-39bd8b05822e {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:53:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9bf7f06c-4187-4dce-b06d-9a8328a8031c req-00cc562f-ac15-4983-9d63-91ad27ec9ddd service nova] Acquiring lock "c5b50062-b965-4686-beea-63537d9f1eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:53:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9bf7f06c-4187-4dce-b06d-9a8328a8031c req-00cc562f-ac15-4983-9d63-91ad27ec9ddd service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:53:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9bf7f06c-4187-4dce-b06d-9a8328a8031c req-00cc562f-ac15-4983-9d63-91ad27ec9ddd service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:53:25 user nova-compute[72444]: DEBUG nova.compute.manager [req-9bf7f06c-4187-4dce-b06d-9a8328a8031c req-00cc562f-ac15-4983-9d63-91ad27ec9ddd service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] No waiting events found dispatching network-vif-plugged-98143be5-d207-4206-a9fb-39bd8b05822e {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:53:25 user nova-compute[72444]: WARNING nova.compute.manager [req-9bf7f06c-4187-4dce-b06d-9a8328a8031c req-00cc562f-ac15-4983-9d63-91ad27ec9ddd service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received unexpected event network-vif-plugged-98143be5-d207-4206-a9fb-39bd8b05822e for instance with vm_state building and task_state spawning.
Aug 03 04:53:25 user nova-compute[72444]: DEBUG nova.compute.manager [req-9bf7f06c-4187-4dce-b06d-9a8328a8031c req-00cc562f-ac15-4983-9d63-91ad27ec9ddd service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-plugged-df356454-4b89-4b15-955c-6d4d41688490 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:53:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9bf7f06c-4187-4dce-b06d-9a8328a8031c req-00cc562f-ac15-4983-9d63-91ad27ec9ddd service nova] Acquiring lock "c5b50062-b965-4686-beea-63537d9f1eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:53:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9bf7f06c-4187-4dce-b06d-9a8328a8031c req-00cc562f-ac15-4983-9d63-91ad27ec9ddd service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:53:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9bf7f06c-4187-4dce-b06d-9a8328a8031c req-00cc562f-ac15-4983-9d63-91ad27ec9ddd service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:53:25 user nova-compute[72444]: DEBUG nova.compute.manager [req-9bf7f06c-4187-4dce-b06d-9a8328a8031c req-00cc562f-ac15-4983-9d63-91ad27ec9ddd service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] No waiting events found dispatching network-vif-plugged-df356454-4b89-4b15-955c-6d4d41688490 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:53:25 user nova-compute[72444]: WARNING nova.compute.manager [req-9bf7f06c-4187-4dce-b06d-9a8328a8031c req-00cc562f-ac15-4983-9d63-91ad27ec9ddd service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received unexpected event network-vif-plugged-df356454-4b89-4b15-955c-6d4d41688490 for instance with vm_state building and task_state spawning.
Aug 03 04:53:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:26 user nova-compute[72444]: DEBUG nova.compute.manager [req-2f7a5678-641a-4f01-bb01-07da10564f9d req-f080eb25-b9a7-4b5f-b349-adcc5005ca3b service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-plugged-978bd88d-0401-4456-b332-7494cbebe1f2 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:53:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2f7a5678-641a-4f01-bb01-07da10564f9d req-f080eb25-b9a7-4b5f-b349-adcc5005ca3b service nova] Acquiring lock "c5b50062-b965-4686-beea-63537d9f1eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:53:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2f7a5678-641a-4f01-bb01-07da10564f9d req-f080eb25-b9a7-4b5f-b349-adcc5005ca3b service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:53:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2f7a5678-641a-4f01-bb01-07da10564f9d req-f080eb25-b9a7-4b5f-b349-adcc5005ca3b service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:53:26 user nova-compute[72444]: DEBUG nova.compute.manager [req-2f7a5678-641a-4f01-bb01-07da10564f9d req-f080eb25-b9a7-4b5f-b349-adcc5005ca3b service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] No waiting events found dispatching network-vif-plugged-978bd88d-0401-4456-b332-7494cbebe1f2 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:53:26 user nova-compute[72444]: WARNING nova.compute.manager [req-2f7a5678-641a-4f01-bb01-07da10564f9d req-f080eb25-b9a7-4b5f-b349-adcc5005ca3b service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received unexpected event network-vif-plugged-978bd88d-0401-4456-b332-7494cbebe1f2 for instance with vm_state building and task_state spawning.
Aug 03 04:53:26 user nova-compute[72444]: DEBUG nova.compute.manager [req-2f7a5678-641a-4f01-bb01-07da10564f9d req-f080eb25-b9a7-4b5f-b349-adcc5005ca3b service nova] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Received event network-changed-62f68bc6-6c23-4a77-9000-46670e8312fa {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:53:26 user nova-compute[72444]: DEBUG nova.compute.manager [req-2f7a5678-641a-4f01-bb01-07da10564f9d req-f080eb25-b9a7-4b5f-b349-adcc5005ca3b service nova] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Refreshing instance network info cache due to event network-changed-62f68bc6-6c23-4a77-9000-46670e8312fa. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:53:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2f7a5678-641a-4f01-bb01-07da10564f9d req-f080eb25-b9a7-4b5f-b349-adcc5005ca3b service nova] Acquiring lock "refresh_cache-0214a998-5624-46f9-801e-c582b4a297e5" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:53:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2f7a5678-641a-4f01-bb01-07da10564f9d req-f080eb25-b9a7-4b5f-b349-adcc5005ca3b service nova] Acquired lock "refresh_cache-0214a998-5624-46f9-801e-c582b4a297e5" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:53:26 user nova-compute[72444]: DEBUG nova.network.neutron [req-2f7a5678-641a-4f01-bb01-07da10564f9d req-f080eb25-b9a7-4b5f-b349-adcc5005ca3b service nova] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Refreshing network info cache for port 62f68bc6-6c23-4a77-9000-46670e8312fa {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:53:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG nova.network.neutron [req-2f7a5678-641a-4f01-bb01-07da10564f9d req-f080eb25-b9a7-4b5f-b349-adcc5005ca3b service nova] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Updated VIF entry in instance network info cache for port 62f68bc6-6c23-4a77-9000-46670e8312fa. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG nova.network.neutron [req-2f7a5678-641a-4f01-bb01-07da10564f9d req-f080eb25-b9a7-4b5f-b349-adcc5005ca3b service nova] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Updating instance_info_cache with network_info: [{"id": "62f68bc6-6c23-4a77-9000-46670e8312fa", "address": "fa:16:3e:54:97:0f", "network": {"id": "628fbd1c-7104-4911-9eb9-1f38c394bebd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-366258398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a65efd00e0ac4039bf1d6429787b8595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f68bc6-6c", "ovs_interfaceid": "62f68bc6-6c23-4a77-9000-46670e8312fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2f7a5678-641a-4f01-bb01-07da10564f9d req-f080eb25-b9a7-4b5f-b349-adcc5005ca3b service nova] Releasing lock "refresh_cache-0214a998-5624-46f9-801e-c582b4a297e5" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG nova.compute.manager [req-2f7a5678-641a-4f01-bb01-07da10564f9d req-f080eb25-b9a7-4b5f-b349-adcc5005ca3b service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-plugged-fe941d99-e8f6-42bd-939e-d2955caed33d {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2f7a5678-641a-4f01-bb01-07da10564f9d req-f080eb25-b9a7-4b5f-b349-adcc5005ca3b service nova] Acquiring lock "c5b50062-b965-4686-beea-63537d9f1eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2f7a5678-641a-4f01-bb01-07da10564f9d req-f080eb25-b9a7-4b5f-b349-adcc5005ca3b service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2f7a5678-641a-4f01-bb01-07da10564f9d req-f080eb25-b9a7-4b5f-b349-adcc5005ca3b service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG nova.compute.manager [req-2f7a5678-641a-4f01-bb01-07da10564f9d req-f080eb25-b9a7-4b5f-b349-adcc5005ca3b service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] No waiting events found dispatching network-vif-plugged-fe941d99-e8f6-42bd-939e-d2955caed33d {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:53:27 user nova-compute[72444]: WARNING nova.compute.manager [req-2f7a5678-641a-4f01-bb01-07da10564f9d req-f080eb25-b9a7-4b5f-b349-adcc5005ca3b service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received unexpected event network-vif-plugged-fe941d99-e8f6-42bd-939e-d2955caed33d for instance with vm_state building and task_state spawning.
Aug 03 04:53:27 user nova-compute[72444]: DEBUG nova.compute.manager [req-2f7a5678-641a-4f01-bb01-07da10564f9d req-f080eb25-b9a7-4b5f-b349-adcc5005ca3b service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-plugged-fe941d99-e8f6-42bd-939e-d2955caed33d {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2f7a5678-641a-4f01-bb01-07da10564f9d req-f080eb25-b9a7-4b5f-b349-adcc5005ca3b service nova] Acquiring lock "c5b50062-b965-4686-beea-63537d9f1eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2f7a5678-641a-4f01-bb01-07da10564f9d req-f080eb25-b9a7-4b5f-b349-adcc5005ca3b service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2f7a5678-641a-4f01-bb01-07da10564f9d req-f080eb25-b9a7-4b5f-b349-adcc5005ca3b service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG nova.compute.manager [req-2f7a5678-641a-4f01-bb01-07da10564f9d req-f080eb25-b9a7-4b5f-b349-adcc5005ca3b service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] No waiting events found dispatching network-vif-plugged-fe941d99-e8f6-42bd-939e-d2955caed33d {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:53:27 user nova-compute[72444]: WARNING nova.compute.manager [req-2f7a5678-641a-4f01-bb01-07da10564f9d req-f080eb25-b9a7-4b5f-b349-adcc5005ca3b service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received unexpected event network-vif-plugged-fe941d99-e8f6-42bd-939e-d2955caed33d for instance with vm_state building and task_state spawning.
Aug 03 04:53:27 user nova-compute[72444]: DEBUG nova.compute.manager [req-83591b08-fd06-4868-b9a4-602334aa4622 req-9924986c-32be-43f0-a582-d94e35e65e54 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-plugged-df356454-4b89-4b15-955c-6d4d41688490 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-83591b08-fd06-4868-b9a4-602334aa4622 req-9924986c-32be-43f0-a582-d94e35e65e54 service nova] Acquiring lock "c5b50062-b965-4686-beea-63537d9f1eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-83591b08-fd06-4868-b9a4-602334aa4622 req-9924986c-32be-43f0-a582-d94e35e65e54 service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-83591b08-fd06-4868-b9a4-602334aa4622 req-9924986c-32be-43f0-a582-d94e35e65e54 service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG nova.compute.manager [req-83591b08-fd06-4868-b9a4-602334aa4622 req-9924986c-32be-43f0-a582-d94e35e65e54 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] No waiting events found dispatching network-vif-plugged-df356454-4b89-4b15-955c-6d4d41688490 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:53:27 user nova-compute[72444]: WARNING nova.compute.manager [req-83591b08-fd06-4868-b9a4-602334aa4622 req-9924986c-32be-43f0-a582-d94e35e65e54 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received unexpected event network-vif-plugged-df356454-4b89-4b15-955c-6d4d41688490 for instance with vm_state building and task_state spawning.
Aug 03 04:53:27 user nova-compute[72444]: DEBUG nova.compute.manager [req-83591b08-fd06-4868-b9a4-602334aa4622 req-9924986c-32be-43f0-a582-d94e35e65e54 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-plugged-6e47393c-8b6c-4008-a802-8a728b3a7a6c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-83591b08-fd06-4868-b9a4-602334aa4622 req-9924986c-32be-43f0-a582-d94e35e65e54 service nova] Acquiring lock "c5b50062-b965-4686-beea-63537d9f1eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-83591b08-fd06-4868-b9a4-602334aa4622 req-9924986c-32be-43f0-a582-d94e35e65e54 service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-83591b08-fd06-4868-b9a4-602334aa4622 req-9924986c-32be-43f0-a582-d94e35e65e54 service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG nova.compute.manager [req-83591b08-fd06-4868-b9a4-602334aa4622 req-9924986c-32be-43f0-a582-d94e35e65e54 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] No waiting events found dispatching network-vif-plugged-6e47393c-8b6c-4008-a802-8a728b3a7a6c {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:53:27 user nova-compute[72444]: WARNING nova.compute.manager [req-83591b08-fd06-4868-b9a4-602334aa4622 req-9924986c-32be-43f0-a582-d94e35e65e54 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received unexpected event network-vif-plugged-6e47393c-8b6c-4008-a802-8a728b3a7a6c for instance with vm_state building and task_state spawning.
Aug 03 04:53:27 user nova-compute[72444]: DEBUG nova.compute.manager [req-83591b08-fd06-4868-b9a4-602334aa4622 req-9924986c-32be-43f0-a582-d94e35e65e54 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-plugged-6e47393c-8b6c-4008-a802-8a728b3a7a6c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-83591b08-fd06-4868-b9a4-602334aa4622 req-9924986c-32be-43f0-a582-d94e35e65e54 service nova] Acquiring lock "c5b50062-b965-4686-beea-63537d9f1eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-83591b08-fd06-4868-b9a4-602334aa4622 req-9924986c-32be-43f0-a582-d94e35e65e54 service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-83591b08-fd06-4868-b9a4-602334aa4622 req-9924986c-32be-43f0-a582-d94e35e65e54 service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG nova.compute.manager [req-83591b08-fd06-4868-b9a4-602334aa4622 req-9924986c-32be-43f0-a582-d94e35e65e54 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] No waiting events found dispatching network-vif-plugged-6e47393c-8b6c-4008-a802-8a728b3a7a6c {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:53:27 user nova-compute[72444]: WARNING nova.compute.manager [req-83591b08-fd06-4868-b9a4-602334aa4622 req-9924986c-32be-43f0-a582-d94e35e65e54 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received unexpected event network-vif-plugged-6e47393c-8b6c-4008-a802-8a728b3a7a6c for instance with vm_state building and task_state spawning.
Aug 03 04:53:27 user nova-compute[72444]: DEBUG nova.compute.manager [req-83591b08-fd06-4868-b9a4-602334aa4622 req-9924986c-32be-43f0-a582-d94e35e65e54 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-plugged-9fb86964-076c-439e-84fa-7893c15e8871 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-83591b08-fd06-4868-b9a4-602334aa4622 req-9924986c-32be-43f0-a582-d94e35e65e54 service nova] Acquiring lock "c5b50062-b965-4686-beea-63537d9f1eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-83591b08-fd06-4868-b9a4-602334aa4622 req-9924986c-32be-43f0-a582-d94e35e65e54 service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-83591b08-fd06-4868-b9a4-602334aa4622 req-9924986c-32be-43f0-a582-d94e35e65e54 service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG nova.compute.manager [req-83591b08-fd06-4868-b9a4-602334aa4622 req-9924986c-32be-43f0-a582-d94e35e65e54 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] No waiting events found dispatching network-vif-plugged-9fb86964-076c-439e-84fa-7893c15e8871 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:53:27 user nova-compute[72444]: WARNING nova.compute.manager [req-83591b08-fd06-4868-b9a4-602334aa4622 req-9924986c-32be-43f0-a582-d94e35e65e54 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received unexpected event network-vif-plugged-9fb86964-076c-439e-84fa-7893c15e8871 for instance with vm_state building and task_state spawning.
Aug 03 04:53:27 user nova-compute[72444]: DEBUG nova.compute.manager [req-83591b08-fd06-4868-b9a4-602334aa4622 req-9924986c-32be-43f0-a582-d94e35e65e54 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-plugged-9fb86964-076c-439e-84fa-7893c15e8871 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-83591b08-fd06-4868-b9a4-602334aa4622 req-9924986c-32be-43f0-a582-d94e35e65e54 service nova] Acquiring lock "c5b50062-b965-4686-beea-63537d9f1eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-83591b08-fd06-4868-b9a4-602334aa4622 req-9924986c-32be-43f0-a582-d94e35e65e54 service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-83591b08-fd06-4868-b9a4-602334aa4622 req-9924986c-32be-43f0-a582-d94e35e65e54 service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG nova.compute.manager [req-83591b08-fd06-4868-b9a4-602334aa4622 req-9924986c-32be-43f0-a582-d94e35e65e54 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] No waiting events found dispatching network-vif-plugged-9fb86964-076c-439e-84fa-7893c15e8871 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:53:27 user nova-compute[72444]: WARNING nova.compute.manager [req-83591b08-fd06-4868-b9a4-602334aa4622 req-9924986c-32be-43f0-a582-d94e35e65e54 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received unexpected event network-vif-plugged-9fb86964-076c-439e-84fa-7893c15e8871 for instance with vm_state building and task_state spawning.
Aug 03 04:53:27 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038407.6781056, c5b50062-b965-4686-beea-63537d9f1eda => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:53:27 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c5b50062-b965-4686-beea-63537d9f1eda] VM Resumed (Lifecycle Event)
Aug 03 04:53:27 user nova-compute[72444]: DEBUG nova.compute.manager [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 04:53:27 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Instance spawned successfully.
Aug 03 04:53:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:53:27 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c5b50062-b965-4686-beea-63537d9f1eda] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:53:27 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038407.6834931, c5b50062-b965-4686-beea-63537d9f1eda => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:53:27 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c5b50062-b965-4686-beea-63537d9f1eda] VM Started (Lifecycle Event)
Aug 03 04:53:27 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:53:27 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:53:27 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c5b50062-b965-4686-beea-63537d9f1eda] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:53:27 user nova-compute[72444]: INFO nova.compute.manager [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Took 11.62 seconds to spawn the instance on the hypervisor.
Aug 03 04:53:27 user nova-compute[72444]: DEBUG nova.compute.manager [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:53:27 user nova-compute[72444]: INFO nova.compute.manager [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Took 42.67 seconds to build instance.
Aug 03 04:53:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e32a1f7a-0ea9-4f59-9198-47ba69030532 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Lock "c5b50062-b965-4686-beea-63537d9f1eda" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.822s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:53:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "0214a998-5624-46f9-801e-c582b4a297e5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:53:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "0214a998-5624-46f9-801e-c582b4a297e5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:53:29 user nova-compute[72444]: DEBUG nova.objects.instance [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lazy-loading 'flavor' on Instance uuid 0214a998-5624-46f9-801e-c582b4a297e5 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:53:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "0214a998-5624-46f9-801e-c582b4a297e5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:53:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "0214a998-5624-46f9-801e-c582b4a297e5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:53:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "0214a998-5624-46f9-801e-c582b4a297e5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:53:29 user nova-compute[72444]: INFO nova.compute.manager [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Attaching volume 9efcf676-3580-4ab6-891c-a51ca56bcc05 to /dev/vdb
Aug 03 04:53:29 user nova-compute[72444]: DEBUG os_brick.utils [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:53:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:29 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7656ec0f-a913-4513-8956-052eceb8c9c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:29 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:29 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab9f7fc-d316-43a8-a978-f6d6951136ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:29 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1374a9-8521-4673-b74c-947536146d61]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:29 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8f39e6-91ca-4c5c-8a6b-e3049c6b0e27]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:53:29 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 04:53:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:53:29 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 04:53:29 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6794c9d-0d7a-4af7-939b-2bbed29730fc]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:29 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 04:53:29 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 04:53:29 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 04:53:29 user nova-compute[72444]: DEBUG os_brick.utils [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:53:29 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Updating existing volume attachment record: dd97a0bf-b30c-4a94-8492-5375047756a5 {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 04:53:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:39 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:53:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TQJnasYw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:53:39 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:53:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:53:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:53:39 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:53:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:53:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:53:39 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:53:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:39 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[beffb0ce-0adb-4b62-bf48-e15d80079d02]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 04:53:39 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:39 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f1ef4a-06e7-417e-a002-1280c69f6437]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05] added
Aug 03 04:53:39 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:39 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a5b543-7dc1-4a84-974d-5442281f6a1f]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:39 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fb8576-252a-4ef8-8c83-d794915fd19a]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TQJnasYw {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TQJnasYw" returned: 0 in 0.030s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:39 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[515fc388-7694-4243-88d8-022f815dbdaf]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TQJnasYw'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:39 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ceb32ec-b8d7-42ae-a2ef-bce27d3b7ff2]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:40 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3191ee8d-4d03-4512-83d5-7c6eebb5e02d]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:40 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:53:40 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:53:40 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:53:40 user nova-compute[72444]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)
Aug 03 04:53:40 user nova-compute[72444]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)
Aug 03 04:53:40 user nova-compute[72444]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)
Aug 03 04:53:40 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:53:40 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:53:40 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:53:40 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:53:40 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:53:40 user nova-compute[72444]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)
Aug 03 04:53:40 user nova-compute[72444]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)
Aug 03 04:53:40 user nova-compute[72444]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)
Aug 03 04:53:40 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:53:40 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:53:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 -p 172.16.0.220:3260 --login" returned: 0 in 0.106s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:40 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea89578f-c541-4cf4-a24d-828de0ca974d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:40 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05, portal: 172.16.0.220,3260]
Aug 03 04:53:40 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05, portal: 172.16.0.220,3260] successful.
Aug 03 04:53:40 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:40 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0773b80f-f791-4829-960c-d33c82000371]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:40 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:40 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdfc0df-8ae1-4e59-9ad6-8d79dfe94063]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:40 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:53:40 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:53:40 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:53:40 user nova-compute[72444]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)
Aug 03 04:53:40 user nova-compute[72444]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)
Aug 03 04:53:40 user nova-compute[72444]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)
Aug 03 04:53:40 user nova-compute[72444]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 (non-flash)
Aug 03 04:53:40 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:53:40 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:53:40 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:53:40 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:53:40 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:53:40 user nova-compute[72444]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)
Aug 03 04:53:40 user nova-compute[72444]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)
Aug 03 04:53:40 user nova-compute[72444]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)
Aug 03 04:53:40 user nova-compute[72444]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 (non-flash)
Aug 03 04:53:40 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:53:40 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:53:40 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.393s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:53:40 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:53:40 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] HCTL ('40', '-', '-', 0) found on session 31 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:53:40 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:53:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:40 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d10505-5a04-4248-8e62-b792917bb239]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:40 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Searching for a device in session 31 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:53:40 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TQJnasYw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:53:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-58df3ab8-1c24-4a3d-a9bc-ae3576cbabb2 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "c4af22f7-45f8-4777-83ee-5cf1481c9fe8" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:53:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-58df3ab8-1c24-4a3d-a9bc-ae3576cbabb2 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "c4af22f7-45f8-4777-83ee-5cf1481c9fe8" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:53:40 user nova-compute[72444]: DEBUG nova.compute.manager [None req-58df3ab8-1c24-4a3d-a9bc-ae3576cbabb2 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Going to confirm migration 1 {{(pid=72444) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 03 04:53:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.443s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:53:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] <== connect_volume: return (1446ms) {'type': 'block', 'scsi_wwn': '26465386266366330', 'path': '/dev/sdi'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:53:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465386266366330', 'path': '/dev/sdi'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:53:41 user nova-compute[72444]: DEBUG nova.objects.instance [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lazy-loading 'flavor' on Instance uuid 0214a998-5624-46f9-801e-c582b4a297e5 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:53:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 04:53:41 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:53:41 user nova-compute[72444]:   <source dev="/dev/sdi"/>
Aug 03 04:53:41 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:53:41 user nova-compute[72444]:   <serial>9efcf676-3580-4ab6-891c-a51ca56bcc05</serial>
Aug 03 04:53:41 user nova-compute[72444]: </disk>
Aug 03 04:53:41 user nova-compute[72444]:  {{(pid=72444) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 04:53:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-58df3ab8-1c24-4a3d-a9bc-ae3576cbabb2 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "refresh_cache-c4af22f7-45f8-4777-83ee-5cf1481c9fe8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:53:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-58df3ab8-1c24-4a3d-a9bc-ae3576cbabb2 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquired lock "refresh_cache-c4af22f7-45f8-4777-83ee-5cf1481c9fe8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:53:41 user nova-compute[72444]: DEBUG nova.network.neutron [None req-58df3ab8-1c24-4a3d-a9bc-ae3576cbabb2 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:53:41 user nova-compute[72444]: DEBUG nova.objects.instance [None req-58df3ab8-1c24-4a3d-a9bc-ae3576cbabb2 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lazy-loading 'info_cache' on Instance uuid c4af22f7-45f8-4777-83ee-5cf1481c9fe8 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:53:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:53:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:53:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] No VIF found with MAC fa:16:3e:54:97:0f, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:53:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ef79ad7d-896a-4666-ad34-2fc6ef41a982 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "0214a998-5624-46f9-801e-c582b4a297e5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.220s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:53:42 user nova-compute[72444]: DEBUG nova.network.neutron [None req-58df3ab8-1c24-4a3d-a9bc-ae3576cbabb2 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Updating instance_info_cache with network_info: [{"id": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "address": "fa:16:3e:5e:64:b2", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73526f5e-c0", "ovs_interfaceid": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:53:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-58df3ab8-1c24-4a3d-a9bc-ae3576cbabb2 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Releasing lock "refresh_cache-c4af22f7-45f8-4777-83ee-5cf1481c9fe8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:53:42 user nova-compute[72444]: DEBUG nova.objects.instance [None req-58df3ab8-1c24-4a3d-a9bc-ae3576cbabb2 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lazy-loading 'migration_context' on Instance uuid c4af22f7-45f8-4777-83ee-5cf1481c9fe8 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:53:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-58df3ab8-1c24-4a3d-a9bc-ae3576cbabb2 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:53:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-58df3ab8-1c24-4a3d-a9bc-ae3576cbabb2 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:53:43 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-58df3ab8-1c24-4a3d-a9bc-ae3576cbabb2 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:53:43 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-58df3ab8-1c24-4a3d-a9bc-ae3576cbabb2 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:53:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-58df3ab8-1c24-4a3d-a9bc-ae3576cbabb2 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.523s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:53:43 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-58df3ab8-1c24-4a3d-a9bc-ae3576cbabb2 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Deleted allocation for migration b853e16a-0cca-4c10-bd43-429f4612a605
Aug 03 04:53:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-58df3ab8-1c24-4a3d-a9bc-ae3576cbabb2 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "c4af22f7-45f8-4777-83ee-5cf1481c9fe8" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 2.838s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:53:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Acquiring lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:53:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:53:43 user nova-compute[72444]: DEBUG nova.objects.instance [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lazy-loading 'flavor' on Instance uuid c94f537a-b1a1-4cea-996d-e1a88a2c9dac {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:53:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:53:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Acquiring lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:53:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:53:44 user nova-compute[72444]: INFO nova.compute.manager [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Attaching volume aec5e8db-6e46-439e-9925-ef3f9f4fb4d4 to /dev/vdb
Aug 03 04:53:44 user nova-compute[72444]: DEBUG os_brick.utils [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:53:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:44 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d0b985-bec0-433d-9538-d57670ce0fa1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:44 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae7eae1-5824-458a-b3ff-f6f2df4d0c64]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:44 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c8d1df-aa27-45eb-9397-8e29b29a9a94]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:44 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[617ad766-77fb-44fc-97c6-f9bb58e436d0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:53:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 04:53:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:53:44 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 04:53:44 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d62c56-c6c7-4e60-8c65-c975e821391f]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 04:53:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 04:53:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 04:53:44 user nova-compute[72444]: DEBUG os_brick.utils [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:53:44 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Updating existing volume attachment record: b42e1eda-08f6-41ec-aac5-4944b86c2d46 {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 04:53:44 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:44 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "0214a998-5624-46f9-801e-c582b4a297e5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:53:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "0214a998-5624-46f9-801e-c582b4a297e5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:53:46 user nova-compute[72444]: DEBUG nova.objects.instance [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lazy-loading 'flavor' on Instance uuid 0214a998-5624-46f9-801e-c582b4a297e5 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:53:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "0214a998-5624-46f9-801e-c582b4a297e5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:53:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "0214a998-5624-46f9-801e-c582b4a297e5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:53:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "0214a998-5624-46f9-801e-c582b4a297e5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:53:46 user nova-compute[72444]: INFO nova.compute.manager [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Attaching volume 0282f7ae-8e44-483d-bf4e-d9a1921f0214 to /dev/vdc
Aug 03 04:53:46 user nova-compute[72444]: DEBUG os_brick.utils [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:53:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:46 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:53:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4042917d-c0a5-4664-846c-972ad62626f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3964ec0c-19e1-426a-b0f0-6a462e304b97]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af45879-457c-4a0b-92dd-b4bb1deb69e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a97f3a0-973b-4a67-a54f-6f787da11721]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:53:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 04:53:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:53:47 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 04:53:47 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b676af3-2bea-4ee1-b54c-e46eb5fc8b96]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:47 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 04:53:47 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 04:53:47 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 04:53:47 user nova-compute[72444]: DEBUG os_brick.utils [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:53:47 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Updating existing volume attachment record: 7504f258-f725-4210-a3d4-57469a4f8dac {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 04:53:47 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:53:47 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 04:53:48 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:48 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:53:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:50 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:53:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:51 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:53:52 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:53:52 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:53:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:53:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:53:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:53:52 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 04:53:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:53:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:53:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oPcOrXhG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:53:53 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:53:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:53:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:53:53 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:53:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:53:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:53:53 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:53:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8f7e92-8b07-420b-8ca9-ee6a7c02b359]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 04:53:53 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ad4298-93f4-4e83-ba26-d7dab374a19d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4] added
Aug 03 04:53:53 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[100775de-ae1b-4ae3-95ba-daf74b56722a]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82b8ff0-2d90-464d-8fed-0449d6a4f0ad]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oPcOrXhG {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oPcOrXhG" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd732693-2315-4130-ab10-198f7265000a]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oPcOrXhG'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3f76cb-9253-473c-92b5-74276cb9ae7b]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c03c91d-3fff-4d9f-8781-99b2095cd91f]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:53:54 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:53:54 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:53:54 user nova-compute[72444]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)
Aug 03 04:53:54 user nova-compute[72444]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)
Aug 03 04:53:54 user nova-compute[72444]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)
Aug 03 04:53:54 user nova-compute[72444]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 (non-flash)
Aug 03 04:53:54 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:53:54 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:53:54 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:53:54 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:53:54 user nova-compute[72444]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)
Aug 03 04:53:54 user nova-compute[72444]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)
Aug 03 04:53:54 user nova-compute[72444]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)
Aug 03 04:53:54 user nova-compute[72444]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 (non-flash)
Aug 03 04:53:54 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:53:54 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4 -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a2d521-62f0-4632-9331-953fd7d1af92]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4, portal: 172.16.0.220,3260]
Aug 03 04:53:54 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4, portal: 172.16.0.220,3260] successful.
Aug 03 04:53:54 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9885de-a0e4-413d-b3fa-a281433c11a3]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e852fdf-b1fb-4aaf-8c61-432f8ccc2135]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:53:54 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:53:54 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:53:54 user nova-compute[72444]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)
Aug 03 04:53:54 user nova-compute[72444]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)
Aug 03 04:53:54 user nova-compute[72444]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)
Aug 03 04:53:54 user nova-compute[72444]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 (non-flash)
Aug 03 04:53:54 user nova-compute[72444]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4 (non-flash)
Aug 03 04:53:54 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:53:54 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:53:54 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:53:54 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:53:54 user nova-compute[72444]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)
Aug 03 04:53:54 user nova-compute[72444]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)
Aug 03 04:53:54 user nova-compute[72444]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)
Aug 03 04:53:54 user nova-compute[72444]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 (non-flash)
Aug 03 04:53:54 user nova-compute[72444]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4 (non-flash)
Aug 03 04:53:54 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:53:54 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.374s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] HCTL ('41', '-', '-', 0) found on session 32 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[019265a7-f5b5-4e51-b4b6-d58362126306]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Searching for a device in session 32 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oPcOrXhG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0214a998-5624-46f9-801e-c582b4a297e5/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0214a998-5624-46f9-801e-c582b4a297e5/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0214a998-5624-46f9-801e-c582b4a297e5/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0214a998-5624-46f9-801e-c582b4a297e5/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:53:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:53:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:55 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.481s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:53:55 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] <== connect_volume: return (1485ms) {'type': 'block', 'scsi_wwn': '26630636366356331', 'path': '/dev/sdj'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:53:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630636366356331', 'path': '/dev/sdj'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:53:55 user nova-compute[72444]: DEBUG nova.objects.instance [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lazy-loading 'flavor' on Instance uuid c94f537a-b1a1-4cea-996d-e1a88a2c9dac {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:53:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 04:53:55 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:53:55 user nova-compute[72444]:   <source dev="/dev/sdj"/>
Aug 03 04:53:55 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:53:55 user nova-compute[72444]:   <serial>aec5e8db-6e46-439e-9925-ef3f9f4fb4d4</serial>
Aug 03 04:53:55 user nova-compute[72444]: </disk>
Aug 03 04:53:55 user nova-compute[72444]:  {{(pid=72444) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 04:53:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:53:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:53:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:53:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:53:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:53:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:53:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] No VIF found with MAC fa:16:3e:7f:5d:57, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:53:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b8d91727-52ab-4ef9-ab83-a108d3d8f608 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.869s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:53:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:53:55 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kmRBfwbU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:53:55 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:53:55 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:53:55 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:53:55 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:53:55 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:53:55 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:53:55 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:53:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d344c124-25ec-43cc-ba72-e9c1ec2b4e53]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 04:53:56 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214 -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b885cefc-5ecb-4249-813f-5e3b3a8fcdea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214] added
Aug 03 04:53:56 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15678ac-57f2-4aac-a474-26785fb173ca]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0200ca89-2147-4547-9d18-6627c92af085]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kmRBfwbU {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kmRBfwbU" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec1f242-74f5-45ef-af7e-39305d703b3d]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kmRBfwbU'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee2f231-ce8f-4819-b64b-34879cebbc0f]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe07ad3-a8f9-4256-9a18-ffa0361c437f]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:53:56 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:53:56 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:53:56 user nova-compute[72444]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)
Aug 03 04:53:56 user nova-compute[72444]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)
Aug 03 04:53:56 user nova-compute[72444]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)
Aug 03 04:53:56 user nova-compute[72444]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 (non-flash)
Aug 03 04:53:56 user nova-compute[72444]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4 (non-flash)
Aug 03 04:53:56 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:53:56 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:53:56 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:53:56 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:53:56 user nova-compute[72444]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)
Aug 03 04:53:56 user nova-compute[72444]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)
Aug 03 04:53:56 user nova-compute[72444]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)
Aug 03 04:53:56 user nova-compute[72444]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 (non-flash)
Aug 03 04:53:56 user nova-compute[72444]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4 (non-flash)
Aug 03 04:53:56 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:53:56 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214 -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af8969b-dbce-4b5d-95b4-e99999b43170]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214, portal: 172.16.0.220,3260]
Aug 03 04:53:56 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214, portal: 172.16.0.220,3260] successful.
Aug 03 04:53:56 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19286d1-5b15-4b48-9d2b-b81736dcd55a]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[42370ca9-9e60-4125-a9ff-08304aa0f60d]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:53:56 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:53:56 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:53:56 user nova-compute[72444]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)
Aug 03 04:53:56 user nova-compute[72444]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)
Aug 03 04:53:56 user nova-compute[72444]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)
Aug 03 04:53:56 user nova-compute[72444]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 (non-flash)
Aug 03 04:53:56 user nova-compute[72444]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4 (non-flash)
Aug 03 04:53:56 user nova-compute[72444]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214 (non-flash)
Aug 03 04:53:56 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:53:56 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:53:56 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:53:56 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:53:56 user nova-compute[72444]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)
Aug 03 04:53:56 user nova-compute[72444]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)
Aug 03 04:53:56 user nova-compute[72444]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)
Aug 03 04:53:56 user nova-compute[72444]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 (non-flash)
Aug 03 04:53:56 user nova-compute[72444]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4 (non-flash)
Aug 03 04:53:56 user nova-compute[72444]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214 (non-flash)
Aug 03 04:53:56 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:53:56 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.409s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] HCTL ('42', '-', '-', 0) found on session 33 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[556341e4-d58c-4a60-9693-e19686857b60]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Searching for a device in session 33 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kmRBfwbU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:57 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:53:57 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:53:57 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=6769MB free_disk=25.41809844970703GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 04:53:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:53:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:53:57 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:53:57 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 81725845-6158-4e34-bedb-6e41219bc227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:53:57 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance b6ed9c42-fa6e-4a0d-8312-588471e157f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:53:57 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance e2859322-6f99-442d-bee1-65fe49ce6360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:53:57 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:53:57 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 0b219bf3-a3b6-44b5-946e-c10e7498e1d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:53:57 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance c77e96da-6411-4ae9-af05-8e9bb3c432c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:53:57 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance c94f537a-b1a1-4cea-996d-e1a88a2c9dac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:53:57 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 0214a998-5624-46f9-801e-c582b4a297e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:53:57 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance c4af22f7-45f8-4777-83ee-5cf1481c9fe8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:53:57 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 863f0679-c64c-4a13-8028-4cb194f8f99f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:53:57 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance c5b50062-b965-4686-beea-63537d9f1eda actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:53:57 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:53:57 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance ae41789a-ebd1-4265-a903-32d2006e66d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:53:57 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 04:53:57 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 04:53:57 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.453s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:53:57 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] <== connect_volume: return (1456ms) {'type': 'block', 'scsi_wwn': '23863653533353734', 'path': '/dev/sdk'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:53:57 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863653533353734', 'path': '/dev/sdk'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:53:57 user nova-compute[72444]: DEBUG nova.objects.instance [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lazy-loading 'flavor' on Instance uuid 0214a998-5624-46f9-801e-c582b4a297e5 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:53:57 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 04:53:57 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:53:57 user nova-compute[72444]:   <source dev="/dev/sdk"/>
Aug 03 04:53:57 user nova-compute[72444]:   <target dev="vdc" bus="virtio"/>
Aug 03 04:53:57 user nova-compute[72444]:   <serial>0282f7ae-8e44-483d-bf4e-d9a1921f0214</serial>
Aug 03 04:53:57 user nova-compute[72444]: </disk>
Aug 03 04:53:57 user nova-compute[72444]:  {{(pid=72444) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 04:53:57 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:53:57 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:53:57 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 04:53:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.624s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:53:57 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:53:57 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:53:57 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:53:57 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] No VIF found with MAC fa:16:3e:54:97:0f, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:53:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e6a9e1e0-6544-453c-9943-1444a8b8cd3d tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "0214a998-5624-46f9-801e-c582b4a297e5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.262s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:53:58 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:53:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 04:53:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e72792ef-f07a-44e8-9449-a7518fd6a4c3 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Acquiring lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:53:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e72792ef-f07a-44e8-9449-a7518fd6a4c3 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:53:58 user nova-compute[72444]: INFO nova.compute.manager [None req-e72792ef-f07a-44e8-9449-a7518fd6a4c3 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Detaching volume aec5e8db-6e46-439e-9925-ef3f9f4fb4d4
Aug 03 04:53:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:53:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:53:58 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 04:53:58 user nova-compute[72444]: INFO nova.virt.block_device [None req-e72792ef-f07a-44e8-9449-a7518fd6a4c3 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Attempting to driver detach volume aec5e8db-6e46-439e-9925-ef3f9f4fb4d4 from mountpoint /dev/vdb
Aug 03 04:53:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e72792ef-f07a-44e8-9449-a7518fd6a4c3 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Attempting to detach device vdb from instance c94f537a-b1a1-4cea-996d-e1a88a2c9dac from the persistent domain config. {{(pid=72444) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 04:53:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-e72792ef-f07a-44e8-9449-a7518fd6a4c3 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 04:53:58 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:53:58 user nova-compute[72444]:   <source dev="/dev/sdj"/>
Aug 03 04:53:58 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:53:58 user nova-compute[72444]:   <serial>aec5e8db-6e46-439e-9925-ef3f9f4fb4d4</serial>
Aug 03 04:53:58 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 04:53:58 user nova-compute[72444]: </disk>
Aug 03 04:53:58 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:53:58 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-e72792ef-f07a-44e8-9449-a7518fd6a4c3 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Successfully detached device vdb from instance c94f537a-b1a1-4cea-996d-e1a88a2c9dac from the persistent domain config.
Aug 03 04:53:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e72792ef-f07a-44e8-9449-a7518fd6a4c3 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c94f537a-b1a1-4cea-996d-e1a88a2c9dac from the live domain config. {{(pid=72444) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 04:53:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-e72792ef-f07a-44e8-9449-a7518fd6a4c3 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 04:53:58 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:53:58 user nova-compute[72444]:   <source dev="/dev/sdj"/>
Aug 03 04:53:58 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:53:58 user nova-compute[72444]:   <serial>aec5e8db-6e46-439e-9925-ef3f9f4fb4d4</serial>
Aug 03 04:53:58 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 04:53:58 user nova-compute[72444]: </disk>
Aug 03 04:53:58 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4912a376-38d2-4a91-ac72-2cd7d9d406a3 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "0214a998-5624-46f9-801e-c582b4a297e5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4912a376-38d2-4a91-ac72-2cd7d9d406a3 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "0214a998-5624-46f9-801e-c582b4a297e5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:53:59 user nova-compute[72444]: INFO nova.compute.manager [None req-4912a376-38d2-4a91-ac72-2cd7d9d406a3 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Detaching volume 9efcf676-3580-4ab6-891c-a51ca56bcc05
Aug 03 04:53:59 user nova-compute[72444]: INFO nova.virt.block_device [None req-4912a376-38d2-4a91-ac72-2cd7d9d406a3 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Attempting to driver detach volume 9efcf676-3580-4ab6-891c-a51ca56bcc05 from mountpoint /dev/vdb
Aug 03 04:53:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4912a376-38d2-4a91-ac72-2cd7d9d406a3 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Attempting to detach device vdb from instance 0214a998-5624-46f9-801e-c582b4a297e5 from the persistent domain config. {{(pid=72444) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-4912a376-38d2-4a91-ac72-2cd7d9d406a3 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 04:53:59 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:53:59 user nova-compute[72444]:   <source dev="/dev/sdi"/>
Aug 03 04:53:59 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:53:59 user nova-compute[72444]:   <serial>9efcf676-3580-4ab6-891c-a51ca56bcc05</serial>
Aug 03 04:53:59 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 04:53:59 user nova-compute[72444]: </disk>
Aug 03 04:53:59 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:53:59 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-4912a376-38d2-4a91-ac72-2cd7d9d406a3 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Successfully detached device vdb from instance 0214a998-5624-46f9-801e-c582b4a297e5 from the persistent domain config.
Aug 03 04:53:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4912a376-38d2-4a91-ac72-2cd7d9d406a3 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0214a998-5624-46f9-801e-c582b4a297e5 from the live domain config. {{(pid=72444) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-4912a376-38d2-4a91-ac72-2cd7d9d406a3 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 04:53:59 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:53:59 user nova-compute[72444]:   <source dev="/dev/sdi"/>
Aug 03 04:53:59 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:53:59 user nova-compute[72444]:   <serial>9efcf676-3580-4ab6-891c-a51ca56bcc05</serial>
Aug 03 04:53:59 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 04:53:59 user nova-compute[72444]: </disk>
Aug 03 04:53:59 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Received event <DeviceRemovedEvent: 1691038439.4148192, c94f537a-b1a1-4cea-996d-e1a88a2c9dac => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72444) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e72792ef-f07a-44e8-9449-a7518fd6a4c3 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c94f537a-b1a1-4cea-996d-e1a88a2c9dac {{(pid=72444) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 04:53:59 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-e72792ef-f07a-44e8-9449-a7518fd6a4c3 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Successfully detached device vdb from instance c94f537a-b1a1-4cea-996d-e1a88a2c9dac from the live domain config.
Aug 03 04:53:59 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Updating instance_info_cache with network_info: [{"id": "c14e16af-c17e-4152-a400-cbb8fb4f41fa", "address": "fa:16:3e:05:10:6a", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14e16af-c1", "ovs_interfaceid": "c14e16af-c17e-4152-a400-cbb8fb4f41fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e72792ef-f07a-44e8-9449-a7518fd6a4c3 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72792ef-f07a-44e8-9449-a7518fd6a4c3 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oPcOrXhG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:53:59 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-e72792ef-f07a-44e8-9449-a7518fd6a4c3 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:53:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e72792ef-f07a-44e8-9449-a7518fd6a4c3 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e72792ef-f07a-44e8-9449-a7518fd6a4c3 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72792ef-f07a-44e8-9449-a7518fd6a4c3 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[066b70c9-62cf-47c2-92ea-35eeab854a00]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb0b969-ee6f-4c55-85b9-b7b2006c97ed]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72792ef-f07a-44e8-9449-a7518fd6a4c3 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:53:59 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:53:59 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:53:59 user nova-compute[72444]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)
Aug 03 04:53:59 user nova-compute[72444]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)
Aug 03 04:53:59 user nova-compute[72444]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)
Aug 03 04:53:59 user nova-compute[72444]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 (non-flash)
Aug 03 04:53:59 user nova-compute[72444]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4 (non-flash)
Aug 03 04:53:59 user nova-compute[72444]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214 (non-flash)
Aug 03 04:53:59 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:53:59 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72792ef-f07a-44e8-9449-a7518fd6a4c3 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:53:59 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:53:59 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:53:59 user nova-compute[72444]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)
Aug 03 04:53:59 user nova-compute[72444]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)
Aug 03 04:53:59 user nova-compute[72444]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)
Aug 03 04:53:59 user nova-compute[72444]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 (non-flash)
Aug 03 04:53:59 user nova-compute[72444]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4 (non-flash)
Aug 03 04:53:59 user nova-compute[72444]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214 (non-flash)
Aug 03 04:53:59 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:53:59 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72792ef-f07a-44e8-9449-a7518fd6a4c3 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f309ec23d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4'): ({'sdj'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-e72792ef-f07a-44e8-9449-a7518fd6a4c3 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Removing single pathed devices sdj {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c4534e-28c9-4671-aefc-b10b9c5366b0]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d05a464-0a99-486d-9747-3fe5463e1d2f]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-e72792ef-f07a-44e8-9449-a7518fd6a4c3 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Flushing IO for device /dev/sdj {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3db0a9-5336-4884-9313-8b58b7d2d58e]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-e72792ef-f07a-44e8-9449-a7518fd6a4c3 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.045s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1423181-578d-43a6-8556-aa5d074690c1]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-e72792ef-f07a-44e8-9449-a7518fd6a4c3 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-e72792ef-f07a-44e8-9449-a7518fd6a4c3 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] SCSI volumes sdj have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72792ef-f07a-44e8-9449-a7518fd6a4c3 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[159ece28-568b-4ddb-bc4f-9fc872a60af6]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72792ef-f07a-44e8-9449-a7518fd6a4c3 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4 -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b63595-d4ab-4e5a-a626-a19b27422dae]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72792ef-f07a-44e8-9449-a7518fd6a4c3 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4, portal: 172.16.0.220,3260]
Aug 03 04:53:59 user nova-compute[72444]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4, portal: 172.16.0.220,3260] successful.
Aug 03 04:53:59 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4 -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aec5e8db-6e46-439e-9925-ef3f9f4fb4d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9bad01-1c5f-4d2d-9797-5fc6bad59897]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72792ef-f07a-44e8-9449-a7518fd6a4c3 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e72792ef-f07a-44e8-9449-a7518fd6a4c3 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72792ef-f07a-44e8-9449-a7518fd6a4c3 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] <== disconnect_volume: return (312ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e72792ef-f07a-44e8-9449-a7518fd6a4c3 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Received event <DeviceRemovedEvent: 1691038439.7562401, 0214a998-5624-46f9-801e-c582b4a297e5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72444) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4912a376-38d2-4a91-ac72-2cd7d9d406a3 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0214a998-5624-46f9-801e-c582b4a297e5 {{(pid=72444) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 04:53:59 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-4912a376-38d2-4a91-ac72-2cd7d9d406a3 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Successfully detached device vdb from instance 0214a998-5624-46f9-801e-c582b4a297e5 from the live domain config.
Aug 03 04:53:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4912a376-38d2-4a91-ac72-2cd7d9d406a3 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4912a376-38d2-4a91-ac72-2cd7d9d406a3 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TQJnasYw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:53:59 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-4912a376-38d2-4a91-ac72-2cd7d9d406a3 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:53:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-4912a376-38d2-4a91-ac72-2cd7d9d406a3 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-4912a376-38d2-4a91-ac72-2cd7d9d406a3 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4912a376-38d2-4a91-ac72-2cd7d9d406a3 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5138ad0-eb57-45f8-94e2-92e88f774fdc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e530e6-9469-452c-8e5a-35cb45a5a3fa]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4912a376-38d2-4a91-ac72-2cd7d9d406a3 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:53:59 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:53:59 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:53:59 user nova-compute[72444]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)
Aug 03 04:53:59 user nova-compute[72444]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)
Aug 03 04:53:59 user nova-compute[72444]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)
Aug 03 04:53:59 user nova-compute[72444]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 (non-flash)
Aug 03 04:53:59 user nova-compute[72444]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214 (non-flash)
Aug 03 04:53:59 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:53:59 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4912a376-38d2-4a91-ac72-2cd7d9d406a3 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:53:59 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:53:59 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:53:59 user nova-compute[72444]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)
Aug 03 04:53:59 user nova-compute[72444]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)
Aug 03 04:53:59 user nova-compute[72444]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)
Aug 03 04:53:59 user nova-compute[72444]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 (non-flash)
Aug 03 04:53:59 user nova-compute[72444]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214 (non-flash)
Aug 03 04:53:59 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:53:59 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4912a376-38d2-4a91-ac72-2cd7d9d406a3 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30a0dcb640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05'): ({'sdi'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-4912a376-38d2-4a91-ac72-2cd7d9d406a3 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Removing single pathed devices sdi {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[49dce44b-a362-4cf0-b66f-636976caeb88]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d481df2-c490-4fe6-a707-e90c0d1c9e9d]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-4912a376-38d2-4a91-ac72-2cd7d9d406a3 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Flushing IO for device /dev/sdi {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[af25f207-396b-4c12-a234-a57406855db1]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-4912a376-38d2-4a91-ac72-2cd7d9d406a3 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.041s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[341e52df-2dbf-4b85-97de-cc639a2876fa]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-4912a376-38d2-4a91-ac72-2cd7d9d406a3 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-4912a376-38d2-4a91-ac72-2cd7d9d406a3 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] SCSI volumes sdi have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4912a376-38d2-4a91-ac72-2cd7d9d406a3 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a13d021-4fde-455a-8aa8-84c0748b981f]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4912a376-38d2-4a91-ac72-2cd7d9d406a3 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:53:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:00 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4934de1-06be-4786-9428-7e9fd467991b]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:00 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4912a376-38d2-4a91-ac72-2cd7d9d406a3 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05, portal: 172.16.0.220,3260]
Aug 03 04:54:00 user nova-compute[72444]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05, portal: 172.16.0.220,3260] successful.
Aug 03 04:54:00 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:54:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efcf676-3580-4ab6-891c-a51ca56bcc05 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.048s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:00 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[064ba11c-50c7-4b39-b429-4f1b07064723]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:00 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4912a376-38d2-4a91-ac72-2cd7d9d406a3 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:54:00 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-4912a376-38d2-4a91-ac72-2cd7d9d406a3 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:54:00 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4912a376-38d2-4a91-ac72-2cd7d9d406a3 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] <== disconnect_volume: return (335ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:54:00 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4912a376-38d2-4a91-ac72-2cd7d9d406a3 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:54:00 user nova-compute[72444]: DEBUG nova.objects.instance [None req-e72792ef-f07a-44e8-9449-a7518fd6a4c3 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lazy-loading 'flavor' on Instance uuid c94f537a-b1a1-4cea-996d-e1a88a2c9dac {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:54:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e72792ef-f07a-44e8-9449-a7518fd6a4c3 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.684s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:54:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:00 user nova-compute[72444]: DEBUG nova.objects.instance [None req-4912a376-38d2-4a91-ac72-2cd7d9d406a3 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lazy-loading 'flavor' on Instance uuid 0214a998-5624-46f9-801e-c582b4a297e5 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:54:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4912a376-38d2-4a91-ac72-2cd7d9d406a3 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "0214a998-5624-46f9-801e-c582b4a297e5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.850s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:54:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-547cb717-f095-4899-a775-71af07403c53 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "0214a998-5624-46f9-801e-c582b4a297e5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:54:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-547cb717-f095-4899-a775-71af07403c53 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "0214a998-5624-46f9-801e-c582b4a297e5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:54:01 user nova-compute[72444]: INFO nova.compute.manager [None req-547cb717-f095-4899-a775-71af07403c53 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Detaching volume 0282f7ae-8e44-483d-bf4e-d9a1921f0214
Aug 03 04:54:01 user nova-compute[72444]: INFO nova.virt.block_device [None req-547cb717-f095-4899-a775-71af07403c53 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Attempting to driver detach volume 0282f7ae-8e44-483d-bf4e-d9a1921f0214 from mountpoint /dev/vdc
Aug 03 04:54:01 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-547cb717-f095-4899-a775-71af07403c53 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Attempting to detach device vdc from instance 0214a998-5624-46f9-801e-c582b4a297e5 from the persistent domain config. {{(pid=72444) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 04:54:01 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-547cb717-f095-4899-a775-71af07403c53 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 04:54:01 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:54:01 user nova-compute[72444]:   <source dev="/dev/sdk"/>
Aug 03 04:54:01 user nova-compute[72444]:   <target dev="vdc" bus="virtio"/>
Aug 03 04:54:01 user nova-compute[72444]:   <serial>0282f7ae-8e44-483d-bf4e-d9a1921f0214</serial>
Aug 03 04:54:01 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 03 04:54:01 user nova-compute[72444]: </disk>
Aug 03 04:54:01 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:54:01 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-547cb717-f095-4899-a775-71af07403c53 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Successfully detached device vdc from instance 0214a998-5624-46f9-801e-c582b4a297e5 from the persistent domain config.
Aug 03 04:54:01 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-547cb717-f095-4899-a775-71af07403c53 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 0214a998-5624-46f9-801e-c582b4a297e5 from the live domain config. {{(pid=72444) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 04:54:01 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-547cb717-f095-4899-a775-71af07403c53 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 04:54:01 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:54:01 user nova-compute[72444]:   <source dev="/dev/sdk"/>
Aug 03 04:54:01 user nova-compute[72444]:   <target dev="vdc" bus="virtio"/>
Aug 03 04:54:01 user nova-compute[72444]:   <serial>0282f7ae-8e44-483d-bf4e-d9a1921f0214</serial>
Aug 03 04:54:01 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 03 04:54:01 user nova-compute[72444]: </disk>
Aug 03 04:54:01 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Received event <DeviceRemovedEvent: 1691038442.1508923, 0214a998-5624-46f9-801e-c582b4a297e5 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72444) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-547cb717-f095-4899-a775-71af07403c53 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 0214a998-5624-46f9-801e-c582b4a297e5 {{(pid=72444) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 04:54:02 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-547cb717-f095-4899-a775-71af07403c53 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Successfully detached device vdc from instance 0214a998-5624-46f9-801e-c582b4a297e5 from the live domain config.
Aug 03 04:54:02 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-547cb717-f095-4899-a775-71af07403c53 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-547cb717-f095-4899-a775-71af07403c53 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kmRBfwbU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:54:02 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-547cb717-f095-4899-a775-71af07403c53 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:54:02 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-547cb717-f095-4899-a775-71af07403c53 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-547cb717-f095-4899-a775-71af07403c53 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-547cb717-f095-4899-a775-71af07403c53 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa862748-7f38-4226-a3dd-2aca8cb7ca54]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eef70b6-00a0-4add-a19e-a87f5df452a2]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-547cb717-f095-4899-a775-71af07403c53 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:54:02 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:54:02 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:54:02 user nova-compute[72444]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)
Aug 03 04:54:02 user nova-compute[72444]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)
Aug 03 04:54:02 user nova-compute[72444]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)
Aug 03 04:54:02 user nova-compute[72444]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214 (non-flash)
Aug 03 04:54:02 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:54:02 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-547cb717-f095-4899-a775-71af07403c53 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:54:02 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:54:02 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:54:02 user nova-compute[72444]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)
Aug 03 04:54:02 user nova-compute[72444]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)
Aug 03 04:54:02 user nova-compute[72444]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)
Aug 03 04:54:02 user nova-compute[72444]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214 (non-flash)
Aug 03 04:54:02 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:54:02 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-547cb717-f095-4899-a775-71af07403c53 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30941d7d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214'): ({'sdk'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-547cb717-f095-4899-a775-71af07403c53 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Removing single pathed devices sdk {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6738eb44-260d-4706-89c5-75d3f7a96fc2]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf312120-d866-4a04-815d-2b59e27cdc33]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-547cb717-f095-4899-a775-71af07403c53 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Flushing IO for device /dev/sdk {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.014s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4a0afb-6de3-4720-aa85-07223e3025b6]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-547cb717-f095-4899-a775-71af07403c53 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.061s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[43213340-f833-479b-95c2-99614632a6b6]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-547cb717-f095-4899-a775-71af07403c53 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-547cb717-f095-4899-a775-71af07403c53 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] SCSI volumes sdk have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-547cb717-f095-4899-a775-71af07403c53 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc7ed9c-b444-46e3-802e-0f46f342aa17]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-547cb717-f095-4899-a775-71af07403c53 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214 -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0446c4-ca64-4ec7-8bc6-7432be6451b5]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-547cb717-f095-4899-a775-71af07403c53 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214, portal: 172.16.0.220,3260]
Aug 03 04:54:02 user nova-compute[72444]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214, portal: 172.16.0.220,3260] successful.
Aug 03 04:54:02 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214 -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0282f7ae-8e44-483d-bf4e-d9a1921f0214 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a072e8bb-7c06-45f0-baa4-3e4f63c8ab14]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-547cb717-f095-4899-a775-71af07403c53 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-547cb717-f095-4899-a775-71af07403c53 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-547cb717-f095-4899-a775-71af07403c53 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] <== disconnect_volume: return (343ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:54:02 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-547cb717-f095-4899-a775-71af07403c53 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:54:03 user nova-compute[72444]: DEBUG nova.objects.instance [None req-547cb717-f095-4899-a775-71af07403c53 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lazy-loading 'flavor' on Instance uuid 0214a998-5624-46f9-801e-c582b4a297e5 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:54:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-547cb717-f095-4899-a775-71af07403c53 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "0214a998-5624-46f9-801e-c582b4a297e5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.731s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:54:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-546454f2-770f-4d34-95fd-edd0fc526a69 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "0214a998-5624-46f9-801e-c582b4a297e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:54:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-546454f2-770f-4d34-95fd-edd0fc526a69 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "0214a998-5624-46f9-801e-c582b4a297e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:54:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-546454f2-770f-4d34-95fd-edd0fc526a69 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "0214a998-5624-46f9-801e-c582b4a297e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:54:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-546454f2-770f-4d34-95fd-edd0fc526a69 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "0214a998-5624-46f9-801e-c582b4a297e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:54:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-546454f2-770f-4d34-95fd-edd0fc526a69 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "0214a998-5624-46f9-801e-c582b4a297e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:54:04 user nova-compute[72444]: INFO nova.compute.manager [None req-546454f2-770f-4d34-95fd-edd0fc526a69 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Terminating instance
Aug 03 04:54:04 user nova-compute[72444]: DEBUG nova.compute.manager [None req-546454f2-770f-4d34-95fd-edd0fc526a69 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 04:54:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:04 user nova-compute[72444]: DEBUG nova.compute.manager [req-b7f3f8e4-1c4e-4179-9333-81cc527de65d req-aad4a5f7-c4bb-4d51-8655-fbb4375b0df4 service nova] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Received event network-vif-unplugged-62f68bc6-6c23-4a77-9000-46670e8312fa {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:54:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b7f3f8e4-1c4e-4179-9333-81cc527de65d req-aad4a5f7-c4bb-4d51-8655-fbb4375b0df4 service nova] Acquiring lock "0214a998-5624-46f9-801e-c582b4a297e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:54:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b7f3f8e4-1c4e-4179-9333-81cc527de65d req-aad4a5f7-c4bb-4d51-8655-fbb4375b0df4 service nova] Lock "0214a998-5624-46f9-801e-c582b4a297e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:54:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b7f3f8e4-1c4e-4179-9333-81cc527de65d req-aad4a5f7-c4bb-4d51-8655-fbb4375b0df4 service nova] Lock "0214a998-5624-46f9-801e-c582b4a297e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:54:04 user nova-compute[72444]: DEBUG nova.compute.manager [req-b7f3f8e4-1c4e-4179-9333-81cc527de65d req-aad4a5f7-c4bb-4d51-8655-fbb4375b0df4 service nova] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] No waiting events found dispatching network-vif-unplugged-62f68bc6-6c23-4a77-9000-46670e8312fa {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:54:04 user nova-compute[72444]: DEBUG nova.compute.manager [req-b7f3f8e4-1c4e-4179-9333-81cc527de65d req-aad4a5f7-c4bb-4d51-8655-fbb4375b0df4 service nova] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Received event network-vif-unplugged-62f68bc6-6c23-4a77-9000-46670e8312fa for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:54:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:04 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Instance destroyed successfully.
Aug 03 04:54:04 user nova-compute[72444]: DEBUG nova.objects.instance [None req-546454f2-770f-4d34-95fd-edd0fc526a69 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lazy-loading 'resources' on Instance uuid 0214a998-5624-46f9-801e-c582b4a297e5 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:54:05 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-546454f2-770f-4d34-95fd-edd0fc526a69 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:51:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-496141584',display_name='tempest-AttachVolumeTestJSON-server-496141584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-496141584',id=27,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMXBVtWUxj++Zjsxy4sFEtIsPN+GU+NEpWxox0y7DZzqNy60nwOEuwRURSiVJKnaYyjSrINgPfeHM4xYuXWv7s5I2FYtN7vxpBGsU9L4N0Ec1Q7f9fEZFh3DdmzCcZT/g==',key_name='tempest-keypair-1442806230',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:51:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a65efd00e0ac4039bf1d6429787b8595',ramdisk_id='',reservation_id='r-dyaml07b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1814863301',owner_user_name='tempest-AttachVolumeTestJSON-1814863301-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:51:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e44603a26afa49098e76422420c825c2',uuid=0214a998-5624-46f9-801e-c582b4a297e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62f68bc6-6c23-4a77-9000-46670e8312fa", "address": "fa:16:3e:54:97:0f", "network": {"id": "628fbd1c-7104-4911-9eb9-1f38c394bebd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-366258398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a65efd00e0ac4039bf1d6429787b8595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f68bc6-6c", "ovs_interfaceid": "62f68bc6-6c23-4a77-9000-46670e8312fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:54:05 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-546454f2-770f-4d34-95fd-edd0fc526a69 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Converting VIF {"id": "62f68bc6-6c23-4a77-9000-46670e8312fa", "address": "fa:16:3e:54:97:0f", "network": {"id": "628fbd1c-7104-4911-9eb9-1f38c394bebd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-366258398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a65efd00e0ac4039bf1d6429787b8595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f68bc6-6c", "ovs_interfaceid": "62f68bc6-6c23-4a77-9000-46670e8312fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:54:05 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-546454f2-770f-4d34-95fd-edd0fc526a69 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:97:0f,bridge_name='br-int',has_traffic_filtering=True,id=62f68bc6-6c23-4a77-9000-46670e8312fa,network=Network(628fbd1c-7104-4911-9eb9-1f38c394bebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62f68bc6-6c') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:54:05 user nova-compute[72444]: DEBUG os_vif [None req-546454f2-770f-4d34-95fd-edd0fc526a69 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:97:0f,bridge_name='br-int',has_traffic_filtering=True,id=62f68bc6-6c23-4a77-9000-46670e8312fa,network=Network(628fbd1c-7104-4911-9eb9-1f38c394bebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62f68bc6-6c') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:54:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62f68bc6-6c, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:54:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:05 user nova-compute[72444]: INFO os_vif [None req-546454f2-770f-4d34-95fd-edd0fc526a69 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:97:0f,bridge_name='br-int',has_traffic_filtering=True,id=62f68bc6-6c23-4a77-9000-46670e8312fa,network=Network(628fbd1c-7104-4911-9eb9-1f38c394bebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62f68bc6-6c')
Aug 03 04:54:05 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-546454f2-770f-4d34-95fd-edd0fc526a69 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Deleting instance files /opt/stack/data/nova/instances/0214a998-5624-46f9-801e-c582b4a297e5_del
Aug 03 04:54:05 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-546454f2-770f-4d34-95fd-edd0fc526a69 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Deletion of /opt/stack/data/nova/instances/0214a998-5624-46f9-801e-c582b4a297e5_del complete
Aug 03 04:54:05 user nova-compute[72444]: INFO nova.compute.manager [None req-546454f2-770f-4d34-95fd-edd0fc526a69 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 03 04:54:05 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-546454f2-770f-4d34-95fd-edd0fc526a69 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 04:54:05 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 04:54:05 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 04:54:05 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:54:05 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Took 0.75 seconds to deallocate network for instance.
Aug 03 04:54:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-546454f2-770f-4d34-95fd-edd0fc526a69 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:54:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-546454f2-770f-4d34-95fd-edd0fc526a69 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:54:06 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-546454f2-770f-4d34-95fd-edd0fc526a69 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:54:06 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-546454f2-770f-4d34-95fd-edd0fc526a69 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:54:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-546454f2-770f-4d34-95fd-edd0fc526a69 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:54:06 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-546454f2-770f-4d34-95fd-edd0fc526a69 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Deleted allocations for instance 0214a998-5624-46f9-801e-c582b4a297e5
Aug 03 04:54:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-546454f2-770f-4d34-95fd-edd0fc526a69 tempest-AttachVolumeTestJSON-1814863301 tempest-AttachVolumeTestJSON-1814863301-project-member] Lock "0214a998-5624-46f9-801e-c582b4a297e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.246s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:54:06 user nova-compute[72444]: DEBUG nova.compute.manager [req-48ca2594-ad5b-4706-89f0-2157f40995b7 req-8e8c0267-23bc-4f4f-9233-395d506a31a8 service nova] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Received event network-vif-plugged-62f68bc6-6c23-4a77-9000-46670e8312fa {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:54:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-48ca2594-ad5b-4706-89f0-2157f40995b7 req-8e8c0267-23bc-4f4f-9233-395d506a31a8 service nova] Acquiring lock "0214a998-5624-46f9-801e-c582b4a297e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:54:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-48ca2594-ad5b-4706-89f0-2157f40995b7 req-8e8c0267-23bc-4f4f-9233-395d506a31a8 service nova] Lock "0214a998-5624-46f9-801e-c582b4a297e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:54:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-48ca2594-ad5b-4706-89f0-2157f40995b7 req-8e8c0267-23bc-4f4f-9233-395d506a31a8 service nova] Lock "0214a998-5624-46f9-801e-c582b4a297e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:54:06 user nova-compute[72444]: DEBUG nova.compute.manager [req-48ca2594-ad5b-4706-89f0-2157f40995b7 req-8e8c0267-23bc-4f4f-9233-395d506a31a8 service nova] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] No waiting events found dispatching network-vif-plugged-62f68bc6-6c23-4a77-9000-46670e8312fa {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:54:06 user nova-compute[72444]: WARNING nova.compute.manager [req-48ca2594-ad5b-4706-89f0-2157f40995b7 req-8e8c0267-23bc-4f4f-9233-395d506a31a8 service nova] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Received unexpected event network-vif-plugged-62f68bc6-6c23-4a77-9000-46670e8312fa for instance with vm_state deleted and task_state None.
Aug 03 04:54:06 user nova-compute[72444]: DEBUG nova.compute.manager [req-48ca2594-ad5b-4706-89f0-2157f40995b7 req-8e8c0267-23bc-4f4f-9233-395d506a31a8 service nova] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Received event network-vif-deleted-62f68bc6-6c23-4a77-9000-46670e8312fa {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:54:07 user nova-compute[72444]: INFO nova.compute.manager [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Rescuing
Aug 03 04:54:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "refresh_cache-863f0679-c64c-4a13-8028-4cb194f8f99f" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:54:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquired lock "refresh_cache-863f0679-c64c-4a13-8028-4cb194f8f99f" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:54:07 user nova-compute[72444]: DEBUG nova.network.neutron [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:54:08 user nova-compute[72444]: DEBUG nova.network.neutron [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Updating instance_info_cache with network_info: [{"id": "74465661-452c-4dba-b207-94f35c3fa50d", "address": "fa:16:3e:ea:30:b2", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74465661-45", "ovs_interfaceid": "74465661-452c-4dba-b207-94f35c3fa50d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:54:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Releasing lock "refresh_cache-863f0679-c64c-4a13-8028-4cb194f8f99f" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:54:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:08 user nova-compute[72444]: DEBUG nova.compute.manager [req-96c8cde6-aa28-4596-ac30-11690afdb2da req-a5cef88c-89ba-4f42-b5ca-7dc769569a76 service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Received event network-vif-unplugged-74465661-452c-4dba-b207-94f35c3fa50d {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:54:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-96c8cde6-aa28-4596-ac30-11690afdb2da req-a5cef88c-89ba-4f42-b5ca-7dc769569a76 service nova] Acquiring lock "863f0679-c64c-4a13-8028-4cb194f8f99f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:54:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-96c8cde6-aa28-4596-ac30-11690afdb2da req-a5cef88c-89ba-4f42-b5ca-7dc769569a76 service nova] Lock "863f0679-c64c-4a13-8028-4cb194f8f99f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:54:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-96c8cde6-aa28-4596-ac30-11690afdb2da req-a5cef88c-89ba-4f42-b5ca-7dc769569a76 service nova] Lock "863f0679-c64c-4a13-8028-4cb194f8f99f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:54:08 user nova-compute[72444]: DEBUG nova.compute.manager [req-96c8cde6-aa28-4596-ac30-11690afdb2da req-a5cef88c-89ba-4f42-b5ca-7dc769569a76 service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] No waiting events found dispatching network-vif-unplugged-74465661-452c-4dba-b207-94f35c3fa50d {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:54:08 user nova-compute[72444]: WARNING nova.compute.manager [req-96c8cde6-aa28-4596-ac30-11690afdb2da req-a5cef88c-89ba-4f42-b5ca-7dc769569a76 service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Received unexpected event network-vif-unplugged-74465661-452c-4dba-b207-94f35c3fa50d for instance with vm_state active and task_state rescuing.
Aug 03 04:54:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:09 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Instance destroyed successfully.
Aug 03 04:54:09 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Attempting a stable device rescue
Aug 03 04:54:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72444) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 03 04:54:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Instance directory exists: not creating {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 03 04:54:09 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Creating image(s)
Aug 03 04:54:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "/opt/stack/data/nova/instances/863f0679-c64c-4a13-8028-4cb194f8f99f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:54:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "/opt/stack/data/nova/instances/863f0679-c64c-4a13-8028-4cb194f8f99f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:54:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "/opt/stack/data/nova/instances/863f0679-c64c-4a13-8028-4cb194f8f99f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:54:09 user nova-compute[72444]: DEBUG nova.objects.instance [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lazy-loading 'trusted_certs' on Instance uuid 863f0679-c64c-4a13-8028-4cb194f8f99f {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:54:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "af0d1ccff0235893ba423a6081b39968740a7d75" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:54:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "af0d1ccff0235893ba423a6081b39968740a7d75" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:54:10 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af0d1ccff0235893ba423a6081b39968740a7d75.part --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:10 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af0d1ccff0235893ba423a6081b39968740a7d75.part --force-share --output=json" returned: 0 in 0.133s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:10 user nova-compute[72444]: DEBUG nova.virt.images [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] 7d648a8d-df16-46e8-9e19-c6cf17c21af1 was qcow2, converting to raw {{(pid=72444) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 03 04:54:10 user nova-compute[72444]: DEBUG nova.privsep.utils [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72444) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 03 04:54:10 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/af0d1ccff0235893ba423a6081b39968740a7d75.part /opt/stack/data/nova/instances/_base/af0d1ccff0235893ba423a6081b39968740a7d75.converted {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:10 user nova-compute[72444]: DEBUG nova.compute.manager [req-11215cea-c304-4e9b-8a49-acadfa4b7260 req-0e55ba5e-ee1a-4ead-8351-718d9980be19 service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Received event network-vif-plugged-74465661-452c-4dba-b207-94f35c3fa50d {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:54:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-11215cea-c304-4e9b-8a49-acadfa4b7260 req-0e55ba5e-ee1a-4ead-8351-718d9980be19 service nova] Acquiring lock "863f0679-c64c-4a13-8028-4cb194f8f99f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:54:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-11215cea-c304-4e9b-8a49-acadfa4b7260 req-0e55ba5e-ee1a-4ead-8351-718d9980be19 service nova] Lock "863f0679-c64c-4a13-8028-4cb194f8f99f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:54:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-11215cea-c304-4e9b-8a49-acadfa4b7260 req-0e55ba5e-ee1a-4ead-8351-718d9980be19 service nova] Lock "863f0679-c64c-4a13-8028-4cb194f8f99f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:54:10 user nova-compute[72444]: DEBUG nova.compute.manager [req-11215cea-c304-4e9b-8a49-acadfa4b7260 req-0e55ba5e-ee1a-4ead-8351-718d9980be19 service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] No waiting events found dispatching network-vif-plugged-74465661-452c-4dba-b207-94f35c3fa50d {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:54:10 user nova-compute[72444]: WARNING nova.compute.manager [req-11215cea-c304-4e9b-8a49-acadfa4b7260 req-0e55ba5e-ee1a-4ead-8351-718d9980be19 service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Received unexpected event network-vif-plugged-74465661-452c-4dba-b207-94f35c3fa50d for instance with vm_state active and task_state rescuing.
Aug 03 04:54:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/af0d1ccff0235893ba423a6081b39968740a7d75.part /opt/stack/data/nova/instances/_base/af0d1ccff0235893ba423a6081b39968740a7d75.converted" returned: 0 in 0.454s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af0d1ccff0235893ba423a6081b39968740a7d75.converted --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af0d1ccff0235893ba423a6081b39968740a7d75.converted --force-share --output=json" returned: 0 in 0.136s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "af0d1ccff0235893ba423a6081b39968740a7d75" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.846s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "af0d1ccff0235893ba423a6081b39968740a7d75" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "af0d1ccff0235893ba423a6081b39968740a7d75" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af0d1ccff0235893ba423a6081b39968740a7d75 --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af0d1ccff0235893ba423a6081b39968740a7d75 --force-share --output=json" returned: 0 in 0.144s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af0d1ccff0235893ba423a6081b39968740a7d75,backing_fmt=raw /opt/stack/data/nova/instances/863f0679-c64c-4a13-8028-4cb194f8f99f/disk.rescue {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af0d1ccff0235893ba423a6081b39968740a7d75,backing_fmt=raw /opt/stack/data/nova/instances/863f0679-c64c-4a13-8028-4cb194f8f99f/disk.rescue" returned: 0 in 0.060s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "af0d1ccff0235893ba423a6081b39968740a7d75" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG nova.objects.instance [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lazy-loading 'migration_context' on Instance uuid 863f0679-c64c-4a13-8028-4cb194f8f99f {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Start _get_guest_xml network_info=[{"id": "74465661-452c-4dba-b207-94f35c3fa50d", "address": "fa:16:3e:ea:30:b2", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "vif_mac": "fa:16:3e:ea:30:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74465661-45", "ovs_interfaceid": "74465661-452c-4dba-b207-94f35c3fa50d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7d648a8d-df16-46e8-9e19-c6cf17c21af1', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pumHUtGc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '863f0679-c64c-4a13-8028-4cb194f8f99f', 'attached_at': '', 'detached_at': '', 'volume_id': '9e9476a5-82bf-4497-8f44-a7d6a95b0da3', 'serial': '9e9476a5-82bf-4497-8f44-a7d6a95b0da3'}, 'disk_bus': 'virtio', 'attachment_id': 'd30a3dc2-bff3-4986-9e96-91e1d116a1fc', 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG nova.objects.instance [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lazy-loading 'resources' on Instance uuid 863f0679-c64c-4a13-8028-4cb194f8f99f {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG nova.objects.instance [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lazy-loading 'numa_topology' on Instance uuid 863f0679-c64c-4a13-8028-4cb194f8f99f {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:54:11 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:54:11 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:54:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG nova.objects.instance [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lazy-loading 'vcpu_model' on Instance uuid 863f0679-c64c-4a13-8028-4cb194f8f99f {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pumHUtGc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:54:11 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:54:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:54:11 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:54:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:54:11 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:54:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0743f21f-ab26-48f4-b524-3d549c42940a]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = pumHUtGc\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 03 04:54:11 user nova-compute[72444]: node.name = iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3
Aug 03 04:54:11 user nova-compute[72444]: node.tpgt = -1
Aug 03 04:54:11 user nova-compute[72444]: node.startup = automatic
Aug 03 04:54:11 user nova-compute[72444]: node.leading_login = No
Aug 03 04:54:11 user nova-compute[72444]: iface.iscsi_ifacename = default
Aug 03 04:54:11 user nova-compute[72444]: iface.net_ifacename = <empty>
Aug 03 04:54:11 user nova-compute[72444]: iface.ipaddress = <empty>
Aug 03 04:54:11 user nova-compute[72444]: iface.prefix_len = 0
Aug 03 04:54:11 user nova-compute[72444]: iface.hwaddress = <empty>
Aug 03 04:54:11 user nova-compute[72444]: iface.transport_name = tcp
Aug 03 04:54:11 user nova-compute[72444]: iface.initiatorname = <empty>
Aug 03 04:54:11 user nova-compute[72444]: iface.state = <empty>
Aug 03 04:54:11 user nova-compute[72444]: iface.vlan_id = 0
Aug 03 04:54:11 user nova-compute[72444]: iface.vlan_priority = 0
Aug 03 04:54:11 user nova-compute[72444]: iface.vlan_state = <empty>
Aug 03 04:54:11 user nova-compute[72444]: iface.iface_num = 0
Aug 03 04:54:11 user nova-compute[72444]: iface.mtu = 0
Aug 03 04:54:11 user nova-compute[72444]: iface.port = 0
Aug 03 04:54:11 user nova-compute[72444]: iface.bootproto = <empty>
Aug 03 04:54:11 user nova-compute[72444]: iface.subnet_mask = <empty>
Aug 03 04:54:11 user nova-compute[72444]: iface.gateway = <empty>
Aug 03 04:54:11 user nova-compute[72444]: iface.dhcp_alt_client_id_state = <empty>
Aug 03 04:54:11 user nova-compute[72444]: iface.dhcp_alt_client_id = <empty>
Aug 03 04:54:11 user nova-compute[72444]: iface.dhcp_dns = <empty>
Aug 03 04:54:11 user nova-compute[72444]: iface.dhcp_learn_iqn = <empty>
Aug 03 04:54:11 user nova-compute[72444]: iface.dhcp_req_vendor_id_state = <empty>
Aug 03 04:54:11 user nova-compute[72444]: iface.dhcp_vendor_id_state = <empty>
Aug 03 04:54:11 user nova-compute[72444]: iface.dhcp_vendor_id = <empty>
Aug 03 04:54:11 user nova-compute[72444]: iface.dhcp_slp_da = <empty>
Aug 03 04:54:11 user nova-compute[72444]: iface.fragmentation = <empty>
Aug 03 04:54:11 user nova-compute[72444]: iface.gratuitous_arp = <empty>
Aug 03 04:54:11 user nova-compute[72444]: iface.incoming_forwarding = <empty>
Aug 03 04:54:11 user nova-compute[72444]: iface.tos_state = <empty>
Aug 03 04:54:11 user nova-compute[72444]: iface.tos = 0
Aug 03 04:54:11 user nova-compute[72444]: iface.ttl = 0
Aug 03 04:54:11 user nova-compute[72444]: iface.delayed_ack = <empty>
Aug 03 04:54:11 user nova-compute[72444]: iface.tcp_nagle = <empty>
Aug 03 04:54:11 user nova-compute[72444]: iface.tcp_wsf_state = <empty>
Aug 03 04:54:11 user nova-compute[72444]: iface.tcp_wsf = 0
Aug 03 04:54:11 user nova-compute[72444]: iface.tcp_timer_scale = 0
Aug 03 04:54:11 user nova-compute[72444]: iface.tcp_timestamp = <empty>
Aug 03 04:54:11 user nova-compute[72444]: iface.redirect = <empty>
Aug 03 04:54:11 user nova-compute[72444]: iface.def_task_mgmt_timeout = 0
Aug 03 04:54:11 user nova-compute[72444]: iface.header_digest = <empty>
Aug 03 04:54:11 user nova-compute[72444]: iface.data_digest = <empty>
Aug 03 04:54:11 user nova-compute[72444]: iface.immediate_data = <empty>
Aug 03 04:54:11 user nova-compute[72444]: iface.initial_r2t = <empty>
Aug 03 04:54:11 user nova-compute[72444]: iface.data_seq_inorder = <empty>
Aug 03 04:54:11 user nova-compute[72444]: iface.data_pdu_inorder = <empty>
Aug 03 04:54:11 user nova-compute[72444]: iface.erl = 0
Aug 03 04:54:11 user nova-compute[72444]: iface.max_receive_data_len = 0
Aug 03 04:54:11 user nova-compute[72444]: iface.first_burst_len = 0
Aug 03 04:54:11 user nova-compute[72444]: iface.max_outstanding_r2t = 0
Aug 03 04:54:11 user nova-compute[72444]: iface.max_burst_len = 0
Aug 03 04:54:11 user nova-compute[72444]: iface.chap_auth = <empty>
Aug 03 04:54:11 user nova-compute[72444]: iface.bidi_chap = <empty>
Aug 03 04:54:11 user nova-compute[72444]: iface.strict_login_compliance = <empty>
Aug 03 04:54:11 user nova-compute[72444]: iface.discovery_auth = <empty>
Aug 03 04:54:11 user nova-compute[72444]: iface.discovery_logout = <empty>
Aug 03 04:54:11 user nova-compute[72444]: node.discovery_address = <empty>
Aug 03 04:54:11 user nova-compute[72444]: node.discovery_port = 0
Aug 03 04:54:11 user nova-compute[72444]: node.discovery_type = static
Aug 03 04:54:11 user nova-compute[72444]: node.session.initial_cmdsn = 0
Aug 03 04:54:11 user nova-compute[72444]: node.session.initial_login_retry_max = 8
Aug 03 04:54:11 user nova-compute[72444]: node.session.xmit_thread_priority = -20
Aug 03 04:54:11 user nova-compute[72444]: node.session.cmds_max = 128
Aug 03 04:54:11 user nova-compute[72444]: node.session.queue_depth = 32
Aug 03 04:54:11 user nova-compute[72444]: node.session.nr_sessions = 1
Aug 03 04:54:11 user nova-compute[72444]: node.session.auth.authmethod = CHAP
Aug 03 04:54:11 user nova-compute[72444]: node.session.auth.username = pumHUtGc
Aug 03 04:54:11 user nova-compute[72444]: node.session.auth.password = ***
Aug 03 04:54:11 user nova-compute[72444]: node.session.auth.username_in = <empty>
Aug 03 04:54:11 user nova-compute[72444]: node.session.auth.password_in = <empty>
Aug 03 04:54:11 user nova-compute[72444]: node.session.auth.chap_algs = MD5
Aug 03 04:54:11 user nova-compute[72444]: node.session.timeo.replacement_timeout = 120
Aug 03 04:54:11 user nova-compute[72444]: node.session.err_timeo.abort_timeout = 15
Aug 03 04:54:11 user nova-compute[72444]: node.session.err_timeo.lu_reset_timeout = 30
Aug 03 04:54:11 user nova-compute[72444]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 03 04:54:11 user nova-compute[72444]: node.session.err_timeo.host_reset_timeout = 60
Aug 03 04:54:11 user nova-compute[72444]: node.session.iscsi.FastAbort = Yes
Aug 03 04:54:11 user nova-compute[72444]: node.session.iscsi.InitialR2T = No
Aug 03 04:54:11 user nova-compute[72444]: node.session.iscsi.ImmediateData = Yes
Aug 03 04:54:11 user nova-compute[72444]: node.session.iscsi.FirstBurstLength = 262144
Aug 03 04:54:11 user nova-compute[72444]: node.session.iscsi.MaxBurstLength = 16776192
Aug 03 04:54:11 user nova-compute[72444]: node.session.iscsi.DefaultTime2Retain = 0
Aug 03 04:54:11 user nova-compute[72444]: node.session.iscsi.DefaultTime2Wait = 2
Aug 03 04:54:11 user nova-compute[72444]: node.session.iscsi.MaxConnections = 1
Aug 03 04:54:11 user nova-compute[72444]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 03 04:54:11 user nova-compute[72444]: node.session.iscsi.ERL = 0
Aug 03 04:54:11 user nova-compute[72444]: node.session.scan = manual
Aug 03 04:54:11 user nova-compute[72444]: node.session.reopen_max = 0
Aug 03 04:54:11 user nova-compute[72444]: node.conn[0].address = 172.16.0.220
Aug 03 04:54:11 user nova-compute[72444]: node.conn[0].port = 3260
Aug 03 04:54:11 user nova-compute[72444]: node.conn[0].startup = manual
Aug 03 04:54:11 user nova-compute[72444]: node.conn[0].tcp.window_size = 524288
Aug 03 04:54:11 user nova-compute[72444]: node.conn[0].tcp.type_of_service = 0
Aug 03 04:54:11 user nova-compute[72444]: node.conn[0].timeo.logout_timeout = 15
Aug 03 04:54:11 user nova-compute[72444]: node.conn[0].timeo.login_timeout = 15
Aug 03 04:54:11 user nova-compute[72444]: node.conn[0].timeo.auth_timeout = 45
Aug 03 04:54:11 user nova-compute[72444]: node.conn[0].timeo.noop_out_interval = 5
Aug 03 04:54:11 user nova-compute[72444]: node.conn[0].timeo.noop_out_timeout = 5
Aug 03 04:54:11 user nova-compute[72444]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 03 04:54:11 user nova-compute[72444]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 03 04:54:11 user nova-compute[72444]: node.conn[0].iscsi.HeaderDigest = None
Aug 03 04:54:11 user nova-compute[72444]: node.conn[0].iscsi.DataDigest = None
Aug 03 04:54:11 user nova-compute[72444]: node.conn[0].iscsi.IFMarker = No
Aug 03 04:54:11 user nova-compute[72444]: node.conn[0].iscsi.OFMarker = No
Aug 03 04:54:11 user nova-compute[72444]: # END RECORD
Aug 03 04:54:11 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0817dd03-0534-4c90-aa40-da76a08895e5]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[457878f3-a9e5-4659-9dab-a35a07d1c09d]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pumHUtGc {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pumHUtGc" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c1b102-d8da-4226-92dc-ead35616d4e4]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pumHUtGc'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7a83cd-1482-4a1c-9d90-22bf4c455cb6]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a961f7-5c63-40da-9c30-125403159d8e]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:54:11 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:54:11 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:54:11 user nova-compute[72444]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)
Aug 03 04:54:11 user nova-compute[72444]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)
Aug 03 04:54:11 user nova-compute[72444]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)
Aug 03 04:54:11 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:54:11 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:54:11 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:54:11 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:54:11 user nova-compute[72444]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)
Aug 03 04:54:11 user nova-compute[72444]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)
Aug 03 04:54:11 user nova-compute[72444]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)
Aug 03 04:54:11 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:54:11 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.143s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] HCTL ('36', '0', '0', 0) found on session 27 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.013s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e4c1fd-91d5-446e-b7c1-2feb5964374c]: (4, ('0 0 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Searching for a device in session 27 and hctl ('36', '0', '0', 0) yield: sde {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pumHUtGc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.164s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] <== connect_volume: return (166ms) {'type': 'block', 'scsi_wwn': '23832373834353933', 'path': '/dev/sde'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832373834353933', 'path': '/dev/sde'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:52:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1691297042',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1691297042',id=28,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:52:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='929fd4a3127b475282426d4412e58def',ramdisk_id='',reservation_id='r-c97ymyhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1082770125',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:52:45Z,user_data=None,user_id='ceede92aa3a74060a7f57d29d0d97aee',uuid=863f0679-c64c-4a13-8028-4cb194f8f99f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74465661-452c-4dba-b207-94f35c3fa50d", "address": "fa:16:3e:ea:30:b2", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "vif_mac": "fa:16:3e:ea:30:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74465661-45", "ovs_interfaceid": "74465661-452c-4dba-b207-94f35c3fa50d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Converting VIF {"id": "74465661-452c-4dba-b207-94f35c3fa50d", "address": "fa:16:3e:ea:30:b2", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "vif_mac": "fa:16:3e:ea:30:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74465661-45", "ovs_interfaceid": "74465661-452c-4dba-b207-94f35c3fa50d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:30:b2,bridge_name='br-int',has_traffic_filtering=True,id=74465661-452c-4dba-b207-94f35c3fa50d,network=Network(0e8b3ddd-e35a-45eb-a34c-614654c25549),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74465661-45') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG nova.objects.instance [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lazy-loading 'pci_devices' on Instance uuid 863f0679-c64c-4a13-8028-4cb194f8f99f {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:54:11 user nova-compute[72444]:   <uuid>863f0679-c64c-4a13-8028-4cb194f8f99f</uuid>
Aug 03 04:54:11 user nova-compute[72444]:   <name>instance-0000001c</name>
Aug 03 04:54:11 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:54:11 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:54:11 user nova-compute[72444]:   <metadata>
Aug 03 04:54:11 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:54:11 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:54:11 user nova-compute[72444]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1691297042</nova:name>
Aug 03 04:54:11 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:54:11</nova:creationTime>
Aug 03 04:54:11 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:54:11 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:54:11 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:54:11 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:54:11 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:54:11 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:54:11 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:54:11 user nova-compute[72444]:       <nova:owner>
Aug 03 04:54:11 user nova-compute[72444]:         <nova:user uuid="ceede92aa3a74060a7f57d29d0d97aee">tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member</nova:user>
Aug 03 04:54:11 user nova-compute[72444]:         <nova:project uuid="929fd4a3127b475282426d4412e58def">tempest-ServerBootFromVolumeStableRescueTest-1082770125</nova:project>
Aug 03 04:54:11 user nova-compute[72444]:       </nova:owner>
Aug 03 04:54:11 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:54:11 user nova-compute[72444]:       <nova:ports>
Aug 03 04:54:11 user nova-compute[72444]:         <nova:port uuid="74465661-452c-4dba-b207-94f35c3fa50d">
Aug 03 04:54:11 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 03 04:54:11 user nova-compute[72444]:         </nova:port>
Aug 03 04:54:11 user nova-compute[72444]:       </nova:ports>
Aug 03 04:54:11 user nova-compute[72444]:     </nova:instance>
Aug 03 04:54:11 user nova-compute[72444]:   </metadata>
Aug 03 04:54:11 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:54:11 user nova-compute[72444]:     <system>
Aug 03 04:54:11 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:54:11 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:54:11 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:54:11 user nova-compute[72444]:       <entry name="serial">863f0679-c64c-4a13-8028-4cb194f8f99f</entry>
Aug 03 04:54:11 user nova-compute[72444]:       <entry name="uuid">863f0679-c64c-4a13-8028-4cb194f8f99f</entry>
Aug 03 04:54:11 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:54:11 user nova-compute[72444]:     </system>
Aug 03 04:54:11 user nova-compute[72444]:   </sysinfo>
Aug 03 04:54:11 user nova-compute[72444]:   <os>
Aug 03 04:54:11 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:54:11 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:54:11 user nova-compute[72444]:   </os>
Aug 03 04:54:11 user nova-compute[72444]:   <features>
Aug 03 04:54:11 user nova-compute[72444]:     <acpi/>
Aug 03 04:54:11 user nova-compute[72444]:     <apic/>
Aug 03 04:54:11 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:54:11 user nova-compute[72444]:   </features>
Aug 03 04:54:11 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:54:11 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:54:11 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:54:11 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:54:11 user nova-compute[72444]:   </clock>
Aug 03 04:54:11 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:54:11 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:54:11 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:54:11 user nova-compute[72444]:   </cpu>
Aug 03 04:54:11 user nova-compute[72444]:   <devices>
Aug 03 04:54:11 user nova-compute[72444]:     <disk type="block" device="disk">
Aug 03 04:54:11 user nova-compute[72444]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:54:11 user nova-compute[72444]:       <source dev="/dev/sde"/>
Aug 03 04:54:11 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:54:11 user nova-compute[72444]:       <serial>9e9476a5-82bf-4497-8f44-a7d6a95b0da3</serial>
Aug 03 04:54:11 user nova-compute[72444]:     </disk>
Aug 03 04:54:11 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:54:11 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:54:11 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/863f0679-c64c-4a13-8028-4cb194f8f99f/disk.rescue"/>
Aug 03 04:54:11 user nova-compute[72444]:       <target dev="vdb" bus="virtio"/>
Aug 03 04:54:11 user nova-compute[72444]:       <boot order="1"/>
Aug 03 04:54:11 user nova-compute[72444]:     </disk>
Aug 03 04:54:11 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:54:11 user nova-compute[72444]:       <mac address="fa:16:3e:ea:30:b2"/>
Aug 03 04:54:11 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:54:11 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:54:11 user nova-compute[72444]:       <target dev="tap74465661-45"/>
Aug 03 04:54:11 user nova-compute[72444]:     </interface>
Aug 03 04:54:11 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:54:11 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/863f0679-c64c-4a13-8028-4cb194f8f99f/console.log" append="off"/>
Aug 03 04:54:11 user nova-compute[72444]:     </serial>
Aug 03 04:54:11 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:54:11 user nova-compute[72444]:     <video>
Aug 03 04:54:11 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:54:11 user nova-compute[72444]:     </video>
Aug 03 04:54:11 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:54:11 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:54:11 user nova-compute[72444]:     </rng>
Aug 03 04:54:11 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:54:11 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:54:11 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:54:11 user nova-compute[72444]:     </memballoon>
Aug 03 04:54:11 user nova-compute[72444]:   </devices>
Aug 03 04:54:11 user nova-compute[72444]: </domain>
Aug 03 04:54:11 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:54:11 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Instance destroyed successfully.
Aug 03 04:54:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:54:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] No VIF found with MAC fa:16:3e:ea:30:b2, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:54:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:13 user nova-compute[72444]: DEBUG nova.compute.manager [req-cb634dc8-83eb-4e5a-93c8-c7962a8b5f90 req-7805c671-3e8f-44c5-a1ce-7b43a5e667e2 service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Received event network-vif-plugged-74465661-452c-4dba-b207-94f35c3fa50d {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:54:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-cb634dc8-83eb-4e5a-93c8-c7962a8b5f90 req-7805c671-3e8f-44c5-a1ce-7b43a5e667e2 service nova] Acquiring lock "863f0679-c64c-4a13-8028-4cb194f8f99f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:54:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-cb634dc8-83eb-4e5a-93c8-c7962a8b5f90 req-7805c671-3e8f-44c5-a1ce-7b43a5e667e2 service nova] Lock "863f0679-c64c-4a13-8028-4cb194f8f99f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:54:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-cb634dc8-83eb-4e5a-93c8-c7962a8b5f90 req-7805c671-3e8f-44c5-a1ce-7b43a5e667e2 service nova] Lock "863f0679-c64c-4a13-8028-4cb194f8f99f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:54:13 user nova-compute[72444]: DEBUG nova.compute.manager [req-cb634dc8-83eb-4e5a-93c8-c7962a8b5f90 req-7805c671-3e8f-44c5-a1ce-7b43a5e667e2 service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] No waiting events found dispatching network-vif-plugged-74465661-452c-4dba-b207-94f35c3fa50d {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:54:13 user nova-compute[72444]: WARNING nova.compute.manager [req-cb634dc8-83eb-4e5a-93c8-c7962a8b5f90 req-7805c671-3e8f-44c5-a1ce-7b43a5e667e2 service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Received unexpected event network-vif-plugged-74465661-452c-4dba-b207-94f35c3fa50d for instance with vm_state active and task_state rescuing.
Aug 03 04:54:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:15 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Removed pending event for 863f0679-c64c-4a13-8028-4cb194f8f99f due to event {{(pid=72444) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 03 04:54:15 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038455.3060412, 863f0679-c64c-4a13-8028-4cb194f8f99f => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:54:15 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] VM Resumed (Lifecycle Event)
Aug 03 04:54:15 user nova-compute[72444]: DEBUG nova.compute.manager [None req-58e943ca-ac79-4024-9510-d9ce85550dcc tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:54:15 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:54:15 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:54:15 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 03 04:54:15 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038455.3107097, 863f0679-c64c-4a13-8028-4cb194f8f99f => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:54:15 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] VM Started (Lifecycle Event)
Aug 03 04:54:15 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:54:15 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:54:15 user nova-compute[72444]: DEBUG nova.compute.manager [req-e01f183e-c3af-4f30-a90c-d466c51f42be req-96765daf-8a09-4adf-a64b-b4e8246ecaac service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Received event network-vif-plugged-74465661-452c-4dba-b207-94f35c3fa50d {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:54:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e01f183e-c3af-4f30-a90c-d466c51f42be req-96765daf-8a09-4adf-a64b-b4e8246ecaac service nova] Acquiring lock "863f0679-c64c-4a13-8028-4cb194f8f99f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:54:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e01f183e-c3af-4f30-a90c-d466c51f42be req-96765daf-8a09-4adf-a64b-b4e8246ecaac service nova] Lock "863f0679-c64c-4a13-8028-4cb194f8f99f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:54:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e01f183e-c3af-4f30-a90c-d466c51f42be req-96765daf-8a09-4adf-a64b-b4e8246ecaac service nova] Lock "863f0679-c64c-4a13-8028-4cb194f8f99f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:54:15 user nova-compute[72444]: DEBUG nova.compute.manager [req-e01f183e-c3af-4f30-a90c-d466c51f42be req-96765daf-8a09-4adf-a64b-b4e8246ecaac service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] No waiting events found dispatching network-vif-plugged-74465661-452c-4dba-b207-94f35c3fa50d {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:54:15 user nova-compute[72444]: WARNING nova.compute.manager [req-e01f183e-c3af-4f30-a90c-d466c51f42be req-96765daf-8a09-4adf-a64b-b4e8246ecaac service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Received unexpected event network-vif-plugged-74465661-452c-4dba-b207-94f35c3fa50d for instance with vm_state rescued and task_state None.
Aug 03 04:54:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:19 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691038444.99397, 0214a998-5624-46f9-801e-c582b4a297e5 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:54:19 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] VM Stopped (Lifecycle Event)
Aug 03 04:54:20 user nova-compute[72444]: DEBUG nova.compute.manager [None req-d47e2ede-7d3b-4d12-828c-fb6a882236cf None None] [instance: 0214a998-5624-46f9-801e-c582b4a297e5] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:54:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:29 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:35 user nova-compute[72444]: DEBUG nova.compute.manager [req-234ecdcd-e09d-4183-b1c4-d758c6c8a41e req-55acc1d9-253d-496f-8282-6e50c654aa4d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-changed-4015917d-392d-4101-a347-15b1a37dc252 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:54:35 user nova-compute[72444]: DEBUG nova.compute.manager [req-234ecdcd-e09d-4183-b1c4-d758c6c8a41e req-55acc1d9-253d-496f-8282-6e50c654aa4d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Refreshing instance network info cache due to event network-changed-4015917d-392d-4101-a347-15b1a37dc252. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:54:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-234ecdcd-e09d-4183-b1c4-d758c6c8a41e req-55acc1d9-253d-496f-8282-6e50c654aa4d service nova] Acquiring lock "refresh_cache-c5b50062-b965-4686-beea-63537d9f1eda" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:54:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-234ecdcd-e09d-4183-b1c4-d758c6c8a41e req-55acc1d9-253d-496f-8282-6e50c654aa4d service nova] Acquired lock "refresh_cache-c5b50062-b965-4686-beea-63537d9f1eda" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:54:35 user nova-compute[72444]: DEBUG nova.network.neutron [req-234ecdcd-e09d-4183-b1c4-d758c6c8a41e req-55acc1d9-253d-496f-8282-6e50c654aa4d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Refreshing network info cache for port 4015917d-392d-4101-a347-15b1a37dc252 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:54:36 user nova-compute[72444]: DEBUG nova.network.neutron [req-234ecdcd-e09d-4183-b1c4-d758c6c8a41e req-55acc1d9-253d-496f-8282-6e50c654aa4d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Updated VIF entry in instance network info cache for port 4015917d-392d-4101-a347-15b1a37dc252. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:54:36 user nova-compute[72444]: DEBUG nova.network.neutron [req-234ecdcd-e09d-4183-b1c4-d758c6c8a41e req-55acc1d9-253d-496f-8282-6e50c654aa4d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Updating instance_info_cache with network_info: [{"id": "4015917d-392d-4101-a347-15b1a37dc252", "address": "fa:16:3e:2f:8b:e3", "network": {"id": "0dfdee8f-99ee-4369-af46-a2f1d097cf8c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-316229813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4015917d-39", "ovs_interfaceid": "4015917d-392d-4101-a347-15b1a37dc252", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "978bd88d-0401-4456-b332-7494cbebe1f2", "address": "fa:16:3e:66:09:aa", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap978bd88d-04", "ovs_interfaceid": "978bd88d-0401-4456-b332-7494cbebe1f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "98143be5-d207-4206-a9fb-39bd8b05822e", "address": "fa:16:3e:68:a8:5f", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98143be5-d2", "ovs_interfaceid": "98143be5-d207-4206-a9fb-39bd8b05822e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fe941d99-e8f6-42bd-939e-d2955caed33d", "address": "fa:16:3e:94:2f:3a", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe941d99-e8", "ovs_interfaceid": "fe941d99-e8f6-42bd-939e-d2955caed33d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "df356454-4b89-4b15-955c-6d4d41688490", "address": "fa:16:3e:5d:b1:8b", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf356454-4b", "ovs_interfaceid": "df356454-4b89-4b15-955c-6d4d41688490", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6e47393c-8b6c-4008-a802-8a728b3a7a6c", "address": "fa:16:3e:1d:3a:74", "network": {"id": "bc31bf9c-5e34-4a68-91e8-6a79eb2e0cdf", "bridge": "br-int", "label": "tempest-device-tagging-net2-117214369", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e47393c-8b", "ovs_interfaceid": "6e47393c-8b6c-4008-a802-8a728b3a7a6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9fb86964-076c-439e-84fa-7893c15e8871", "address": "fa:16:3e:5b:33:4e", "network": {"id": "bc31bf9c-5e34-4a68-91e8-6a79eb2e0cdf", "bridge": "br-int", "label": "tempest-device-tagging-net2-117214369", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb86964-07", "ovs_interfaceid": "9fb86964-076c-439e-84fa-7893c15e8871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:54:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-234ecdcd-e09d-4183-b1c4-d758c6c8a41e req-55acc1d9-253d-496f-8282-6e50c654aa4d service nova] Releasing lock "refresh_cache-c5b50062-b965-4686-beea-63537d9f1eda" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:54:37 user nova-compute[72444]: DEBUG nova.compute.manager [req-5b9e66a9-c406-496a-bf49-7d37feb104e3 req-7d93f61d-dc5b-4427-ae39-13f1f6172d0c service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Received event network-changed-7a41fc62-2272-4198-99cb-19d77d1dc193 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:54:37 user nova-compute[72444]: DEBUG nova.compute.manager [req-5b9e66a9-c406-496a-bf49-7d37feb104e3 req-7d93f61d-dc5b-4427-ae39-13f1f6172d0c service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Refreshing instance network info cache due to event network-changed-7a41fc62-2272-4198-99cb-19d77d1dc193. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:54:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5b9e66a9-c406-496a-bf49-7d37feb104e3 req-7d93f61d-dc5b-4427-ae39-13f1f6172d0c service nova] Acquiring lock "refresh_cache-27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:54:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5b9e66a9-c406-496a-bf49-7d37feb104e3 req-7d93f61d-dc5b-4427-ae39-13f1f6172d0c service nova] Acquired lock "refresh_cache-27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:54:37 user nova-compute[72444]: DEBUG nova.network.neutron [req-5b9e66a9-c406-496a-bf49-7d37feb104e3 req-7d93f61d-dc5b-4427-ae39-13f1f6172d0c service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Refreshing network info cache for port 7a41fc62-2272-4198-99cb-19d77d1dc193 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:54:38 user nova-compute[72444]: DEBUG nova.compute.manager [None req-ab5fb669-7ab6-444b-aa26-15170d5e9991 tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:54:38 user nova-compute[72444]: DEBUG nova.network.neutron [req-5b9e66a9-c406-496a-bf49-7d37feb104e3 req-7d93f61d-dc5b-4427-ae39-13f1f6172d0c service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Updated VIF entry in instance network info cache for port 7a41fc62-2272-4198-99cb-19d77d1dc193. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:54:38 user nova-compute[72444]: DEBUG nova.network.neutron [req-5b9e66a9-c406-496a-bf49-7d37feb104e3 req-7d93f61d-dc5b-4427-ae39-13f1f6172d0c service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Updating instance_info_cache with network_info: [{"id": "7a41fc62-2272-4198-99cb-19d77d1dc193", "address": "fa:16:3e:68:ec:25", "network": {"id": "d132f1d9-d7bd-4630-bd3d-e911f43d14bb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1090455023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08ed53988ee44a081db4223ad0a9264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a41fc62-22", "ovs_interfaceid": "7a41fc62-2272-4198-99cb-19d77d1dc193", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:54:38 user nova-compute[72444]: INFO nova.compute.manager [None req-ab5fb669-7ab6-444b-aa26-15170d5e9991 tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] instance snapshotting
Aug 03 04:54:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5b9e66a9-c406-496a-bf49-7d37feb104e3 req-7d93f61d-dc5b-4427-ae39-13f1f6172d0c service nova] Releasing lock "refresh_cache-27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:54:38 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-ab5fb669-7ab6-444b-aa26-15170d5e9991 tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Beginning live snapshot process
Aug 03 04:54:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Acquiring lock "c5b50062-b965-4686-beea-63537d9f1eda" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:54:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Lock "c5b50062-b965-4686-beea-63537d9f1eda" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:54:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Acquiring lock "c5b50062-b965-4686-beea-63537d9f1eda-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:54:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:54:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:54:38 user nova-compute[72444]: INFO nova.compute.manager [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Terminating instance
Aug 03 04:54:38 user nova-compute[72444]: DEBUG nova.compute.manager [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 04:54:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-ab5fb669-7ab6-444b-aa26-15170d5e9991 tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk --force-share --output=json -f qcow2 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-ab5fb669-7ab6-444b-aa26-15170d5e9991 tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk --force-share --output=json -f qcow2" returned: 0 in 0.147s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-ab5fb669-7ab6-444b-aa26-15170d5e9991 tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk --force-share --output=json -f qcow2 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-ab5fb669-7ab6-444b-aa26-15170d5e9991 tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk --force-share --output=json -f qcow2" returned: 0 in 0.153s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-ab5fb669-7ab6-444b-aa26-15170d5e9991 tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:39 user nova-compute[72444]: DEBUG nova.compute.manager [req-796afda6-7c2d-40de-92ff-11ad049ff8f7 req-3746e7a0-3248-4ef9-8884-05b556bf49e4 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-unplugged-978bd88d-0401-4456-b332-7494cbebe1f2 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:54:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-796afda6-7c2d-40de-92ff-11ad049ff8f7 req-3746e7a0-3248-4ef9-8884-05b556bf49e4 service nova] Acquiring lock "c5b50062-b965-4686-beea-63537d9f1eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:54:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-796afda6-7c2d-40de-92ff-11ad049ff8f7 req-3746e7a0-3248-4ef9-8884-05b556bf49e4 service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:54:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-796afda6-7c2d-40de-92ff-11ad049ff8f7 req-3746e7a0-3248-4ef9-8884-05b556bf49e4 service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:54:39 user nova-compute[72444]: DEBUG nova.compute.manager [req-796afda6-7c2d-40de-92ff-11ad049ff8f7 req-3746e7a0-3248-4ef9-8884-05b556bf49e4 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] No waiting events found dispatching network-vif-unplugged-978bd88d-0401-4456-b332-7494cbebe1f2 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:54:39 user nova-compute[72444]: DEBUG nova.compute.manager [req-796afda6-7c2d-40de-92ff-11ad049ff8f7 req-3746e7a0-3248-4ef9-8884-05b556bf49e4 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-unplugged-978bd88d-0401-4456-b332-7494cbebe1f2 for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:54:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-ab5fb669-7ab6-444b-aa26-15170d5e9991 tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.153s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-ab5fb669-7ab6-444b-aa26-15170d5e9991 tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpivea152t/1775e14f8c15439d949b7eaa7047fafd.delta 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-ab5fb669-7ab6-444b-aa26-15170d5e9991 tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpivea152t/1775e14f8c15439d949b7eaa7047fafd.delta 1073741824" returned: 0 in 0.058s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:39 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-ab5fb669-7ab6-444b-aa26-15170d5e9991 tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 03 04:54:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:39 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-ab5fb669-7ab6-444b-aa26-15170d5e9991 tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72444) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG nova.compute.manager [req-7b1ee55d-37ee-48b4-be54-2bc2701cd41c req-1a3504ba-118f-40a6-96a8-19fb286a94d0 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-unplugged-4015917d-392d-4101-a347-15b1a37dc252 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7b1ee55d-37ee-48b4-be54-2bc2701cd41c req-1a3504ba-118f-40a6-96a8-19fb286a94d0 service nova] Acquiring lock "c5b50062-b965-4686-beea-63537d9f1eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7b1ee55d-37ee-48b4-be54-2bc2701cd41c req-1a3504ba-118f-40a6-96a8-19fb286a94d0 service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7b1ee55d-37ee-48b4-be54-2bc2701cd41c req-1a3504ba-118f-40a6-96a8-19fb286a94d0 service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG nova.compute.manager [req-7b1ee55d-37ee-48b4-be54-2bc2701cd41c req-1a3504ba-118f-40a6-96a8-19fb286a94d0 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] No waiting events found dispatching network-vif-unplugged-4015917d-392d-4101-a347-15b1a37dc252 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG nova.compute.manager [req-7b1ee55d-37ee-48b4-be54-2bc2701cd41c req-1a3504ba-118f-40a6-96a8-19fb286a94d0 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-unplugged-4015917d-392d-4101-a347-15b1a37dc252 for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG nova.compute.manager [req-7b1ee55d-37ee-48b4-be54-2bc2701cd41c req-1a3504ba-118f-40a6-96a8-19fb286a94d0 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-plugged-4015917d-392d-4101-a347-15b1a37dc252 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7b1ee55d-37ee-48b4-be54-2bc2701cd41c req-1a3504ba-118f-40a6-96a8-19fb286a94d0 service nova] Acquiring lock "c5b50062-b965-4686-beea-63537d9f1eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7b1ee55d-37ee-48b4-be54-2bc2701cd41c req-1a3504ba-118f-40a6-96a8-19fb286a94d0 service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7b1ee55d-37ee-48b4-be54-2bc2701cd41c req-1a3504ba-118f-40a6-96a8-19fb286a94d0 service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG nova.compute.manager [req-7b1ee55d-37ee-48b4-be54-2bc2701cd41c req-1a3504ba-118f-40a6-96a8-19fb286a94d0 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] No waiting events found dispatching network-vif-plugged-4015917d-392d-4101-a347-15b1a37dc252 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:54:40 user nova-compute[72444]: WARNING nova.compute.manager [req-7b1ee55d-37ee-48b4-be54-2bc2701cd41c req-1a3504ba-118f-40a6-96a8-19fb286a94d0 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received unexpected event network-vif-plugged-4015917d-392d-4101-a347-15b1a37dc252 for instance with vm_state active and task_state deleting.
Aug 03 04:54:40 user nova-compute[72444]: DEBUG nova.compute.manager [req-7b1ee55d-37ee-48b4-be54-2bc2701cd41c req-1a3504ba-118f-40a6-96a8-19fb286a94d0 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-unplugged-98143be5-d207-4206-a9fb-39bd8b05822e {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7b1ee55d-37ee-48b4-be54-2bc2701cd41c req-1a3504ba-118f-40a6-96a8-19fb286a94d0 service nova] Acquiring lock "c5b50062-b965-4686-beea-63537d9f1eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7b1ee55d-37ee-48b4-be54-2bc2701cd41c req-1a3504ba-118f-40a6-96a8-19fb286a94d0 service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7b1ee55d-37ee-48b4-be54-2bc2701cd41c req-1a3504ba-118f-40a6-96a8-19fb286a94d0 service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG nova.compute.manager [req-7b1ee55d-37ee-48b4-be54-2bc2701cd41c req-1a3504ba-118f-40a6-96a8-19fb286a94d0 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] No waiting events found dispatching network-vif-unplugged-98143be5-d207-4206-a9fb-39bd8b05822e {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG nova.compute.manager [req-7b1ee55d-37ee-48b4-be54-2bc2701cd41c req-1a3504ba-118f-40a6-96a8-19fb286a94d0 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-unplugged-98143be5-d207-4206-a9fb-39bd8b05822e for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG nova.compute.manager [req-7b1ee55d-37ee-48b4-be54-2bc2701cd41c req-1a3504ba-118f-40a6-96a8-19fb286a94d0 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-plugged-98143be5-d207-4206-a9fb-39bd8b05822e {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7b1ee55d-37ee-48b4-be54-2bc2701cd41c req-1a3504ba-118f-40a6-96a8-19fb286a94d0 service nova] Acquiring lock "c5b50062-b965-4686-beea-63537d9f1eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7b1ee55d-37ee-48b4-be54-2bc2701cd41c req-1a3504ba-118f-40a6-96a8-19fb286a94d0 service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7b1ee55d-37ee-48b4-be54-2bc2701cd41c req-1a3504ba-118f-40a6-96a8-19fb286a94d0 service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG nova.compute.manager [req-7b1ee55d-37ee-48b4-be54-2bc2701cd41c req-1a3504ba-118f-40a6-96a8-19fb286a94d0 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] No waiting events found dispatching network-vif-plugged-98143be5-d207-4206-a9fb-39bd8b05822e {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:54:40 user nova-compute[72444]: WARNING nova.compute.manager [req-7b1ee55d-37ee-48b4-be54-2bc2701cd41c req-1a3504ba-118f-40a6-96a8-19fb286a94d0 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received unexpected event network-vif-plugged-98143be5-d207-4206-a9fb-39bd8b05822e for instance with vm_state active and task_state deleting.
Aug 03 04:54:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-ab5fb669-7ab6-444b-aa26-15170d5e9991 tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72444) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 03 04:54:40 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-ab5fb669-7ab6-444b-aa26-15170d5e9991 tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 03 04:54:40 user nova-compute[72444]: DEBUG nova.privsep.utils [None req-ab5fb669-7ab6-444b-aa26-15170d5e9991 tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72444) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-ab5fb669-7ab6-444b-aa26-15170d5e9991 tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpivea152t/1775e14f8c15439d949b7eaa7047fafd.delta /opt/stack/data/nova/instances/snapshots/tmpivea152t/1775e14f8c15439d949b7eaa7047fafd {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:40 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Instance destroyed successfully.
Aug 03 04:54:40 user nova-compute[72444]: DEBUG nova.objects.instance [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Lazy-loading 'resources' on Instance uuid c5b50062-b965-4686-beea-63537d9f1eda {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:52:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886858126',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886858126',id=29,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEInirpvC4T4EdVFVkrmObaHSSQyMUS/rI7EInKwyhK/lVP4Oj5AshO1QG8VPfD8Cs8eUr/uW0SLnoCIQ2vo52oAp/pq83mxnKrpxML5Ej9Ks6sFH7wB/rHNb5zZc9Ogg==',key_name='tempest-keypair-1178417223',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:53:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c053965223cd48eab71fe19c2dcb3856',ramdisk_id='',reservation_id='r-xesres5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1604326291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1604326291-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:53:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26901807745b4c748dd3358068d07983',uuid=c5b50062-b965-4686-beea-63537d9f1eda,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4015917d-392d-4101-a347-15b1a37dc252", "address": "fa:16:3e:2f:8b:e3", "network": {"id": "0dfdee8f-99ee-4369-af46-a2f1d097cf8c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-316229813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4015917d-39", "ovs_interfaceid": "4015917d-392d-4101-a347-15b1a37dc252", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converting VIF {"id": "4015917d-392d-4101-a347-15b1a37dc252", "address": "fa:16:3e:2f:8b:e3", "network": {"id": "0dfdee8f-99ee-4369-af46-a2f1d097cf8c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-316229813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4015917d-39", "ovs_interfaceid": "4015917d-392d-4101-a347-15b1a37dc252", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:8b:e3,bridge_name='br-int',has_traffic_filtering=True,id=4015917d-392d-4101-a347-15b1a37dc252,network=Network(0dfdee8f-99ee-4369-af46-a2f1d097cf8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4015917d-39') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG os_vif [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:8b:e3,bridge_name='br-int',has_traffic_filtering=True,id=4015917d-392d-4101-a347-15b1a37dc252,network=Network(0dfdee8f-99ee-4369-af46-a2f1d097cf8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4015917d-39') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4015917d-39, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:40 user nova-compute[72444]: INFO os_vif [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:8b:e3,bridge_name='br-int',has_traffic_filtering=True,id=4015917d-392d-4101-a347-15b1a37dc252,network=Network(0dfdee8f-99ee-4369-af46-a2f1d097cf8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4015917d-39')
Aug 03 04:54:40 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:52:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886858126',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886858126',id=29,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEInirpvC4T4EdVFVkrmObaHSSQyMUS/rI7EInKwyhK/lVP4Oj5AshO1QG8VPfD8Cs8eUr/uW0SLnoCIQ2vo52oAp/pq83mxnKrpxML5Ej9Ks6sFH7wB/rHNb5zZc9Ogg==',key_name='tempest-keypair-1178417223',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:53:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c053965223cd48eab71fe19c2dcb3856',ramdisk_id='',reservation_id='r-xesres5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1604326291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1604326291-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:53:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26901807745b4c748dd3358068d07983',uuid=c5b50062-b965-4686-beea-63537d9f1eda,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "978bd88d-0401-4456-b332-7494cbebe1f2", "address": "fa:16:3e:66:09:aa", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap978bd88d-04", "ovs_interfaceid": "978bd88d-0401-4456-b332-7494cbebe1f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converting VIF {"id": "978bd88d-0401-4456-b332-7494cbebe1f2", "address": "fa:16:3e:66:09:aa", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap978bd88d-04", "ovs_interfaceid": "978bd88d-0401-4456-b332-7494cbebe1f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:09:aa,bridge_name='br-int',has_traffic_filtering=True,id=978bd88d-0401-4456-b332-7494cbebe1f2,network=Network(24f0a98a-4787-4d04-a606-bad6281d2fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap978bd88d-04') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG os_vif [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:09:aa,bridge_name='br-int',has_traffic_filtering=True,id=978bd88d-0401-4456-b332-7494cbebe1f2,network=Network(24f0a98a-4787-4d04-a606-bad6281d2fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap978bd88d-04') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap978bd88d-04, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:40 user nova-compute[72444]: INFO os_vif [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:09:aa,bridge_name='br-int',has_traffic_filtering=True,id=978bd88d-0401-4456-b332-7494cbebe1f2,network=Network(24f0a98a-4787-4d04-a606-bad6281d2fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap978bd88d-04')
Aug 03 04:54:40 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:52:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886858126',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886858126',id=29,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEInirpvC4T4EdVFVkrmObaHSSQyMUS/rI7EInKwyhK/lVP4Oj5AshO1QG8VPfD8Cs8eUr/uW0SLnoCIQ2vo52oAp/pq83mxnKrpxML5Ej9Ks6sFH7wB/rHNb5zZc9Ogg==',key_name='tempest-keypair-1178417223',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:53:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c053965223cd48eab71fe19c2dcb3856',ramdisk_id='',reservation_id='r-xesres5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1604326291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1604326291-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:53:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26901807745b4c748dd3358068d07983',uuid=c5b50062-b965-4686-beea-63537d9f1eda,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98143be5-d207-4206-a9fb-39bd8b05822e", "address": "fa:16:3e:68:a8:5f", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98143be5-d2", "ovs_interfaceid": "98143be5-d207-4206-a9fb-39bd8b05822e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converting VIF {"id": "98143be5-d207-4206-a9fb-39bd8b05822e", "address": "fa:16:3e:68:a8:5f", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98143be5-d2", "ovs_interfaceid": "98143be5-d207-4206-a9fb-39bd8b05822e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:a8:5f,bridge_name='br-int',has_traffic_filtering=True,id=98143be5-d207-4206-a9fb-39bd8b05822e,network=Network(24f0a98a-4787-4d04-a606-bad6281d2fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap98143be5-d2') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG os_vif [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:a8:5f,bridge_name='br-int',has_traffic_filtering=True,id=98143be5-d207-4206-a9fb-39bd8b05822e,network=Network(24f0a98a-4787-4d04-a606-bad6281d2fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap98143be5-d2') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98143be5-d2, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG nova.compute.manager [req-647217ea-9a66-4d57-ad53-4bac441efaca req-7cf8f62a-61e5-49f5-82da-16eea95f888e service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-plugged-978bd88d-0401-4456-b332-7494cbebe1f2 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-647217ea-9a66-4d57-ad53-4bac441efaca req-7cf8f62a-61e5-49f5-82da-16eea95f888e service nova] Acquiring lock "c5b50062-b965-4686-beea-63537d9f1eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-647217ea-9a66-4d57-ad53-4bac441efaca req-7cf8f62a-61e5-49f5-82da-16eea95f888e service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-647217ea-9a66-4d57-ad53-4bac441efaca req-7cf8f62a-61e5-49f5-82da-16eea95f888e service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG nova.compute.manager [req-647217ea-9a66-4d57-ad53-4bac441efaca req-7cf8f62a-61e5-49f5-82da-16eea95f888e service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] No waiting events found dispatching network-vif-plugged-978bd88d-0401-4456-b332-7494cbebe1f2 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:54:41 user nova-compute[72444]: WARNING nova.compute.manager [req-647217ea-9a66-4d57-ad53-4bac441efaca req-7cf8f62a-61e5-49f5-82da-16eea95f888e service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received unexpected event network-vif-plugged-978bd88d-0401-4456-b332-7494cbebe1f2 for instance with vm_state active and task_state deleting.
Aug 03 04:54:41 user nova-compute[72444]: DEBUG nova.compute.manager [req-647217ea-9a66-4d57-ad53-4bac441efaca req-7cf8f62a-61e5-49f5-82da-16eea95f888e service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-unplugged-fe941d99-e8f6-42bd-939e-d2955caed33d {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-647217ea-9a66-4d57-ad53-4bac441efaca req-7cf8f62a-61e5-49f5-82da-16eea95f888e service nova] Acquiring lock "c5b50062-b965-4686-beea-63537d9f1eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-647217ea-9a66-4d57-ad53-4bac441efaca req-7cf8f62a-61e5-49f5-82da-16eea95f888e service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-647217ea-9a66-4d57-ad53-4bac441efaca req-7cf8f62a-61e5-49f5-82da-16eea95f888e service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG nova.compute.manager [req-647217ea-9a66-4d57-ad53-4bac441efaca req-7cf8f62a-61e5-49f5-82da-16eea95f888e service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] No waiting events found dispatching network-vif-unplugged-fe941d99-e8f6-42bd-939e-d2955caed33d {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG nova.compute.manager [req-647217ea-9a66-4d57-ad53-4bac441efaca req-7cf8f62a-61e5-49f5-82da-16eea95f888e service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-unplugged-fe941d99-e8f6-42bd-939e-d2955caed33d for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG nova.compute.manager [req-647217ea-9a66-4d57-ad53-4bac441efaca req-7cf8f62a-61e5-49f5-82da-16eea95f888e service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-plugged-fe941d99-e8f6-42bd-939e-d2955caed33d {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-647217ea-9a66-4d57-ad53-4bac441efaca req-7cf8f62a-61e5-49f5-82da-16eea95f888e service nova] Acquiring lock "c5b50062-b965-4686-beea-63537d9f1eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-647217ea-9a66-4d57-ad53-4bac441efaca req-7cf8f62a-61e5-49f5-82da-16eea95f888e service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-647217ea-9a66-4d57-ad53-4bac441efaca req-7cf8f62a-61e5-49f5-82da-16eea95f888e service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG nova.compute.manager [req-647217ea-9a66-4d57-ad53-4bac441efaca req-7cf8f62a-61e5-49f5-82da-16eea95f888e service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] No waiting events found dispatching network-vif-plugged-fe941d99-e8f6-42bd-939e-d2955caed33d {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:54:41 user nova-compute[72444]: WARNING nova.compute.manager [req-647217ea-9a66-4d57-ad53-4bac441efaca req-7cf8f62a-61e5-49f5-82da-16eea95f888e service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received unexpected event network-vif-plugged-fe941d99-e8f6-42bd-939e-d2955caed33d for instance with vm_state active and task_state deleting.
Aug 03 04:54:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:41 user nova-compute[72444]: INFO os_vif [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:a8:5f,bridge_name='br-int',has_traffic_filtering=True,id=98143be5-d207-4206-a9fb-39bd8b05822e,network=Network(24f0a98a-4787-4d04-a606-bad6281d2fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap98143be5-d2')
Aug 03 04:54:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:52:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886858126',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886858126',id=29,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEInirpvC4T4EdVFVkrmObaHSSQyMUS/rI7EInKwyhK/lVP4Oj5AshO1QG8VPfD8Cs8eUr/uW0SLnoCIQ2vo52oAp/pq83mxnKrpxML5Ej9Ks6sFH7wB/rHNb5zZc9Ogg==',key_name='tempest-keypair-1178417223',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:53:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c053965223cd48eab71fe19c2dcb3856',ramdisk_id='',reservation_id='r-xesres5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1604326291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1604326291-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:53:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26901807745b4c748dd3358068d07983',uuid=c5b50062-b965-4686-beea-63537d9f1eda,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe941d99-e8f6-42bd-939e-d2955caed33d", "address": "fa:16:3e:94:2f:3a", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe941d99-e8", "ovs_interfaceid": "fe941d99-e8f6-42bd-939e-d2955caed33d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converting VIF {"id": "fe941d99-e8f6-42bd-939e-d2955caed33d", "address": "fa:16:3e:94:2f:3a", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe941d99-e8", "ovs_interfaceid": "fe941d99-e8f6-42bd-939e-d2955caed33d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:2f:3a,bridge_name='br-int',has_traffic_filtering=True,id=fe941d99-e8f6-42bd-939e-d2955caed33d,network=Network(24f0a98a-4787-4d04-a606-bad6281d2fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe941d99-e8') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_vif [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:2f:3a,bridge_name='br-int',has_traffic_filtering=True,id=fe941d99-e8f6-42bd-939e-d2955caed33d,network=Network(24f0a98a-4787-4d04-a606-bad6281d2fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe941d99-e8') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe941d99-e8, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:41 user nova-compute[72444]: INFO os_vif [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:2f:3a,bridge_name='br-int',has_traffic_filtering=True,id=fe941d99-e8f6-42bd-939e-d2955caed33d,network=Network(24f0a98a-4787-4d04-a606-bad6281d2fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe941d99-e8')
Aug 03 04:54:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:52:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886858126',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886858126',id=29,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEInirpvC4T4EdVFVkrmObaHSSQyMUS/rI7EInKwyhK/lVP4Oj5AshO1QG8VPfD8Cs8eUr/uW0SLnoCIQ2vo52oAp/pq83mxnKrpxML5Ej9Ks6sFH7wB/rHNb5zZc9Ogg==',key_name='tempest-keypair-1178417223',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:53:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c053965223cd48eab71fe19c2dcb3856',ramdisk_id='',reservation_id='r-xesres5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1604326291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1604326291-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:53:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26901807745b4c748dd3358068d07983',uuid=c5b50062-b965-4686-beea-63537d9f1eda,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df356454-4b89-4b15-955c-6d4d41688490", "address": "fa:16:3e:5d:b1:8b", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf356454-4b", "ovs_interfaceid": "df356454-4b89-4b15-955c-6d4d41688490", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converting VIF {"id": "df356454-4b89-4b15-955c-6d4d41688490", "address": "fa:16:3e:5d:b1:8b", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf356454-4b", "ovs_interfaceid": "df356454-4b89-4b15-955c-6d4d41688490", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b1:8b,bridge_name='br-int',has_traffic_filtering=True,id=df356454-4b89-4b15-955c-6d4d41688490,network=Network(24f0a98a-4787-4d04-a606-bad6281d2fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf356454-4b') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_vif [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b1:8b,bridge_name='br-int',has_traffic_filtering=True,id=df356454-4b89-4b15-955c-6d4d41688490,network=Network(24f0a98a-4787-4d04-a606-bad6281d2fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf356454-4b') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf356454-4b, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:41 user nova-compute[72444]: INFO os_vif [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b1:8b,bridge_name='br-int',has_traffic_filtering=True,id=df356454-4b89-4b15-955c-6d4d41688490,network=Network(24f0a98a-4787-4d04-a606-bad6281d2fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf356454-4b')
Aug 03 04:54:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:52:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886858126',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886858126',id=29,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEInirpvC4T4EdVFVkrmObaHSSQyMUS/rI7EInKwyhK/lVP4Oj5AshO1QG8VPfD8Cs8eUr/uW0SLnoCIQ2vo52oAp/pq83mxnKrpxML5Ej9Ks6sFH7wB/rHNb5zZc9Ogg==',key_name='tempest-keypair-1178417223',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:53:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c053965223cd48eab71fe19c2dcb3856',ramdisk_id='',reservation_id='r-xesres5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1604326291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1604326291-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:53:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26901807745b4c748dd3358068d07983',uuid=c5b50062-b965-4686-beea-63537d9f1eda,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e47393c-8b6c-4008-a802-8a728b3a7a6c", "address": "fa:16:3e:1d:3a:74", "network": {"id": "bc31bf9c-5e34-4a68-91e8-6a79eb2e0cdf", "bridge": "br-int", "label": "tempest-device-tagging-net2-117214369", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e47393c-8b", "ovs_interfaceid": "6e47393c-8b6c-4008-a802-8a728b3a7a6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converting VIF {"id": "6e47393c-8b6c-4008-a802-8a728b3a7a6c", "address": "fa:16:3e:1d:3a:74", "network": {"id": "bc31bf9c-5e34-4a68-91e8-6a79eb2e0cdf", "bridge": "br-int", "label": "tempest-device-tagging-net2-117214369", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e47393c-8b", "ovs_interfaceid": "6e47393c-8b6c-4008-a802-8a728b3a7a6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:3a:74,bridge_name='br-int',has_traffic_filtering=True,id=6e47393c-8b6c-4008-a802-8a728b3a7a6c,network=Network(bc31bf9c-5e34-4a68-91e8-6a79eb2e0cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e47393c-8b') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_vif [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:3a:74,bridge_name='br-int',has_traffic_filtering=True,id=6e47393c-8b6c-4008-a802-8a728b3a7a6c,network=Network(bc31bf9c-5e34-4a68-91e8-6a79eb2e0cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e47393c-8b') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e47393c-8b, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-ab5fb669-7ab6-444b-aa26-15170d5e9991 tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpivea152t/1775e14f8c15439d949b7eaa7047fafd.delta /opt/stack/data/nova/instances/snapshots/tmpivea152t/1775e14f8c15439d949b7eaa7047fafd" returned: 0 in 0.568s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:41 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-ab5fb669-7ab6-444b-aa26-15170d5e9991 tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Snapshot extracted, beginning image upload
Aug 03 04:54:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:41 user nova-compute[72444]: INFO os_vif [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:3a:74,bridge_name='br-int',has_traffic_filtering=True,id=6e47393c-8b6c-4008-a802-8a728b3a7a6c,network=Network(bc31bf9c-5e34-4a68-91e8-6a79eb2e0cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e47393c-8b')
Aug 03 04:54:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-03T04:52:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886858126',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886858126',id=29,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEInirpvC4T4EdVFVkrmObaHSSQyMUS/rI7EInKwyhK/lVP4Oj5AshO1QG8VPfD8Cs8eUr/uW0SLnoCIQ2vo52oAp/pq83mxnKrpxML5Ej9Ks6sFH7wB/rHNb5zZc9Ogg==',key_name='tempest-keypair-1178417223',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:53:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c053965223cd48eab71fe19c2dcb3856',ramdisk_id='',reservation_id='r-xesres5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1604326291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1604326291-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:53:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26901807745b4c748dd3358068d07983',uuid=c5b50062-b965-4686-beea-63537d9f1eda,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9fb86964-076c-439e-84fa-7893c15e8871", "address": "fa:16:3e:5b:33:4e", "network": {"id": "bc31bf9c-5e34-4a68-91e8-6a79eb2e0cdf", "bridge": "br-int", "label": "tempest-device-tagging-net2-117214369", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb86964-07", "ovs_interfaceid": "9fb86964-076c-439e-84fa-7893c15e8871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converting VIF {"id": "9fb86964-076c-439e-84fa-7893c15e8871", "address": "fa:16:3e:5b:33:4e", "network": {"id": "bc31bf9c-5e34-4a68-91e8-6a79eb2e0cdf", "bridge": "br-int", "label": "tempest-device-tagging-net2-117214369", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb86964-07", "ovs_interfaceid": "9fb86964-076c-439e-84fa-7893c15e8871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:33:4e,bridge_name='br-int',has_traffic_filtering=True,id=9fb86964-076c-439e-84fa-7893c15e8871,network=Network(bc31bf9c-5e34-4a68-91e8-6a79eb2e0cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb86964-07') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_vif [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:33:4e,bridge_name='br-int',has_traffic_filtering=True,id=9fb86964-076c-439e-84fa-7893c15e8871,network=Network(bc31bf9c-5e34-4a68-91e8-6a79eb2e0cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb86964-07') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9fb86964-07, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:41 user nova-compute[72444]: INFO os_vif [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:33:4e,bridge_name='br-int',has_traffic_filtering=True,id=9fb86964-076c-439e-84fa-7893c15e8871,network=Network(bc31bf9c-5e34-4a68-91e8-6a79eb2e0cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb86964-07')
Aug 03 04:54:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wMfbvstS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:54:41 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[272b0711-5f4c-4249-9142-80a0715b1f13]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9b2fbc-18ff-4d7a-926e-ac4ae6839d38]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:54:41 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:54:41 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:54:41 user nova-compute[72444]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)
Aug 03 04:54:41 user nova-compute[72444]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)
Aug 03 04:54:41 user nova-compute[72444]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)
Aug 03 04:54:41 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:54:41 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:54:41 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:54:41 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:54:41 user nova-compute[72444]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 (non-flash)
Aug 03 04:54:41 user nova-compute[72444]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)
Aug 03 04:54:41 user nova-compute[72444]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)
Aug 03 04:54:41 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:54:41 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30941d5d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727'): ({'sdc'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Removing single pathed devices sdc {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[852d6dfb-d8f9-4763-b779-6896ace4c90b]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7753a6f2-f295-4e4f-8ece-7462458e0752]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Flushing IO for device /dev/sdc {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1235cf48-c1da-431f-b721-2c2b91d1aa30]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7b2e7f-a60c-4106-bcd9-e253fa4b6bd1]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] SCSI volumes sdc have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33d7c22-395f-4573-99ad-158011c408ec]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e94f3a8-439c-4945-b093-32d8c68ae118]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727, portal: 172.16.0.220,3260]
Aug 03 04:54:41 user nova-compute[72444]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727, portal: 172.16.0.220,3260] successful.
Aug 03 04:54:41 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d99161a6-916a-44e5-8815-0f0df9d29727 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e3eb2a-f61c-4975-a34a-840dcd97f2bf]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] <== disconnect_volume: return (323ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YPiDSpjI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:54:41 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[635fa96d-a310-4ed4-928b-5e94f0baa47b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1220b33-eace-434c-8e8f-5a4a0b25f4ed]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:54:41 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:54:41 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:54:41 user nova-compute[72444]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)
Aug 03 04:54:41 user nova-compute[72444]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)
Aug 03 04:54:41 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:54:41 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:54:41 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:54:41 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:54:41 user nova-compute[72444]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 (non-flash)
Aug 03 04:54:41 user nova-compute[72444]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)
Aug 03 04:54:41 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:54:41 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3094305bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55'): ({'sdg'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Removing single pathed devices sdg {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e875bb7-404d-4c56-8491-b308b2e6b33a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2775c01-d8c3-4365-8aab-32effa1bb256]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Flushing IO for device /dev/sdg {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[96868b02-6986-4aba-940e-278d50501d4f]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.055s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed625a1-7cd8-4776-9c82-ae470fa57e21]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] SCSI volumes sdg have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7c7f03-73dd-48f6-98a7-02e23883993f]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdaab7c-17e4-4a61-b8a4-ffe3c15594d6]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55, portal: 172.16.0.220,3260]
Aug 03 04:54:41 user nova-compute[72444]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55, portal: 172.16.0.220,3260] successful.
Aug 03 04:54:41 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b58f424-a14b-4c41-8991-fa4fa11d7e55 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3f4d06-c45e-4408-b591-399c9db101a9]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] <== disconnect_volume: return (314ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'alKQHMOo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:54:41 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b9689b-047f-4e97-864d-33f86400e003]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8eede43-affd-4157-b32d-43cd9ff902d8]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:54:41 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:54:41 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:54:41 user nova-compute[72444]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)
Aug 03 04:54:41 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:54:41 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:54:41 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:54:41 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:54:41 user nova-compute[72444]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 (non-flash)
Aug 03 04:54:41 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:54:41 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3094305bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853'): ({'sdh'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Removing single pathed devices sdh {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01e5f4d-b02c-4060-940a-7e283b3689fd]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcc05a4-f508-46a9-b7a2-143fbf0a5fdb]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Flushing IO for device /dev/sdh {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a458b0c-6746-44af-b7fa-9fe268765ce0]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 04:54:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.034s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb86ab6-956a-4133-ad17-a11d73e7334c]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] SCSI volumes sdh have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94a31f1-6e6b-418d-8f86-556dc0184d85]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef34895a-a504-4814-b00c-20c5484261aa]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853, portal: 172.16.0.220,3260]
Aug 03 04:54:42 user nova-compute[72444]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853, portal: 172.16.0.220,3260] successful.
Aug 03 04:54:42 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ba9030-fb28-4918-a99c-7e333a003853 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4511bef-5b93-4b48-934f-0d2de113f3b3]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] <== disconnect_volume: return (276ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:54:42 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Deleting instance files /opt/stack/data/nova/instances/c5b50062-b965-4686-beea-63537d9f1eda_del
Aug 03 04:54:42 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Deletion of /opt/stack/data/nova/instances/c5b50062-b965-4686-beea-63537d9f1eda_del complete
Aug 03 04:54:42 user nova-compute[72444]: INFO nova.compute.manager [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Took 3.68 seconds to destroy the instance on the hypervisor.
Aug 03 04:54:42 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: c5b50062-b965-4686-beea-63537d9f1eda] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG nova.compute.manager [req-c9798b15-b9da-42ca-8c07-f5428636658b req-7594d0f2-bb94-426f-bd17-59fa87e56b7d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-unplugged-df356454-4b89-4b15-955c-6d4d41688490 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-c9798b15-b9da-42ca-8c07-f5428636658b req-7594d0f2-bb94-426f-bd17-59fa87e56b7d service nova] Acquiring lock "c5b50062-b965-4686-beea-63537d9f1eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-c9798b15-b9da-42ca-8c07-f5428636658b req-7594d0f2-bb94-426f-bd17-59fa87e56b7d service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-c9798b15-b9da-42ca-8c07-f5428636658b req-7594d0f2-bb94-426f-bd17-59fa87e56b7d service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG nova.compute.manager [req-c9798b15-b9da-42ca-8c07-f5428636658b req-7594d0f2-bb94-426f-bd17-59fa87e56b7d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] No waiting events found dispatching network-vif-unplugged-df356454-4b89-4b15-955c-6d4d41688490 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG nova.compute.manager [req-c9798b15-b9da-42ca-8c07-f5428636658b req-7594d0f2-bb94-426f-bd17-59fa87e56b7d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-unplugged-df356454-4b89-4b15-955c-6d4d41688490 for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG nova.compute.manager [req-c9798b15-b9da-42ca-8c07-f5428636658b req-7594d0f2-bb94-426f-bd17-59fa87e56b7d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-plugged-df356454-4b89-4b15-955c-6d4d41688490 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-c9798b15-b9da-42ca-8c07-f5428636658b req-7594d0f2-bb94-426f-bd17-59fa87e56b7d service nova] Acquiring lock "c5b50062-b965-4686-beea-63537d9f1eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-c9798b15-b9da-42ca-8c07-f5428636658b req-7594d0f2-bb94-426f-bd17-59fa87e56b7d service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-c9798b15-b9da-42ca-8c07-f5428636658b req-7594d0f2-bb94-426f-bd17-59fa87e56b7d service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG nova.compute.manager [req-c9798b15-b9da-42ca-8c07-f5428636658b req-7594d0f2-bb94-426f-bd17-59fa87e56b7d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] No waiting events found dispatching network-vif-plugged-df356454-4b89-4b15-955c-6d4d41688490 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:54:42 user nova-compute[72444]: WARNING nova.compute.manager [req-c9798b15-b9da-42ca-8c07-f5428636658b req-7594d0f2-bb94-426f-bd17-59fa87e56b7d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received unexpected event network-vif-plugged-df356454-4b89-4b15-955c-6d4d41688490 for instance with vm_state active and task_state deleting.
Aug 03 04:54:42 user nova-compute[72444]: DEBUG nova.compute.manager [req-c9798b15-b9da-42ca-8c07-f5428636658b req-7594d0f2-bb94-426f-bd17-59fa87e56b7d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-unplugged-6e47393c-8b6c-4008-a802-8a728b3a7a6c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-c9798b15-b9da-42ca-8c07-f5428636658b req-7594d0f2-bb94-426f-bd17-59fa87e56b7d service nova] Acquiring lock "c5b50062-b965-4686-beea-63537d9f1eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-c9798b15-b9da-42ca-8c07-f5428636658b req-7594d0f2-bb94-426f-bd17-59fa87e56b7d service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-c9798b15-b9da-42ca-8c07-f5428636658b req-7594d0f2-bb94-426f-bd17-59fa87e56b7d service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG nova.compute.manager [req-c9798b15-b9da-42ca-8c07-f5428636658b req-7594d0f2-bb94-426f-bd17-59fa87e56b7d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] No waiting events found dispatching network-vif-unplugged-6e47393c-8b6c-4008-a802-8a728b3a7a6c {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG nova.compute.manager [req-c9798b15-b9da-42ca-8c07-f5428636658b req-7594d0f2-bb94-426f-bd17-59fa87e56b7d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-unplugged-6e47393c-8b6c-4008-a802-8a728b3a7a6c for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG nova.compute.manager [req-c9798b15-b9da-42ca-8c07-f5428636658b req-7594d0f2-bb94-426f-bd17-59fa87e56b7d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-plugged-6e47393c-8b6c-4008-a802-8a728b3a7a6c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-c9798b15-b9da-42ca-8c07-f5428636658b req-7594d0f2-bb94-426f-bd17-59fa87e56b7d service nova] Acquiring lock "c5b50062-b965-4686-beea-63537d9f1eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-c9798b15-b9da-42ca-8c07-f5428636658b req-7594d0f2-bb94-426f-bd17-59fa87e56b7d service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-c9798b15-b9da-42ca-8c07-f5428636658b req-7594d0f2-bb94-426f-bd17-59fa87e56b7d service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG nova.compute.manager [req-c9798b15-b9da-42ca-8c07-f5428636658b req-7594d0f2-bb94-426f-bd17-59fa87e56b7d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] No waiting events found dispatching network-vif-plugged-6e47393c-8b6c-4008-a802-8a728b3a7a6c {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:54:42 user nova-compute[72444]: WARNING nova.compute.manager [req-c9798b15-b9da-42ca-8c07-f5428636658b req-7594d0f2-bb94-426f-bd17-59fa87e56b7d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received unexpected event network-vif-plugged-6e47393c-8b6c-4008-a802-8a728b3a7a6c for instance with vm_state active and task_state deleting.
Aug 03 04:54:42 user nova-compute[72444]: DEBUG nova.compute.manager [req-c9798b15-b9da-42ca-8c07-f5428636658b req-7594d0f2-bb94-426f-bd17-59fa87e56b7d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-unplugged-9fb86964-076c-439e-84fa-7893c15e8871 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-c9798b15-b9da-42ca-8c07-f5428636658b req-7594d0f2-bb94-426f-bd17-59fa87e56b7d service nova] Acquiring lock "c5b50062-b965-4686-beea-63537d9f1eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-c9798b15-b9da-42ca-8c07-f5428636658b req-7594d0f2-bb94-426f-bd17-59fa87e56b7d service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-c9798b15-b9da-42ca-8c07-f5428636658b req-7594d0f2-bb94-426f-bd17-59fa87e56b7d service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG nova.compute.manager [req-c9798b15-b9da-42ca-8c07-f5428636658b req-7594d0f2-bb94-426f-bd17-59fa87e56b7d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] No waiting events found dispatching network-vif-unplugged-9fb86964-076c-439e-84fa-7893c15e8871 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG nova.compute.manager [req-c9798b15-b9da-42ca-8c07-f5428636658b req-7594d0f2-bb94-426f-bd17-59fa87e56b7d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-unplugged-9fb86964-076c-439e-84fa-7893c15e8871 for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG nova.compute.manager [req-c9798b15-b9da-42ca-8c07-f5428636658b req-7594d0f2-bb94-426f-bd17-59fa87e56b7d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-plugged-9fb86964-076c-439e-84fa-7893c15e8871 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-c9798b15-b9da-42ca-8c07-f5428636658b req-7594d0f2-bb94-426f-bd17-59fa87e56b7d service nova] Acquiring lock "c5b50062-b965-4686-beea-63537d9f1eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-c9798b15-b9da-42ca-8c07-f5428636658b req-7594d0f2-bb94-426f-bd17-59fa87e56b7d service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-c9798b15-b9da-42ca-8c07-f5428636658b req-7594d0f2-bb94-426f-bd17-59fa87e56b7d service nova] Lock "c5b50062-b965-4686-beea-63537d9f1eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:54:42 user nova-compute[72444]: DEBUG nova.compute.manager [req-c9798b15-b9da-42ca-8c07-f5428636658b req-7594d0f2-bb94-426f-bd17-59fa87e56b7d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] No waiting events found dispatching network-vif-plugged-9fb86964-076c-439e-84fa-7893c15e8871 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:54:42 user nova-compute[72444]: WARNING nova.compute.manager [req-c9798b15-b9da-42ca-8c07-f5428636658b req-7594d0f2-bb94-426f-bd17-59fa87e56b7d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received unexpected event network-vif-plugged-9fb86964-076c-439e-84fa-7893c15e8871 for instance with vm_state active and task_state deleting.
Aug 03 04:54:43 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:43 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-ab5fb669-7ab6-444b-aa26-15170d5e9991 tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Snapshot image upload complete
Aug 03 04:54:43 user nova-compute[72444]: INFO nova.compute.manager [None req-ab5fb669-7ab6-444b-aa26-15170d5e9991 tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Took 4.98 seconds to snapshot the instance on the hypervisor.
Aug 03 04:54:44 user nova-compute[72444]: DEBUG nova.compute.manager [req-f0337431-cab3-4283-b309-e9a446a9bf52 req-8f6e3b15-0515-47f5-a224-fd45be6511a3 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-deleted-9fb86964-076c-439e-84fa-7893c15e8871 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:54:44 user nova-compute[72444]: INFO nova.compute.manager [req-f0337431-cab3-4283-b309-e9a446a9bf52 req-8f6e3b15-0515-47f5-a224-fd45be6511a3 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Neutron deleted interface 9fb86964-076c-439e-84fa-7893c15e8871; detaching it from the instance and deleting it from the info cache
Aug 03 04:54:44 user nova-compute[72444]: DEBUG nova.network.neutron [req-f0337431-cab3-4283-b309-e9a446a9bf52 req-8f6e3b15-0515-47f5-a224-fd45be6511a3 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Updating instance_info_cache with network_info: [{"id": "4015917d-392d-4101-a347-15b1a37dc252", "address": "fa:16:3e:2f:8b:e3", "network": {"id": "0dfdee8f-99ee-4369-af46-a2f1d097cf8c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-316229813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4015917d-39", "ovs_interfaceid": "4015917d-392d-4101-a347-15b1a37dc252", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "978bd88d-0401-4456-b332-7494cbebe1f2", "address": "fa:16:3e:66:09:aa", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap978bd88d-04", "ovs_interfaceid": "978bd88d-0401-4456-b332-7494cbebe1f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "98143be5-d207-4206-a9fb-39bd8b05822e", "address": "fa:16:3e:68:a8:5f", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98143be5-d2", "ovs_interfaceid": "98143be5-d207-4206-a9fb-39bd8b05822e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fe941d99-e8f6-42bd-939e-d2955caed33d", "address": "fa:16:3e:94:2f:3a", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe941d99-e8", "ovs_interfaceid": "fe941d99-e8f6-42bd-939e-d2955caed33d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "df356454-4b89-4b15-955c-6d4d41688490", "address": "fa:16:3e:5d:b1:8b", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf356454-4b", "ovs_interfaceid": "df356454-4b89-4b15-955c-6d4d41688490", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6e47393c-8b6c-4008-a802-8a728b3a7a6c", "address": "fa:16:3e:1d:3a:74", "network": {"id": "bc31bf9c-5e34-4a68-91e8-6a79eb2e0cdf", "bridge": "br-int", "label": "tempest-device-tagging-net2-117214369", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e47393c-8b", "ovs_interfaceid": "6e47393c-8b6c-4008-a802-8a728b3a7a6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:54:44 user nova-compute[72444]: DEBUG nova.compute.manager [req-f0337431-cab3-4283-b309-e9a446a9bf52 req-8f6e3b15-0515-47f5-a224-fd45be6511a3 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Detach interface failed, port_id=9fb86964-076c-439e-84fa-7893c15e8871, reason: Instance c5b50062-b965-4686-beea-63537d9f1eda could not be found. {{(pid=72444) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 03 04:54:44 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:46 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:46 user nova-compute[72444]: DEBUG nova.compute.manager [req-9a445e6f-6371-41ae-ab6f-027b9215c907 req-2a9dc535-e424-4e2a-95a2-a4d7aaae0e9d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-deleted-df356454-4b89-4b15-955c-6d4d41688490 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:54:46 user nova-compute[72444]: INFO nova.compute.manager [req-9a445e6f-6371-41ae-ab6f-027b9215c907 req-2a9dc535-e424-4e2a-95a2-a4d7aaae0e9d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Neutron deleted interface df356454-4b89-4b15-955c-6d4d41688490; detaching it from the instance and deleting it from the info cache
Aug 03 04:54:46 user nova-compute[72444]: DEBUG nova.network.neutron [req-9a445e6f-6371-41ae-ab6f-027b9215c907 req-2a9dc535-e424-4e2a-95a2-a4d7aaae0e9d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Updating instance_info_cache with network_info: [{"id": "4015917d-392d-4101-a347-15b1a37dc252", "address": "fa:16:3e:2f:8b:e3", "network": {"id": "0dfdee8f-99ee-4369-af46-a2f1d097cf8c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-316229813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4015917d-39", "ovs_interfaceid": "4015917d-392d-4101-a347-15b1a37dc252", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "978bd88d-0401-4456-b332-7494cbebe1f2", "address": "fa:16:3e:66:09:aa", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap978bd88d-04", "ovs_interfaceid": "978bd88d-0401-4456-b332-7494cbebe1f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "98143be5-d207-4206-a9fb-39bd8b05822e", "address": "fa:16:3e:68:a8:5f", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98143be5-d2", "ovs_interfaceid": "98143be5-d207-4206-a9fb-39bd8b05822e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fe941d99-e8f6-42bd-939e-d2955caed33d", "address": "fa:16:3e:94:2f:3a", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe941d99-e8", "ovs_interfaceid": "fe941d99-e8f6-42bd-939e-d2955caed33d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6e47393c-8b6c-4008-a802-8a728b3a7a6c", "address": "fa:16:3e:1d:3a:74", "network": {"id": "bc31bf9c-5e34-4a68-91e8-6a79eb2e0cdf", "bridge": "br-int", "label": "tempest-device-tagging-net2-117214369", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e47393c-8b", "ovs_interfaceid": "6e47393c-8b6c-4008-a802-8a728b3a7a6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:54:46 user nova-compute[72444]: DEBUG nova.compute.manager [req-9a445e6f-6371-41ae-ab6f-027b9215c907 req-2a9dc535-e424-4e2a-95a2-a4d7aaae0e9d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Detach interface failed, port_id=df356454-4b89-4b15-955c-6d4d41688490, reason: Instance c5b50062-b965-4686-beea-63537d9f1eda could not be found. {{(pid=72444) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 03 04:54:46 user nova-compute[72444]: DEBUG nova.compute.manager [req-9a445e6f-6371-41ae-ab6f-027b9215c907 req-2a9dc535-e424-4e2a-95a2-a4d7aaae0e9d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-deleted-6e47393c-8b6c-4008-a802-8a728b3a7a6c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:54:46 user nova-compute[72444]: INFO nova.compute.manager [req-9a445e6f-6371-41ae-ab6f-027b9215c907 req-2a9dc535-e424-4e2a-95a2-a4d7aaae0e9d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Neutron deleted interface 6e47393c-8b6c-4008-a802-8a728b3a7a6c; detaching it from the instance and deleting it from the info cache
Aug 03 04:54:46 user nova-compute[72444]: DEBUG nova.network.neutron [req-9a445e6f-6371-41ae-ab6f-027b9215c907 req-2a9dc535-e424-4e2a-95a2-a4d7aaae0e9d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Updating instance_info_cache with network_info: [{"id": "4015917d-392d-4101-a347-15b1a37dc252", "address": "fa:16:3e:2f:8b:e3", "network": {"id": "0dfdee8f-99ee-4369-af46-a2f1d097cf8c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-316229813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4015917d-39", "ovs_interfaceid": "4015917d-392d-4101-a347-15b1a37dc252", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "978bd88d-0401-4456-b332-7494cbebe1f2", "address": "fa:16:3e:66:09:aa", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap978bd88d-04", "ovs_interfaceid": "978bd88d-0401-4456-b332-7494cbebe1f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "98143be5-d207-4206-a9fb-39bd8b05822e", "address": "fa:16:3e:68:a8:5f", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98143be5-d2", "ovs_interfaceid": "98143be5-d207-4206-a9fb-39bd8b05822e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fe941d99-e8f6-42bd-939e-d2955caed33d", "address": "fa:16:3e:94:2f:3a", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe941d99-e8", "ovs_interfaceid": "fe941d99-e8f6-42bd-939e-d2955caed33d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:54:46 user nova-compute[72444]: DEBUG nova.compute.manager [req-9a445e6f-6371-41ae-ab6f-027b9215c907 req-2a9dc535-e424-4e2a-95a2-a4d7aaae0e9d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Detach interface failed, port_id=6e47393c-8b6c-4008-a802-8a728b3a7a6c, reason: Instance c5b50062-b965-4686-beea-63537d9f1eda could not be found. {{(pid=72444) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 03 04:54:46 user nova-compute[72444]: DEBUG nova.compute.manager [req-9a445e6f-6371-41ae-ab6f-027b9215c907 req-2a9dc535-e424-4e2a-95a2-a4d7aaae0e9d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-deleted-fe941d99-e8f6-42bd-939e-d2955caed33d {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:54:46 user nova-compute[72444]: INFO nova.compute.manager [req-9a445e6f-6371-41ae-ab6f-027b9215c907 req-2a9dc535-e424-4e2a-95a2-a4d7aaae0e9d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Neutron deleted interface fe941d99-e8f6-42bd-939e-d2955caed33d; detaching it from the instance and deleting it from the info cache
Aug 03 04:54:46 user nova-compute[72444]: DEBUG nova.network.neutron [req-9a445e6f-6371-41ae-ab6f-027b9215c907 req-2a9dc535-e424-4e2a-95a2-a4d7aaae0e9d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Updating instance_info_cache with network_info: [{"id": "4015917d-392d-4101-a347-15b1a37dc252", "address": "fa:16:3e:2f:8b:e3", "network": {"id": "0dfdee8f-99ee-4369-af46-a2f1d097cf8c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-316229813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4015917d-39", "ovs_interfaceid": "4015917d-392d-4101-a347-15b1a37dc252", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "978bd88d-0401-4456-b332-7494cbebe1f2", "address": "fa:16:3e:66:09:aa", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap978bd88d-04", "ovs_interfaceid": "978bd88d-0401-4456-b332-7494cbebe1f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "98143be5-d207-4206-a9fb-39bd8b05822e", "address": "fa:16:3e:68:a8:5f", "network": {"id": "24f0a98a-4787-4d04-a606-bad6281d2fdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1823277935", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c053965223cd48eab71fe19c2dcb3856", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98143be5-d2", "ovs_interfaceid": "98143be5-d207-4206-a9fb-39bd8b05822e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:54:46 user nova-compute[72444]: DEBUG nova.compute.manager [req-9a445e6f-6371-41ae-ab6f-027b9215c907 req-2a9dc535-e424-4e2a-95a2-a4d7aaae0e9d service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Detach interface failed, port_id=fe941d99-e8f6-42bd-939e-d2955caed33d, reason: Instance c5b50062-b965-4686-beea-63537d9f1eda could not be found. {{(pid=72444) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 03 04:54:46 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:54:46 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Took 4.24 seconds to deallocate network for instance.
Aug 03 04:54:46 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:54:47 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:54:47 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 04:54:48 user nova-compute[72444]: DEBUG nova.compute.manager [req-ad6950bd-5a3a-4d11-8b89-b2bff94779fd req-d0bb0ac6-ee14-45ef-ab4b-0ec1f519d0b0 service nova] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Received event network-vif-deleted-4015917d-392d-4101-a347-15b1a37dc252 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:54:48 user nova-compute[72444]: INFO nova.compute.manager [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Took 2.18 seconds to detach 3 volumes for instance.
Aug 03 04:54:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:54:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:54:49 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:54:49 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:54:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:54:49 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Deleted allocations for instance c5b50062-b965-4686-beea-63537d9f1eda
Aug 03 04:54:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-149b106a-6464-4acb-a644-15dac1932141 tempest-TaggedBootDevicesTest_v242-1604326291 tempest-TaggedBootDevicesTest_v242-1604326291-project-member] Lock "c5b50062-b965-4686-beea-63537d9f1eda" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.683s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:54:49 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:54:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:51 user nova-compute[72444]: DEBUG nova.compute.manager [req-7e7bb907-2b2c-4c94-9706-a6cd6e4f74a5 req-d1d32cce-fa78-47d2-b5de-93f28a80c935 service nova] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Received event network-changed-37b60bd1-1877-4cd1-833b-4db852dbe1f8 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:54:51 user nova-compute[72444]: DEBUG nova.compute.manager [req-7e7bb907-2b2c-4c94-9706-a6cd6e4f74a5 req-d1d32cce-fa78-47d2-b5de-93f28a80c935 service nova] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Refreshing instance network info cache due to event network-changed-37b60bd1-1877-4cd1-833b-4db852dbe1f8. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:54:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7e7bb907-2b2c-4c94-9706-a6cd6e4f74a5 req-d1d32cce-fa78-47d2-b5de-93f28a80c935 service nova] Acquiring lock "refresh_cache-ae41789a-ebd1-4265-a903-32d2006e66d1" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:54:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7e7bb907-2b2c-4c94-9706-a6cd6e4f74a5 req-d1d32cce-fa78-47d2-b5de-93f28a80c935 service nova] Acquired lock "refresh_cache-ae41789a-ebd1-4265-a903-32d2006e66d1" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:54:51 user nova-compute[72444]: DEBUG nova.network.neutron [req-7e7bb907-2b2c-4c94-9706-a6cd6e4f74a5 req-d1d32cce-fa78-47d2-b5de-93f28a80c935 service nova] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Refreshing network info cache for port 37b60bd1-1877-4cd1-833b-4db852dbe1f8 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:54:51 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:54:51 user nova-compute[72444]: DEBUG nova.network.neutron [req-7e7bb907-2b2c-4c94-9706-a6cd6e4f74a5 req-d1d32cce-fa78-47d2-b5de-93f28a80c935 service nova] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Updated VIF entry in instance network info cache for port 37b60bd1-1877-4cd1-833b-4db852dbe1f8. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:54:51 user nova-compute[72444]: DEBUG nova.network.neutron [req-7e7bb907-2b2c-4c94-9706-a6cd6e4f74a5 req-d1d32cce-fa78-47d2-b5de-93f28a80c935 service nova] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Updating instance_info_cache with network_info: [{"id": "37b60bd1-1877-4cd1-833b-4db852dbe1f8", "address": "fa:16:3e:a9:bc:76", "network": {"id": "bb35bc76-087b-4468-ba0c-3637873207f8", "bridge": "br-int", "label": "tempest-TestStampPattern-620416114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d114efe1dfc1424299621df67bf00863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b60bd1-18", "ovs_interfaceid": "37b60bd1-1877-4cd1-833b-4db852dbe1f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:54:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7e7bb907-2b2c-4c94-9706-a6cd6e4f74a5 req-d1d32cce-fa78-47d2-b5de-93f28a80c935 service nova] Releasing lock "refresh_cache-ae41789a-ebd1-4265-a903-32d2006e66d1" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:54:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Acquiring lock "ae41789a-ebd1-4265-a903-32d2006e66d1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:54:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "ae41789a-ebd1-4265-a903-32d2006e66d1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:54:52 user nova-compute[72444]: DEBUG nova.objects.instance [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lazy-loading 'flavor' on Instance uuid ae41789a-ebd1-4265-a903-32d2006e66d1 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:54:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "ae41789a-ebd1-4265-a903-32d2006e66d1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:54:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Acquiring lock "ae41789a-ebd1-4265-a903-32d2006e66d1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:54:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "ae41789a-ebd1-4265-a903-32d2006e66d1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:54:52 user nova-compute[72444]: INFO nova.compute.manager [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Attaching volume f82f474a-d697-4251-98b6-45c48b85300b to /dev/vdb
Aug 03 04:54:52 user nova-compute[72444]: DEBUG os_brick.utils [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:54:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:52 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c379787-a90f-4924-bd04-871a4a058243]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:52 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3d72b2-a079-4e17-8941-f00e6dec1e42]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:52 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb0c3cd-3161-40d7-9161-1143268e51ed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:52 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca4f972-ca19-4cc9-806c-3bce33e69b03]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:54:52 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 04:54:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:54:52 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 04:54:52 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[900a493d-b4ad-4793-a51c-76079317ec67]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:52 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 04:54:52 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 04:54:52 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 04:54:52 user nova-compute[72444]: DEBUG os_brick.utils [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:54:52 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Updating existing volume attachment record: c588f009-c9bf-47c8-b0d9-499365804671 {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 04:54:52 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:54:52 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:54:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Acquiring lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:54:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:54:53 user nova-compute[72444]: DEBUG nova.objects.instance [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lazy-loading 'flavor' on Instance uuid c94f537a-b1a1-4cea-996d-e1a88a2c9dac {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:54:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:54:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Acquiring lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:54:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:54:53 user nova-compute[72444]: INFO nova.compute.manager [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Attaching volume e4ee7009-a469-44d6-a13e-8fb0c9b6eca8 to /dev/vdb
Aug 03 04:54:53 user nova-compute[72444]: DEBUG os_brick.utils [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:54:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bed30ce-2a80-4831-8a00-92357aa66f18]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc54322-1b6a-4982-a8ce-c1c8b4dc7baa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[da801474-6b84-430a-8c27-082bbab0bb5f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a00ca31-a401-4cdd-87a8-7df38ffa02ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:54:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 04:54:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:54:53 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 04:54:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df337a3-0b85-4db1-b814-5b6ee45a0ad3]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:54:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 04:54:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 04:54:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 04:54:53 user nova-compute[72444]: DEBUG os_brick.utils [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:54:53 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Updating existing volume attachment record: 2b545899-67ff-4b9b-9231-b10be84c1adb {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 04:54:53 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:54:54 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:54:54 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:54:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:54:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:54:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:54:54 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 04:54:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:54:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:55 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691038480.728913, c5b50062-b965-4686-beea-63537d9f1eda => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:54:55 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: c5b50062-b965-4686-beea-63537d9f1eda] VM Stopped (Lifecycle Event)
Aug 03 04:54:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:55 user nova-compute[72444]: DEBUG nova.compute.manager [None req-5747f2cf-2a64-4542-b124-8a7e04456049 None None] [instance: c5b50062-b965-4686-beea-63537d9f1eda] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:54:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:54:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:57 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:54:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:57 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:54:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:57 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:54:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/863f0679-c64c-4a13-8028-4cb194f8f99f/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/863f0679-c64c-4a13-8028-4cb194f8f99f/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/863f0679-c64c-4a13-8028-4cb194f8f99f/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/863f0679-c64c-4a13-8028-4cb194f8f99f/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:54:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:54:58 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:54:58 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:54:58 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=7271MB free_disk=25.29861068725586GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 04:54:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:54:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:54:59 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:54:59 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 81725845-6158-4e34-bedb-6e41219bc227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:54:59 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance b6ed9c42-fa6e-4a0d-8312-588471e157f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:54:59 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance e2859322-6f99-442d-bee1-65fe49ce6360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:54:59 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:54:59 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 0b219bf3-a3b6-44b5-946e-c10e7498e1d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:54:59 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance c77e96da-6411-4ae9-af05-8e9bb3c432c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:54:59 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance c94f537a-b1a1-4cea-996d-e1a88a2c9dac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:54:59 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance c4af22f7-45f8-4777-83ee-5cf1481c9fe8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:54:59 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 863f0679-c64c-4a13-8028-4cb194f8f99f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:54:59 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:54:59 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance ae41789a-ebd1-4265-a903-32d2006e66d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:54:59 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 04:54:59 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 04:54:59 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:54:59 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:54:59 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 04:54:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.620s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:54:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:55:00 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:55:00 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 04:55:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-0b219bf3-a3b6-44b5-946e-c10e7498e1d3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:55:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-0b219bf3-a3b6-44b5-946e-c10e7498e1d3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:55:00 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 04:55:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:55:01 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Updating instance_info_cache with network_info: [{"id": "5c810fce-bc56-4763-a65d-dbc53bf0c08a", "address": "fa:16:3e:d6:a1:18", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c810fce-bc", "ovs_interfaceid": "5c810fce-bc56-4763-a65d-dbc53bf0c08a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:55:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-0b219bf3-a3b6-44b5-946e-c10e7498e1d3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:55:01 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ultOcSTH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:55:03 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:55:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:55:03 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:55:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:55:03 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:55:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5643a0-67d4-418b-80d0-5ec20de82a5e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 04:55:03 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6817242-622e-4c87-98be-2940359a8c4b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b] added
Aug 03 04:55:03 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5a7fa1-ef16-4a59-ae5b-ebfd3e7be1cb]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c534afc0-9b10-484c-be70-2a11b582c4d8]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ultOcSTH {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ultOcSTH" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[115b65a6-82a0-4986-b7da-d2496a7d8367]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ultOcSTH'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4943973e-9d7d-4365-b311-3d1548d9b2e8]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adb6336-5440-4655-b73f-54c05dadac40]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:55:03 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:55:03 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:55:03 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:55:03 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:55:03 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:55:03 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:55:03 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:55:03 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a55e8c-55db-43ee-852b-f6f6b29c83fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b, portal: 172.16.0.220,3260]
Aug 03 04:55:03 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b, portal: 172.16.0.220,3260] successful.
Aug 03 04:55:03 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d15e41-f0d4-4fbc-8cd9-29c3e4bdd2b6]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cd5ffd-4607-4946-ab4f-bff426249e09]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:55:03 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:55:03 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:55:03 user nova-compute[72444]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b (non-flash)
Aug 03 04:55:03 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:55:03 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:55:03 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:55:03 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:55:03 user nova-compute[72444]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b (non-flash)
Aug 03 04:55:03 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:55:03 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfee2943-1694-45fb-b06b-c7d9f37fdcba]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:55:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ultOcSTH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:55:04 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:55:04 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '26237303962666466', 'path': '/dev/sdc'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:55:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237303962666466', 'path': '/dev/sdc'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:55:04 user nova-compute[72444]: DEBUG nova.objects.instance [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lazy-loading 'flavor' on Instance uuid ae41789a-ebd1-4265-a903-32d2006e66d1 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:55:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 04:55:04 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:55:04 user nova-compute[72444]:   <source dev="/dev/sdc"/>
Aug 03 04:55:04 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:55:04 user nova-compute[72444]:   <serial>f82f474a-d697-4251-98b6-45c48b85300b</serial>
Aug 03 04:55:04 user nova-compute[72444]: </disk>
Aug 03 04:55:04 user nova-compute[72444]:  {{(pid=72444) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 04:55:05 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:55:05 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:55:05 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] No VIF found with MAC fa:16:3e:a9:bc:76, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:55:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4e54339e-ce83-4dbf-b697-551a94307cb1 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "ae41789a-ebd1-4265-a903-32d2006e66d1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.998s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:55:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:55:07 user nova-compute[72444]: DEBUG nova.compute.manager [req-a5a124d0-a92b-4704-b2c0-3ed7d78b96cc req-a8f6ff10-efd0-4461-a772-024b057249c1 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Received event network-changed-90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:55:07 user nova-compute[72444]: DEBUG nova.compute.manager [req-a5a124d0-a92b-4704-b2c0-3ed7d78b96cc req-a8f6ff10-efd0-4461-a772-024b057249c1 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Refreshing instance network info cache due to event network-changed-90104ef6-fe9b-4347-8df6-934a276e077b. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:55:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a5a124d0-a92b-4704-b2c0-3ed7d78b96cc req-a8f6ff10-efd0-4461-a772-024b057249c1 service nova] Acquiring lock "refresh_cache-c77e96da-6411-4ae9-af05-8e9bb3c432c6" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:55:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a5a124d0-a92b-4704-b2c0-3ed7d78b96cc req-a8f6ff10-efd0-4461-a772-024b057249c1 service nova] Acquired lock "refresh_cache-c77e96da-6411-4ae9-af05-8e9bb3c432c6" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:55:07 user nova-compute[72444]: DEBUG nova.network.neutron [req-a5a124d0-a92b-4704-b2c0-3ed7d78b96cc req-a8f6ff10-efd0-4461-a772-024b057249c1 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Refreshing network info cache for port 90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:55:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-bec7003e-6800-4115-b8af-973579f0889d tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Acquiring lock "ae41789a-ebd1-4265-a903-32d2006e66d1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:55:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-bec7003e-6800-4115-b8af-973579f0889d tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "ae41789a-ebd1-4265-a903-32d2006e66d1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:55:07 user nova-compute[72444]: INFO nova.compute.manager [None req-bec7003e-6800-4115-b8af-973579f0889d tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Detaching volume f82f474a-d697-4251-98b6-45c48b85300b
Aug 03 04:55:07 user nova-compute[72444]: INFO nova.virt.block_device [None req-bec7003e-6800-4115-b8af-973579f0889d tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Attempting to driver detach volume f82f474a-d697-4251-98b6-45c48b85300b from mountpoint /dev/vdb
Aug 03 04:55:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-bec7003e-6800-4115-b8af-973579f0889d tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Attempting to detach device vdb from instance ae41789a-ebd1-4265-a903-32d2006e66d1 from the persistent domain config. {{(pid=72444) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 04:55:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-bec7003e-6800-4115-b8af-973579f0889d tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 04:55:07 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:55:07 user nova-compute[72444]:   <source dev="/dev/sdc"/>
Aug 03 04:55:07 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:55:07 user nova-compute[72444]:   <serial>f82f474a-d697-4251-98b6-45c48b85300b</serial>
Aug 03 04:55:07 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 04:55:07 user nova-compute[72444]: </disk>
Aug 03 04:55:07 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:55:07 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-bec7003e-6800-4115-b8af-973579f0889d tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Successfully detached device vdb from instance ae41789a-ebd1-4265-a903-32d2006e66d1 from the persistent domain config.
Aug 03 04:55:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-bec7003e-6800-4115-b8af-973579f0889d tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ae41789a-ebd1-4265-a903-32d2006e66d1 from the live domain config. {{(pid=72444) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 04:55:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-bec7003e-6800-4115-b8af-973579f0889d tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 04:55:07 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:55:07 user nova-compute[72444]:   <source dev="/dev/sdc"/>
Aug 03 04:55:07 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:55:07 user nova-compute[72444]:   <serial>f82f474a-d697-4251-98b6-45c48b85300b</serial>
Aug 03 04:55:07 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 04:55:07 user nova-compute[72444]: </disk>
Aug 03 04:55:07 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-eecfecef-14d8-460d-8592-2b62ba558168 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-eecfecef-14d8-460d-8592-2b62ba558168 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:55:08 user nova-compute[72444]: INFO nova.compute.manager [None req-eecfecef-14d8-460d-8592-2b62ba558168 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Detaching volume b64c5177-e1bd-47bc-899c-798c847c978d
Aug 03 04:55:08 user nova-compute[72444]: DEBUG nova.network.neutron [req-a5a124d0-a92b-4704-b2c0-3ed7d78b96cc req-a8f6ff10-efd0-4461-a772-024b057249c1 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Updated VIF entry in instance network info cache for port 90104ef6-fe9b-4347-8df6-934a276e077b. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG nova.network.neutron [req-a5a124d0-a92b-4704-b2c0-3ed7d78b96cc req-a8f6ff10-efd0-4461-a772-024b057249c1 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Updating instance_info_cache with network_info: [{"id": "90104ef6-fe9b-4347-8df6-934a276e077b", "address": "fa:16:3e:22:ec:e0", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90104ef6-fe", "ovs_interfaceid": "90104ef6-fe9b-4347-8df6-934a276e077b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a5a124d0-a92b-4704-b2c0-3ed7d78b96cc req-a8f6ff10-efd0-4461-a772-024b057249c1 service nova] Releasing lock "refresh_cache-c77e96da-6411-4ae9-af05-8e9bb3c432c6" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:55:08 user nova-compute[72444]: INFO nova.virt.block_device [None req-eecfecef-14d8-460d-8592-2b62ba558168 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Attempting to driver detach volume b64c5177-e1bd-47bc-899c-798c847c978d from mountpoint /dev/vdb
Aug 03 04:55:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-eecfecef-14d8-460d-8592-2b62ba558168 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Attempting to detach device vdb from instance c77e96da-6411-4ae9-af05-8e9bb3c432c6 from the persistent domain config. {{(pid=72444) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-eecfecef-14d8-460d-8592-2b62ba558168 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 04:55:08 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:55:08 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 04:55:08 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:55:08 user nova-compute[72444]:   <serial>b64c5177-e1bd-47bc-899c-798c847c978d</serial>
Aug 03 04:55:08 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 04:55:08 user nova-compute[72444]: </disk>
Aug 03 04:55:08 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:55:08 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-eecfecef-14d8-460d-8592-2b62ba558168 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Successfully detached device vdb from instance c77e96da-6411-4ae9-af05-8e9bb3c432c6 from the persistent domain config.
Aug 03 04:55:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-eecfecef-14d8-460d-8592-2b62ba558168 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c77e96da-6411-4ae9-af05-8e9bb3c432c6 from the live domain config. {{(pid=72444) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-eecfecef-14d8-460d-8592-2b62ba558168 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 04:55:08 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:55:08 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 04:55:08 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:55:08 user nova-compute[72444]:   <serial>b64c5177-e1bd-47bc-899c-798c847c978d</serial>
Aug 03 04:55:08 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 04:55:08 user nova-compute[72444]: </disk>
Aug 03 04:55:08 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Received event <DeviceRemovedEvent: 1691038508.4328237, ae41789a-ebd1-4265-a903-32d2006e66d1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72444) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-bec7003e-6800-4115-b8af-973579f0889d tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ae41789a-ebd1-4265-a903-32d2006e66d1 {{(pid=72444) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 04:55:08 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-bec7003e-6800-4115-b8af-973579f0889d tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Successfully detached device vdb from instance ae41789a-ebd1-4265-a903-32d2006e66d1 from the live domain config.
Aug 03 04:55:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bec7003e-6800-4115-b8af-973579f0889d tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec7003e-6800-4115-b8af-973579f0889d tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ultOcSTH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:55:08 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-bec7003e-6800-4115-b8af-973579f0889d tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:55:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-bec7003e-6800-4115-b8af-973579f0889d tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-bec7003e-6800-4115-b8af-973579f0889d tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec7003e-6800-4115-b8af-973579f0889d tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23d9e4b-7cc8-47cb-a2f2-9d0e222474c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9b733b-4a7a-463c-bf97-e05d86fe9164]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec7003e-6800-4115-b8af-973579f0889d tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:55:08 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:55:08 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:55:08 user nova-compute[72444]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b (non-flash)
Aug 03 04:55:08 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:55:08 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec7003e-6800-4115-b8af-973579f0889d tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:55:08 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:55:08 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:55:08 user nova-compute[72444]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b (non-flash)
Aug 03 04:55:08 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:55:08 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec7003e-6800-4115-b8af-973579f0889d tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308c41d750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b'): ({'sdc'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-bec7003e-6800-4115-b8af-973579f0889d tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Removing single pathed devices sdc {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3794664e-9a95-4224-ac03-1f9069cafdf6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcef1f78-6307-4ac5-88c5-3076bbb565ad]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-bec7003e-6800-4115-b8af-973579f0889d tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Flushing IO for device /dev/sdc {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9f10a8-1eb1-4de3-9075-a9dfe6251f35]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-bec7003e-6800-4115-b8af-973579f0889d tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[266aedd7-bbfb-4f63-89ba-6594f758bab6]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-bec7003e-6800-4115-b8af-973579f0889d tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-bec7003e-6800-4115-b8af-973579f0889d tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] SCSI volumes sdc have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec7003e-6800-4115-b8af-973579f0889d tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a282692d-5968-4305-a1d6-954b8af27f95]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec7003e-6800-4115-b8af-973579f0889d tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cdeffe4-3f6b-4f41-8da9-f78ae0c743d6]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec7003e-6800-4115-b8af-973579f0889d tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b, portal: 172.16.0.220,3260]
Aug 03 04:55:08 user nova-compute[72444]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b, portal: 172.16.0.220,3260] successful.
Aug 03 04:55:08 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f82f474a-d697-4251-98b6-45c48b85300b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[865a1466-ca4c-4533-84f4-60ee25f47da2]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec7003e-6800-4115-b8af-973579f0889d tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-bec7003e-6800-4115-b8af-973579f0889d tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec7003e-6800-4115-b8af-973579f0889d tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] <== disconnect_volume: return (321ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bec7003e-6800-4115-b8af-973579f0889d tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Received event <DeviceRemovedEvent: 1691038508.8361983, c77e96da-6411-4ae9-af05-8e9bb3c432c6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72444) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-eecfecef-14d8-460d-8592-2b62ba558168 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c77e96da-6411-4ae9-af05-8e9bb3c432c6 {{(pid=72444) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 04:55:08 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-eecfecef-14d8-460d-8592-2b62ba558168 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Successfully detached device vdb from instance c77e96da-6411-4ae9-af05-8e9bb3c432c6 from the live domain config.
Aug 03 04:55:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eecfecef-14d8-460d-8592-2b62ba558168 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecfecef-14d8-460d-8592-2b62ba558168 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoqzCFpy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:55:08 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-eecfecef-14d8-460d-8592-2b62ba558168 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:55:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-eecfecef-14d8-460d-8592-2b62ba558168 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-eecfecef-14d8-460d-8592-2b62ba558168 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecfecef-14d8-460d-8592-2b62ba558168 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[370d942d-fce1-4450-8a6c-e66ffe59fd76]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DgolaOJp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:55:08 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:55:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[064f2e96-0148-47de-ac02-62dcda6ff993]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecfecef-14d8-460d-8592-2b62ba558168 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:55:08 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:55:08 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:55:08 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:55:08 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecfecef-14d8-460d-8592-2b62ba558168 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d (non-flash)
Aug 03 04:55:08 user nova-compute[72444]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:55:08 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:55:08 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:55:08 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecfecef-14d8-460d-8592-2b62ba558168 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308c41d360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d'): ({'sdb'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-eecfecef-14d8-460d-8592-2b62ba558168 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Removing single pathed devices sdb {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dda78d6-0b30-4eaa-8960-f9eda424f2e6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8ca673-4c1e-4e13-bb3c-e1249659d164]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-eecfecef-14d8-460d-8592-2b62ba558168 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Flushing IO for device /dev/sdb {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 04:55:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf3ca78-b518-4c4a-92be-e29391daa9a1]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-eecfecef-14d8-460d-8592-2b62ba558168 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2ac1b7-7295-4868-8e4e-99a97695d883]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-eecfecef-14d8-460d-8592-2b62ba558168 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-eecfecef-14d8-460d-8592-2b62ba558168 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecfecef-14d8-460d-8592-2b62ba558168 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0328c9ba-8bd4-424d-979f-190951227a51]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecfecef-14d8-460d-8592-2b62ba558168 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3007af26-da7c-455b-8e93-7bd8f414ef65]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecfecef-14d8-460d-8592-2b62ba558168 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d, portal: 172.16.0.220,3260]
Aug 03 04:55:09 user nova-compute[72444]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d, portal: 172.16.0.220,3260] successful.
Aug 03 04:55:09 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b64c5177-e1bd-47bc-899c-798c847c978d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9aa06d-f6ae-46d4-b84b-363e9f42ebe6]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecfecef-14d8-460d-8592-2b62ba558168 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-eecfecef-14d8-460d-8592-2b62ba558168 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecfecef-14d8-460d-8592-2b62ba558168 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] <== disconnect_volume: return (350ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eecfecef-14d8-460d-8592-2b62ba558168 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.311s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:55:09 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:55:09 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:55:09 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d1d1b7-fe1a-4b95-b2f2-4d0b465fedd4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 04:55:09 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4b0bb4-72a4-44a5-9469-ec73ede02149]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8] added
Aug 03 04:55:09 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[da72fd7f-8e5a-4d61-859b-62a2ce5a9f27]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[007395be-aee4-442a-8ac0-9fcc70f69735]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DgolaOJp {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DgolaOJp" returned: 0 in 0.025s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce666f1-6e40-4278-b740-a0f3397dcb0e]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DgolaOJp'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7012e755-ebec-4910-ba5b-407839c17dd5]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d61f3c6-ebf0-49fd-b169-caace3a788b1]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:55:09 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:55:09 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:55:09 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:55:09 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:55:09 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:55:09 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8 -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2511543-d353-45a0-a7e4-b6eaddfd70ae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8, portal: 172.16.0.220,3260]
Aug 03 04:55:09 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8, portal: 172.16.0.220,3260] successful.
Aug 03 04:55:09 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b22759-76c0-4376-b6a0-f6161853434e]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cabd313-1541-4668-a863-894dea6cbc26]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:55:09 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:55:09 user nova-compute[72444]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8 (non-flash)
Aug 03 04:55:09 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:55:09 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:55:09 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:55:09 user nova-compute[72444]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8 (non-flash)
Aug 03 04:55:09 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:55:09 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ed03e0-5b9a-4400-8964-867e20e7e16f]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DgolaOJp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG nova.objects.instance [None req-bec7003e-6800-4115-b8af-973579f0889d tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lazy-loading 'flavor' on Instance uuid ae41789a-ebd1-4265-a903-32d2006e66d1 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-bec7003e-6800-4115-b8af-973579f0889d tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "ae41789a-ebd1-4265-a903-32d2006e66d1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.879s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG nova.compute.manager [req-d1e3a2eb-52fc-4ce8-a81d-3171304b3ed1 req-7818f1b3-8a69-493f-8801-8b34ff3f8913 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Received event network-changed-90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG nova.compute.manager [req-d1e3a2eb-52fc-4ce8-a81d-3171304b3ed1 req-7818f1b3-8a69-493f-8801-8b34ff3f8913 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Refreshing instance network info cache due to event network-changed-90104ef6-fe9b-4347-8df6-934a276e077b. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d1e3a2eb-52fc-4ce8-a81d-3171304b3ed1 req-7818f1b3-8a69-493f-8801-8b34ff3f8913 service nova] Acquiring lock "refresh_cache-c77e96da-6411-4ae9-af05-8e9bb3c432c6" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d1e3a2eb-52fc-4ce8-a81d-3171304b3ed1 req-7818f1b3-8a69-493f-8801-8b34ff3f8913 service nova] Acquired lock "refresh_cache-c77e96da-6411-4ae9-af05-8e9bb3c432c6" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG nova.network.neutron [req-d1e3a2eb-52fc-4ce8-a81d-3171304b3ed1 req-7818f1b3-8a69-493f-8801-8b34ff3f8913 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Refreshing network info cache for port 90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:55:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:55:10 user nova-compute[72444]: DEBUG nova.network.neutron [req-d1e3a2eb-52fc-4ce8-a81d-3171304b3ed1 req-7818f1b3-8a69-493f-8801-8b34ff3f8913 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Updated VIF entry in instance network info cache for port 90104ef6-fe9b-4347-8df6-934a276e077b. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:55:10 user nova-compute[72444]: DEBUG nova.network.neutron [req-d1e3a2eb-52fc-4ce8-a81d-3171304b3ed1 req-7818f1b3-8a69-493f-8801-8b34ff3f8913 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Updating instance_info_cache with network_info: [{"id": "90104ef6-fe9b-4347-8df6-934a276e077b", "address": "fa:16:3e:22:ec:e0", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90104ef6-fe", "ovs_interfaceid": "90104ef6-fe9b-4347-8df6-934a276e077b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:55:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d1e3a2eb-52fc-4ce8-a81d-3171304b3ed1 req-7818f1b3-8a69-493f-8801-8b34ff3f8913 service nova] Releasing lock "refresh_cache-c77e96da-6411-4ae9-af05-8e9bb3c432c6" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:55:10 user nova-compute[72444]: DEBUG nova.objects.instance [None req-eecfecef-14d8-460d-8592-2b62ba558168 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lazy-loading 'flavor' on Instance uuid c77e96da-6411-4ae9-af05-8e9bb3c432c6 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:55:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-eecfecef-14d8-460d-8592-2b62ba558168 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.188s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:55:10 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:55:10 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] <== connect_volume: return (1713ms) {'type': 'block', 'scsi_wwn': '23132383234343931', 'path': '/dev/sdb'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:55:10 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132383234343931', 'path': '/dev/sdb'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:55:10 user nova-compute[72444]: DEBUG nova.objects.instance [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lazy-loading 'flavor' on Instance uuid c94f537a-b1a1-4cea-996d-e1a88a2c9dac {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:55:10 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 04:55:10 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:55:10 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 04:55:10 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:55:10 user nova-compute[72444]:   <serial>e4ee7009-a469-44d6-a13e-8fb0c9b6eca8</serial>
Aug 03 04:55:10 user nova-compute[72444]: </disk>
Aug 03 04:55:10 user nova-compute[72444]:  {{(pid=72444) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 04:55:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:55:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:55:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] No VIF found with MAC fa:16:3e:7f:5d:57, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:55:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c2073768-81fe-4ed6-8adb-4ad297bf5d7c tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.900s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:55:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:55:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7c30d79e-7147-4cff-affd-5e2c8a563bdf tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Acquiring lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:55:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7c30d79e-7147-4cff-affd-5e2c8a563bdf tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:55:13 user nova-compute[72444]: INFO nova.compute.manager [None req-7c30d79e-7147-4cff-affd-5e2c8a563bdf tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Detaching volume e4ee7009-a469-44d6-a13e-8fb0c9b6eca8
Aug 03 04:55:13 user nova-compute[72444]: INFO nova.virt.block_device [None req-7c30d79e-7147-4cff-affd-5e2c8a563bdf tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Attempting to driver detach volume e4ee7009-a469-44d6-a13e-8fb0c9b6eca8 from mountpoint /dev/vdb
Aug 03 04:55:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-7c30d79e-7147-4cff-affd-5e2c8a563bdf tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Attempting to detach device vdb from instance c94f537a-b1a1-4cea-996d-e1a88a2c9dac from the persistent domain config. {{(pid=72444) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 04:55:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-7c30d79e-7147-4cff-affd-5e2c8a563bdf tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 04:55:13 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:55:13 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 04:55:13 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:55:13 user nova-compute[72444]:   <serial>e4ee7009-a469-44d6-a13e-8fb0c9b6eca8</serial>
Aug 03 04:55:13 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 04:55:13 user nova-compute[72444]: </disk>
Aug 03 04:55:13 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:55:13 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-7c30d79e-7147-4cff-affd-5e2c8a563bdf tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Successfully detached device vdb from instance c94f537a-b1a1-4cea-996d-e1a88a2c9dac from the persistent domain config.
Aug 03 04:55:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-7c30d79e-7147-4cff-affd-5e2c8a563bdf tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c94f537a-b1a1-4cea-996d-e1a88a2c9dac from the live domain config. {{(pid=72444) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 04:55:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-7c30d79e-7147-4cff-affd-5e2c8a563bdf tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 04:55:13 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:55:13 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 04:55:13 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:55:13 user nova-compute[72444]:   <serial>e4ee7009-a469-44d6-a13e-8fb0c9b6eca8</serial>
Aug 03 04:55:13 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 04:55:13 user nova-compute[72444]: </disk>
Aug 03 04:55:13 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:55:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Received event <DeviceRemovedEvent: 1691038513.8293903, c94f537a-b1a1-4cea-996d-e1a88a2c9dac => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72444) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 04:55:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-7c30d79e-7147-4cff-affd-5e2c8a563bdf tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c94f537a-b1a1-4cea-996d-e1a88a2c9dac {{(pid=72444) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 04:55:13 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-7c30d79e-7147-4cff-affd-5e2c8a563bdf tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Successfully detached device vdb from instance c94f537a-b1a1-4cea-996d-e1a88a2c9dac from the live domain config.
Aug 03 04:55:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c30d79e-7147-4cff-affd-5e2c8a563bdf tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:55:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c30d79e-7147-4cff-affd-5e2c8a563bdf tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DgolaOJp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:55:13 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-7c30d79e-7147-4cff-affd-5e2c8a563bdf tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:55:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-7c30d79e-7147-4cff-affd-5e2c8a563bdf tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:55:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-7c30d79e-7147-4cff-affd-5e2c8a563bdf tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:55:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c30d79e-7147-4cff-affd-5e2c8a563bdf tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:55:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:13 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[281840fc-b02f-4cfc-8283-9ab765fb0f7b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:13 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09b9b99-7d4d-4ef2-b1b1-5e06a1a45d01]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c30d79e-7147-4cff-affd-5e2c8a563bdf tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:55:13 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:55:13 user nova-compute[72444]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8 (non-flash)
Aug 03 04:55:13 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:55:13 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:55:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c30d79e-7147-4cff-affd-5e2c8a563bdf tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:55:13 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:55:13 user nova-compute[72444]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8 (non-flash)
Aug 03 04:55:13 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:55:13 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:55:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c30d79e-7147-4cff-affd-5e2c8a563bdf tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f309423dd80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8'): ({'sdb'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:55:13 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-7c30d79e-7147-4cff-affd-5e2c8a563bdf tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Removing single pathed devices sdb {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 04:55:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:13 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c41ffd8-2d8e-4991-b183-c9df45ed591c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:13 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d7231d-e480-4033-9980-32c85c4e358b]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:13 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-7c30d79e-7147-4cff-affd-5e2c8a563bdf tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Flushing IO for device /dev/sdb {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 04:55:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:13 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c75f6f-efb5-4770-82cd-4f39f5544f00]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:13 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-7c30d79e-7147-4cff-affd-5e2c8a563bdf tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 04:55:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.076s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[894a78b7-a2ad-4a52-89f3-210161be921a]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:14 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-7c30d79e-7147-4cff-affd-5e2c8a563bdf tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 04:55:14 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-7c30d79e-7147-4cff-affd-5e2c8a563bdf tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 04:55:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c30d79e-7147-4cff-affd-5e2c8a563bdf tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:55:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:55:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[125e9ef3-9c26-434e-b6d3-060ed41454ef]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c30d79e-7147-4cff-affd-5e2c8a563bdf tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:55:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8 -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[17349a6b-d7f7-4912-9fb3-4b7155c0bd37]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c30d79e-7147-4cff-affd-5e2c8a563bdf tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8, portal: 172.16.0.220,3260]
Aug 03 04:55:14 user nova-compute[72444]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8, portal: 172.16.0.220,3260] successful.
Aug 03 04:55:14 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:55:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8 -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4ee7009-a469-44d6-a13e-8fb0c9b6eca8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b305d3a-8eaf-4db0-a7e8-3e7a34bae30a]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:55:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c30d79e-7147-4cff-affd-5e2c8a563bdf tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:55:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-7c30d79e-7147-4cff-affd-5e2c8a563bdf tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:55:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c30d79e-7147-4cff-affd-5e2c8a563bdf tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] <== disconnect_volume: return (329ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:55:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c30d79e-7147-4cff-affd-5e2c8a563bdf tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:55:14 user nova-compute[72444]: DEBUG nova.objects.instance [None req-7c30d79e-7147-4cff-affd-5e2c8a563bdf tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lazy-loading 'flavor' on Instance uuid c94f537a-b1a1-4cea-996d-e1a88a2c9dac {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:55:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7c30d79e-7147-4cff-affd-5e2c8a563bdf tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.683s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:55:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:55:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:55:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:55:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:55:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 04:55:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 04:55:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 04:55:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:55:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:55:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:55:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:55:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:55:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 04:55:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 04:55:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 04:55:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:55:32 user nova-compute[72444]: INFO nova.compute.manager [None req-8c9ffd46-2e91-41e6-98f8-6a04f2aced98 tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Get console output
Aug 03 04:55:32 user nova-compute[72444]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 03 04:55:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:55:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:55:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:55:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:55:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 04:55:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 04:55:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 04:55:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:55:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:55:46 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:55:47 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:55:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:55:49 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:55:49 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 04:55:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:55:51 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:55:51 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:55:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:55:53 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:55:54 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:55:55 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:55:55 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 04:55:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-c77e96da-6411-4ae9-af05-8e9bb3c432c6" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:55:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-c77e96da-6411-4ae9-af05-8e9bb3c432c6" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:55:56 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 04:55:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:55:56 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Updating instance_info_cache with network_info: [{"id": "90104ef6-fe9b-4347-8df6-934a276e077b", "address": "fa:16:3e:22:ec:e0", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90104ef6-fe", "ovs_interfaceid": "90104ef6-fe9b-4347-8df6-934a276e077b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:55:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-c77e96da-6411-4ae9-af05-8e9bb3c432c6" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:55:56 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 04:55:56 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:55:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:55:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:55:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:55:56 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 04:55:56 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:55:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:58 user nova-compute[72444]: INFO nova.compute.manager [None req-104be2d2-812e-4be3-a0f4-5d6412d07994 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Unrescuing
Aug 03 04:55:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-104be2d2-812e-4be3-a0f4-5d6412d07994 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "refresh_cache-863f0679-c64c-4a13-8028-4cb194f8f99f" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:55:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-104be2d2-812e-4be3-a0f4-5d6412d07994 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquired lock "refresh_cache-863f0679-c64c-4a13-8028-4cb194f8f99f" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:55:58 user nova-compute[72444]: DEBUG nova.network.neutron [None req-104be2d2-812e-4be3-a0f4-5d6412d07994 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:55:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b86669d6-ff28-431f-9d5c-f297d86da758 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:55:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b86669d6-ff28-431f-9d5c-f297d86da758 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:55:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b86669d6-ff28-431f-9d5c-f297d86da758 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:55:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b86669d6-ff28-431f-9d5c-f297d86da758 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:55:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b86669d6-ff28-431f-9d5c-f297d86da758 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:55:58 user nova-compute[72444]: INFO nova.compute.manager [None req-b86669d6-ff28-431f-9d5c-f297d86da758 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Terminating instance
Aug 03 04:55:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-b86669d6-ff28-431f-9d5c-f297d86da758 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 04:55:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:55:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:55:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:55:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:55:58 user nova-compute[72444]: DEBUG nova.compute.manager [req-d5ed39f0-0093-4ccd-a8cd-db16355d2817 req-8ff48cea-16de-4592-be1e-0dd39b14d3c0 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Received event network-vif-unplugged-90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:55:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d5ed39f0-0093-4ccd-a8cd-db16355d2817 req-8ff48cea-16de-4592-be1e-0dd39b14d3c0 service nova] Acquiring lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:55:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d5ed39f0-0093-4ccd-a8cd-db16355d2817 req-8ff48cea-16de-4592-be1e-0dd39b14d3c0 service nova] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:55:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d5ed39f0-0093-4ccd-a8cd-db16355d2817 req-8ff48cea-16de-4592-be1e-0dd39b14d3c0 service nova] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:55:58 user nova-compute[72444]: DEBUG nova.compute.manager [req-d5ed39f0-0093-4ccd-a8cd-db16355d2817 req-8ff48cea-16de-4592-be1e-0dd39b14d3c0 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] No waiting events found dispatching network-vif-unplugged-90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:55:58 user nova-compute[72444]: DEBUG nova.compute.manager [req-d5ed39f0-0093-4ccd-a8cd-db16355d2817 req-8ff48cea-16de-4592-be1e-0dd39b14d3c0 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Received event network-vif-unplugged-90104ef6-fe9b-4347-8df6-934a276e077b for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:55:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:55:58 user nova-compute[72444]: DEBUG nova.network.neutron [None req-104be2d2-812e-4be3-a0f4-5d6412d07994 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Updating instance_info_cache with network_info: [{"id": "74465661-452c-4dba-b207-94f35c3fa50d", "address": "fa:16:3e:ea:30:b2", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74465661-45", "ovs_interfaceid": "74465661-452c-4dba-b207-94f35c3fa50d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:55:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:55:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-104be2d2-812e-4be3-a0f4-5d6412d07994 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Releasing lock "refresh_cache-863f0679-c64c-4a13-8028-4cb194f8f99f" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:55:58 user nova-compute[72444]: DEBUG nova.objects.instance [None req-104be2d2-812e-4be3-a0f4-5d6412d07994 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lazy-loading 'flavor' on Instance uuid 863f0679-c64c-4a13-8028-4cb194f8f99f {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:55:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:55:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:55:59 user nova-compute[72444]: DEBUG nova.compute.manager [req-38daa05e-6e16-4551-a2c3-d7366a1f1512 req-fff89a8b-876c-40eb-b56b-537b0cad7a31 service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Received event network-vif-unplugged-74465661-452c-4dba-b207-94f35c3fa50d {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:55:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-38daa05e-6e16-4551-a2c3-d7366a1f1512 req-fff89a8b-876c-40eb-b56b-537b0cad7a31 service nova] Acquiring lock "863f0679-c64c-4a13-8028-4cb194f8f99f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:55:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-38daa05e-6e16-4551-a2c3-d7366a1f1512 req-fff89a8b-876c-40eb-b56b-537b0cad7a31 service nova] Lock "863f0679-c64c-4a13-8028-4cb194f8f99f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:55:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-38daa05e-6e16-4551-a2c3-d7366a1f1512 req-fff89a8b-876c-40eb-b56b-537b0cad7a31 service nova] Lock "863f0679-c64c-4a13-8028-4cb194f8f99f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:55:59 user nova-compute[72444]: DEBUG nova.compute.manager [req-38daa05e-6e16-4551-a2c3-d7366a1f1512 req-fff89a8b-876c-40eb-b56b-537b0cad7a31 service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] No waiting events found dispatching network-vif-unplugged-74465661-452c-4dba-b207-94f35c3fa50d {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:55:59 user nova-compute[72444]: WARNING nova.compute.manager [req-38daa05e-6e16-4551-a2c3-d7366a1f1512 req-fff89a8b-876c-40eb-b56b-537b0cad7a31 service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Received unexpected event network-vif-unplugged-74465661-452c-4dba-b207-94f35c3fa50d for instance with vm_state rescued and task_state unrescuing.
Aug 03 04:55:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:55:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:55:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:55:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:55:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:55:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:55:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:55:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:55:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:55:59 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Instance destroyed successfully.
Aug 03 04:55:59 user nova-compute[72444]: DEBUG nova.objects.instance [None req-b86669d6-ff28-431f-9d5c-f297d86da758 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lazy-loading 'resources' on Instance uuid c77e96da-6411-4ae9-af05-8e9bb3c432c6 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:55:59 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Instance destroyed successfully.
Aug 03 04:55:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-b86669d6-ff28-431f-9d5c-f297d86da758 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:49:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-542782890',display_name='tempest-ServerRescueNegativeTestJSON-server-542782890',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-542782890',id=24,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmAjhUOOKCDltmr3EihMJCY9iEkC7NkRXw90VLoV9/lViPdH11qRTjE77g0xdU01gSL4ArFvtdc3yFICpu7HOjpk1RPgfTzpHtHhNK+y/xi3IO0oDY9ffaaWHdtTe8QZQ==',key_name='tempest-keypair-242052909',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:51:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='063a2a64796f4b87a44383014f0af3dc',ramdisk_id='',reservation_id='r-nw7lk90d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-665683708',owner_user_name='tempest-ServerRescueNegativeTestJSON-665683708-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:53:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07e8b540c9194e1195cb898ad08acaa0',uuid=c77e96da-6411-4ae9-af05-8e9bb3c432c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90104ef6-fe9b-4347-8df6-934a276e077b", "address": "fa:16:3e:22:ec:e0", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90104ef6-fe", "ovs_interfaceid": "90104ef6-fe9b-4347-8df6-934a276e077b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:55:59 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-b86669d6-ff28-431f-9d5c-f297d86da758 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Converting VIF {"id": "90104ef6-fe9b-4347-8df6-934a276e077b", "address": "fa:16:3e:22:ec:e0", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90104ef6-fe", "ovs_interfaceid": "90104ef6-fe9b-4347-8df6-934a276e077b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:55:59 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-b86669d6-ff28-431f-9d5c-f297d86da758 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:ec:e0,bridge_name='br-int',has_traffic_filtering=True,id=90104ef6-fe9b-4347-8df6-934a276e077b,network=Network(bc85da72-7764-4b65-a071-aec46e3a2398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90104ef6-fe') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:55:59 user nova-compute[72444]: DEBUG os_vif [None req-b86669d6-ff28-431f-9d5c-f297d86da758 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:ec:e0,bridge_name='br-int',has_traffic_filtering=True,id=90104ef6-fe9b-4347-8df6-934a276e077b,network=Network(bc85da72-7764-4b65-a071-aec46e3a2398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90104ef6-fe') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:55:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:55:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90104ef6-fe, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:55:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:55:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:55:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:00 user nova-compute[72444]: INFO os_vif [None req-b86669d6-ff28-431f-9d5c-f297d86da758 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:ec:e0,bridge_name='br-int',has_traffic_filtering=True,id=90104ef6-fe9b-4347-8df6-934a276e077b,network=Network(bc85da72-7764-4b65-a071-aec46e3a2398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90104ef6-fe')
Aug 03 04:56:00 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-b86669d6-ff28-431f-9d5c-f297d86da758 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Deleting instance files /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6_del
Aug 03 04:56:00 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-b86669d6-ff28-431f-9d5c-f297d86da758 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Deletion of /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6_del complete
Aug 03 04:56:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk --force-share --output=json" returned: 1 in 0.178s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] '/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk --force-share --output=json' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:56:00 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000018, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/c77e96da-6411-4ae9-af05-8e9bb3c432c6/disk
Aug 03 04:56:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:00 user nova-compute[72444]: INFO nova.compute.manager [None req-b86669d6-ff28-431f-9d5c-f297d86da758 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Took 1.50 seconds to destroy the instance on the hypervisor.
Aug 03 04:56:00 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-b86669d6-ff28-431f-9d5c-f297d86da758 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 04:56:00 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 04:56:00 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 04:56:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:00 user nova-compute[72444]: DEBUG nova.compute.manager [req-f8dfe9cf-922d-482c-9b80-02b4f30959e5 req-238914ee-79ea-44fe-85c9-3acaa3de6458 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Received event network-vif-plugged-90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:56:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f8dfe9cf-922d-482c-9b80-02b4f30959e5 req-238914ee-79ea-44fe-85c9-3acaa3de6458 service nova] Acquiring lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f8dfe9cf-922d-482c-9b80-02b4f30959e5 req-238914ee-79ea-44fe-85c9-3acaa3de6458 service nova] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f8dfe9cf-922d-482c-9b80-02b4f30959e5 req-238914ee-79ea-44fe-85c9-3acaa3de6458 service nova] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:00 user nova-compute[72444]: DEBUG nova.compute.manager [req-f8dfe9cf-922d-482c-9b80-02b4f30959e5 req-238914ee-79ea-44fe-85c9-3acaa3de6458 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] No waiting events found dispatching network-vif-plugged-90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:56:00 user nova-compute[72444]: WARNING nova.compute.manager [req-f8dfe9cf-922d-482c-9b80-02b4f30959e5 req-238914ee-79ea-44fe-85c9-3acaa3de6458 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Received unexpected event network-vif-plugged-90104ef6-fe9b-4347-8df6-934a276e077b for instance with vm_state active and task_state deleting.
Aug 03 04:56:00 user nova-compute[72444]: DEBUG nova.compute.manager [req-f8dfe9cf-922d-482c-9b80-02b4f30959e5 req-238914ee-79ea-44fe-85c9-3acaa3de6458 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Received event network-vif-plugged-90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:56:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f8dfe9cf-922d-482c-9b80-02b4f30959e5 req-238914ee-79ea-44fe-85c9-3acaa3de6458 service nova] Acquiring lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f8dfe9cf-922d-482c-9b80-02b4f30959e5 req-238914ee-79ea-44fe-85c9-3acaa3de6458 service nova] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f8dfe9cf-922d-482c-9b80-02b4f30959e5 req-238914ee-79ea-44fe-85c9-3acaa3de6458 service nova] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:00 user nova-compute[72444]: DEBUG nova.compute.manager [req-f8dfe9cf-922d-482c-9b80-02b4f30959e5 req-238914ee-79ea-44fe-85c9-3acaa3de6458 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] No waiting events found dispatching network-vif-plugged-90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:56:00 user nova-compute[72444]: WARNING nova.compute.manager [req-f8dfe9cf-922d-482c-9b80-02b4f30959e5 req-238914ee-79ea-44fe-85c9-3acaa3de6458 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Received unexpected event network-vif-plugged-90104ef6-fe9b-4347-8df6-934a276e077b for instance with vm_state active and task_state deleting.
Aug 03 04:56:00 user nova-compute[72444]: DEBUG nova.compute.manager [req-f8dfe9cf-922d-482c-9b80-02b4f30959e5 req-238914ee-79ea-44fe-85c9-3acaa3de6458 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Received event network-vif-plugged-90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:56:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f8dfe9cf-922d-482c-9b80-02b4f30959e5 req-238914ee-79ea-44fe-85c9-3acaa3de6458 service nova] Acquiring lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f8dfe9cf-922d-482c-9b80-02b4f30959e5 req-238914ee-79ea-44fe-85c9-3acaa3de6458 service nova] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f8dfe9cf-922d-482c-9b80-02b4f30959e5 req-238914ee-79ea-44fe-85c9-3acaa3de6458 service nova] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:00 user nova-compute[72444]: DEBUG nova.compute.manager [req-f8dfe9cf-922d-482c-9b80-02b4f30959e5 req-238914ee-79ea-44fe-85c9-3acaa3de6458 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] No waiting events found dispatching network-vif-plugged-90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:56:00 user nova-compute[72444]: WARNING nova.compute.manager [req-f8dfe9cf-922d-482c-9b80-02b4f30959e5 req-238914ee-79ea-44fe-85c9-3acaa3de6458 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Received unexpected event network-vif-plugged-90104ef6-fe9b-4347-8df6-934a276e077b for instance with vm_state active and task_state deleting.
Aug 03 04:56:00 user nova-compute[72444]: DEBUG nova.compute.manager [req-f8dfe9cf-922d-482c-9b80-02b4f30959e5 req-238914ee-79ea-44fe-85c9-3acaa3de6458 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Received event network-vif-unplugged-90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:56:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f8dfe9cf-922d-482c-9b80-02b4f30959e5 req-238914ee-79ea-44fe-85c9-3acaa3de6458 service nova] Acquiring lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f8dfe9cf-922d-482c-9b80-02b4f30959e5 req-238914ee-79ea-44fe-85c9-3acaa3de6458 service nova] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f8dfe9cf-922d-482c-9b80-02b4f30959e5 req-238914ee-79ea-44fe-85c9-3acaa3de6458 service nova] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:00 user nova-compute[72444]: DEBUG nova.compute.manager [req-f8dfe9cf-922d-482c-9b80-02b4f30959e5 req-238914ee-79ea-44fe-85c9-3acaa3de6458 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] No waiting events found dispatching network-vif-unplugged-90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:56:00 user nova-compute[72444]: DEBUG nova.compute.manager [req-f8dfe9cf-922d-482c-9b80-02b4f30959e5 req-238914ee-79ea-44fe-85c9-3acaa3de6458 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Received event network-vif-unplugged-90104ef6-fe9b-4347-8df6-934a276e077b for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:56:00 user nova-compute[72444]: DEBUG nova.compute.manager [req-f8dfe9cf-922d-482c-9b80-02b4f30959e5 req-238914ee-79ea-44fe-85c9-3acaa3de6458 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Received event network-vif-plugged-90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:56:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f8dfe9cf-922d-482c-9b80-02b4f30959e5 req-238914ee-79ea-44fe-85c9-3acaa3de6458 service nova] Acquiring lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f8dfe9cf-922d-482c-9b80-02b4f30959e5 req-238914ee-79ea-44fe-85c9-3acaa3de6458 service nova] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f8dfe9cf-922d-482c-9b80-02b4f30959e5 req-238914ee-79ea-44fe-85c9-3acaa3de6458 service nova] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:00 user nova-compute[72444]: DEBUG nova.compute.manager [req-f8dfe9cf-922d-482c-9b80-02b4f30959e5 req-238914ee-79ea-44fe-85c9-3acaa3de6458 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] No waiting events found dispatching network-vif-plugged-90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:56:00 user nova-compute[72444]: WARNING nova.compute.manager [req-f8dfe9cf-922d-482c-9b80-02b4f30959e5 req-238914ee-79ea-44fe-85c9-3acaa3de6458 service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Received unexpected event network-vif-plugged-90104ef6-fe9b-4347-8df6-934a276e077b for instance with vm_state active and task_state deleting.
Aug 03 04:56:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:01 user nova-compute[72444]: DEBUG nova.compute.manager [req-601be133-f525-4708-b8ad-fd56b41b59a3 req-9ad0a21c-d744-443b-8e72-36ff94dcdc13 service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Received event network-vif-plugged-74465661-452c-4dba-b207-94f35c3fa50d {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:56:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-601be133-f525-4708-b8ad-fd56b41b59a3 req-9ad0a21c-d744-443b-8e72-36ff94dcdc13 service nova] Acquiring lock "863f0679-c64c-4a13-8028-4cb194f8f99f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-601be133-f525-4708-b8ad-fd56b41b59a3 req-9ad0a21c-d744-443b-8e72-36ff94dcdc13 service nova] Lock "863f0679-c64c-4a13-8028-4cb194f8f99f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-601be133-f525-4708-b8ad-fd56b41b59a3 req-9ad0a21c-d744-443b-8e72-36ff94dcdc13 service nova] Lock "863f0679-c64c-4a13-8028-4cb194f8f99f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:01 user nova-compute[72444]: DEBUG nova.compute.manager [req-601be133-f525-4708-b8ad-fd56b41b59a3 req-9ad0a21c-d744-443b-8e72-36ff94dcdc13 service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] No waiting events found dispatching network-vif-plugged-74465661-452c-4dba-b207-94f35c3fa50d {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:56:01 user nova-compute[72444]: WARNING nova.compute.manager [req-601be133-f525-4708-b8ad-fd56b41b59a3 req-9ad0a21c-d744-443b-8e72-36ff94dcdc13 service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Received unexpected event network-vif-plugged-74465661-452c-4dba-b207-94f35c3fa50d for instance with vm_state rescued and task_state unrescuing.
Aug 03 04:56:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:01 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:56:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:03 user nova-compute[72444]: DEBUG nova.compute.manager [req-dbb16ecb-f86c-4ff5-a67e-b8504e540366 req-07d8c91f-e463-4a09-8740-c9ca8d8df04d service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Received event network-vif-plugged-74465661-452c-4dba-b207-94f35c3fa50d {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:56:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-dbb16ecb-f86c-4ff5-a67e-b8504e540366 req-07d8c91f-e463-4a09-8740-c9ca8d8df04d service nova] Acquiring lock "863f0679-c64c-4a13-8028-4cb194f8f99f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-dbb16ecb-f86c-4ff5-a67e-b8504e540366 req-07d8c91f-e463-4a09-8740-c9ca8d8df04d service nova] Lock "863f0679-c64c-4a13-8028-4cb194f8f99f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-dbb16ecb-f86c-4ff5-a67e-b8504e540366 req-07d8c91f-e463-4a09-8740-c9ca8d8df04d service nova] Lock "863f0679-c64c-4a13-8028-4cb194f8f99f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:03 user nova-compute[72444]: DEBUG nova.compute.manager [req-dbb16ecb-f86c-4ff5-a67e-b8504e540366 req-07d8c91f-e463-4a09-8740-c9ca8d8df04d service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] No waiting events found dispatching network-vif-plugged-74465661-452c-4dba-b207-94f35c3fa50d {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:56:03 user nova-compute[72444]: WARNING nova.compute.manager [req-dbb16ecb-f86c-4ff5-a67e-b8504e540366 req-07d8c91f-e463-4a09-8740-c9ca8d8df04d service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Received unexpected event network-vif-plugged-74465661-452c-4dba-b207-94f35c3fa50d for instance with vm_state rescued and task_state unrescuing.
Aug 03 04:56:03 user nova-compute[72444]: DEBUG nova.compute.manager [req-dbb16ecb-f86c-4ff5-a67e-b8504e540366 req-07d8c91f-e463-4a09-8740-c9ca8d8df04d service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Received event network-vif-plugged-74465661-452c-4dba-b207-94f35c3fa50d {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:56:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-dbb16ecb-f86c-4ff5-a67e-b8504e540366 req-07d8c91f-e463-4a09-8740-c9ca8d8df04d service nova] Acquiring lock "863f0679-c64c-4a13-8028-4cb194f8f99f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-dbb16ecb-f86c-4ff5-a67e-b8504e540366 req-07d8c91f-e463-4a09-8740-c9ca8d8df04d service nova] Lock "863f0679-c64c-4a13-8028-4cb194f8f99f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-dbb16ecb-f86c-4ff5-a67e-b8504e540366 req-07d8c91f-e463-4a09-8740-c9ca8d8df04d service nova] Lock "863f0679-c64c-4a13-8028-4cb194f8f99f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:03 user nova-compute[72444]: DEBUG nova.compute.manager [req-dbb16ecb-f86c-4ff5-a67e-b8504e540366 req-07d8c91f-e463-4a09-8740-c9ca8d8df04d service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] No waiting events found dispatching network-vif-plugged-74465661-452c-4dba-b207-94f35c3fa50d {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:56:03 user nova-compute[72444]: WARNING nova.compute.manager [req-dbb16ecb-f86c-4ff5-a67e-b8504e540366 req-07d8c91f-e463-4a09-8740-c9ca8d8df04d service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Received unexpected event network-vif-plugged-74465661-452c-4dba-b207-94f35c3fa50d for instance with vm_state rescued and task_state unrescuing.
Aug 03 04:56:03 user nova-compute[72444]: DEBUG nova.compute.manager [req-dbb16ecb-f86c-4ff5-a67e-b8504e540366 req-07d8c91f-e463-4a09-8740-c9ca8d8df04d service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Received event network-vif-deleted-90104ef6-fe9b-4347-8df6-934a276e077b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:56:03 user nova-compute[72444]: INFO nova.compute.manager [req-dbb16ecb-f86c-4ff5-a67e-b8504e540366 req-07d8c91f-e463-4a09-8740-c9ca8d8df04d service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Neutron deleted interface 90104ef6-fe9b-4347-8df6-934a276e077b; detaching it from the instance and deleting it from the info cache
Aug 03 04:56:03 user nova-compute[72444]: DEBUG nova.network.neutron [req-dbb16ecb-f86c-4ff5-a67e-b8504e540366 req-07d8c91f-e463-4a09-8740-c9ca8d8df04d service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:56:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-104be2d2-812e-4be3-a0f4-5d6412d07994 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:56:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Removed pending event for 863f0679-c64c-4a13-8028-4cb194f8f99f due to event {{(pid=72444) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 03 04:56:03 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038563.3775094, 863f0679-c64c-4a13-8028-4cb194f8f99f => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:56:03 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] VM Resumed (Lifecycle Event)
Aug 03 04:56:03 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:56:03 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:56:03 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:56:03 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=7345MB free_disk=25.286033630371094GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 04:56:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:56:03 user nova-compute[72444]: DEBUG nova.compute.manager [req-dbb16ecb-f86c-4ff5-a67e-b8504e540366 req-07d8c91f-e463-4a09-8740-c9ca8d8df04d service nova] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Detach interface failed, port_id=90104ef6-fe9b-4347-8df6-934a276e077b, reason: Instance c77e96da-6411-4ae9-af05-8e9bb3c432c6 could not be found. {{(pid=72444) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 03 04:56:03 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Took 3.75 seconds to deallocate network for instance.
Aug 03 04:56:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:56:03 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 03 04:56:03 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038563.3808653, 863f0679-c64c-4a13-8028-4cb194f8f99f => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:56:03 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] VM Started (Lifecycle Event)
Aug 03 04:56:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b86669d6-ff28-431f-9d5c-f297d86da758 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:56:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:56:04 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:56:04 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 81725845-6158-4e34-bedb-6e41219bc227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:56:04 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance b6ed9c42-fa6e-4a0d-8312-588471e157f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:56:04 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance e2859322-6f99-442d-bee1-65fe49ce6360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:56:04 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:56:04 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 0b219bf3-a3b6-44b5-946e-c10e7498e1d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:56:04 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance c77e96da-6411-4ae9-af05-8e9bb3c432c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:56:04 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance c94f537a-b1a1-4cea-996d-e1a88a2c9dac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:56:04 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance c4af22f7-45f8-4777-83ee-5cf1481c9fe8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:56:04 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 863f0679-c64c-4a13-8028-4cb194f8f99f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:56:04 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:56:04 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance ae41789a-ebd1-4265-a903-32d2006e66d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:56:04 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 04:56:04 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 04:56:04 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:56:04 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:56:04 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 04:56:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.737s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b86669d6-ff28-431f-9d5c-f297d86da758 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.666s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:04 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:56:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:04 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-b86669d6-ff28-431f-9d5c-f297d86da758 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:56:05 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-b86669d6-ff28-431f-9d5c-f297d86da758 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:56:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b86669d6-ff28-431f-9d5c-f297d86da758 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.435s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:05 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-b86669d6-ff28-431f-9d5c-f297d86da758 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Deleted allocations for instance c77e96da-6411-4ae9-af05-8e9bb3c432c6
Aug 03 04:56:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b86669d6-ff28-431f-9d5c-f297d86da758 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "c77e96da-6411-4ae9-af05-8e9bb3c432c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.573s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:05 user nova-compute[72444]: DEBUG nova.compute.manager [None req-af845e8a-fa6e-4857-800e-1d0942dad059 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:56:05 user nova-compute[72444]: INFO nova.compute.manager [None req-af845e8a-fa6e-4857-800e-1d0942dad059 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] instance snapshotting
Aug 03 04:56:06 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-af845e8a-fa6e-4857-800e-1d0942dad059 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Beginning live snapshot process
Aug 03 04:56:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-af845e8a-fa6e-4857-800e-1d0942dad059 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk --force-share --output=json -f qcow2 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-af845e8a-fa6e-4857-800e-1d0942dad059 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk --force-share --output=json -f qcow2" returned: 0 in 0.139s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-af845e8a-fa6e-4857-800e-1d0942dad059 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk --force-share --output=json -f qcow2 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-af845e8a-fa6e-4857-800e-1d0942dad059 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk --force-share --output=json -f qcow2" returned: 0 in 0.141s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-af845e8a-fa6e-4857-800e-1d0942dad059 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-af845e8a-fa6e-4857-800e-1d0942dad059 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.138s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-af845e8a-fa6e-4857-800e-1d0942dad059 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp3oeb6_hm/0a918184db2841ca99b2453ec57a9e24.delta 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-af845e8a-fa6e-4857-800e-1d0942dad059 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp3oeb6_hm/0a918184db2841ca99b2453ec57a9e24.delta 1073741824" returned: 0 in 0.052s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:06 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-af845e8a-fa6e-4857-800e-1d0942dad059 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 03 04:56:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Acquiring lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:07 user nova-compute[72444]: DEBUG nova.objects.instance [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lazy-loading 'flavor' on Instance uuid c94f537a-b1a1-4cea-996d-e1a88a2c9dac {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:56:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-af845e8a-fa6e-4857-800e-1d0942dad059 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72444) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 03 04:56:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Acquiring lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:07 user nova-compute[72444]: INFO nova.compute.manager [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Attaching volume 774797b7-ffe4-45fb-848e-1813949df5aa to /dev/vdb
Aug 03 04:56:07 user nova-compute[72444]: DEBUG os_brick.utils [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:56:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccef74a-c4ab-487b-8222-9e29aaba3e25]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca3e70c-3cd9-444a-a4e0-6374f27d1643]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-af845e8a-fa6e-4857-800e-1d0942dad059 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75563008 {{(pid=72444) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 03 04:56:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c14449f-a4c8-4c7b-8223-8a1d46832fac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a1ee69-35a7-4b9c-bae5-b45ecf4caee9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:56:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 04:56:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:56:08 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 04:56:08 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbb2f78-c4aa-4d8e-ad70-d0d052eca26a]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 04:56:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 04:56:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 04:56:08 user nova-compute[72444]: DEBUG os_brick.utils [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:56:08 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Updating existing volume attachment record: fe8dd0f0-eb73-41a4-bd4e-0d6058516131 {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 04:56:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-af845e8a-fa6e-4857-800e-1d0942dad059 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72444) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 03 04:56:08 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-af845e8a-fa6e-4857-800e-1d0942dad059 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 03 04:56:08 user nova-compute[72444]: DEBUG nova.privsep.utils [None req-af845e8a-fa6e-4857-800e-1d0942dad059 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72444) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 03 04:56:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-af845e8a-fa6e-4857-800e-1d0942dad059 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp3oeb6_hm/0a918184db2841ca99b2453ec57a9e24.delta /opt/stack/data/nova/instances/snapshots/tmp3oeb6_hm/0a918184db2841ca99b2453ec57a9e24 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-af845e8a-fa6e-4857-800e-1d0942dad059 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp3oeb6_hm/0a918184db2841ca99b2453ec57a9e24.delta /opt/stack/data/nova/instances/snapshots/tmp3oeb6_hm/0a918184db2841ca99b2453ec57a9e24" returned: 0 in 0.578s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:09 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-af845e8a-fa6e-4857-800e-1d0942dad059 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Snapshot extracted, beginning image upload
Aug 03 04:56:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:11 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-af845e8a-fa6e-4857-800e-1d0942dad059 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Snapshot image upload complete
Aug 03 04:56:11 user nova-compute[72444]: INFO nova.compute.manager [None req-af845e8a-fa6e-4857-800e-1d0942dad059 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Took 5.92 seconds to snapshot the instance on the hypervisor.
Aug 03 04:56:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Acquiring lock "87667868-78ed-4d9f-aff0-b6f0eda241bd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "87667868-78ed-4d9f-aff0-b6f0eda241bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:14 user nova-compute[72444]: DEBUG nova.compute.manager [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 04:56:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:14 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 04:56:14 user nova-compute[72444]: INFO nova.compute.claims [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Claim successful on node user
Aug 03 04:56:14 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:56:14 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:56:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.550s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:14 user nova-compute[72444]: DEBUG nova.compute.manager [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 04:56:14 user nova-compute[72444]: DEBUG nova.compute.manager [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 04:56:14 user nova-compute[72444]: DEBUG nova.network.neutron [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 04:56:14 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 04:56:14 user nova-compute[72444]: DEBUG nova.compute.manager [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 04:56:14 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691038559.8527455, c77e96da-6411-4ae9-af05-8e9bb3c432c6 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:56:14 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] VM Stopped (Lifecycle Event)
Aug 03 04:56:14 user nova-compute[72444]: DEBUG nova.policy [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cfb2412d135d4e45b5b1c2edf63a560c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd114efe1dfc1424299621df67bf00863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 04:56:14 user nova-compute[72444]: DEBUG nova.compute.manager [None req-9794557f-02c4-40d0-853f-fd7da7d5db0c None None] [instance: c77e96da-6411-4ae9-af05-8e9bb3c432c6] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:56:14 user nova-compute[72444]: DEBUG nova.compute.manager [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 04:56:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 04:56:14 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Creating image(s)
Aug 03 04:56:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Acquiring lock "/opt/stack/data/nova/instances/87667868-78ed-4d9f-aff0-b6f0eda241bd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "/opt/stack/data/nova/instances/87667868-78ed-4d9f-aff0-b6f0eda241bd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "/opt/stack/data/nova/instances/87667868-78ed-4d9f-aff0-b6f0eda241bd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Acquiring lock "1efdd16df76198a83b6a587f7e5bfa6e644bed95" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "1efdd16df76198a83b6a587f7e5bfa6e644bed95" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1efdd16df76198a83b6a587f7e5bfa6e644bed95.part --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:15 user nova-compute[72444]: DEBUG nova.network.neutron [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Successfully created port: e6e423a5-90cd-466a-9a6f-6b99812426ee {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:56:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1efdd16df76198a83b6a587f7e5bfa6e644bed95.part --force-share --output=json" returned: 0 in 0.163s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:15 user nova-compute[72444]: DEBUG nova.virt.images [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] bf5603b1-3e6f-4a73-a2d8-b0f2e741a9f1 was qcow2, converting to raw {{(pid=72444) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 03 04:56:15 user nova-compute[72444]: DEBUG nova.privsep.utils [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72444) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 03 04:56:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1efdd16df76198a83b6a587f7e5bfa6e644bed95.part /opt/stack/data/nova/instances/_base/1efdd16df76198a83b6a587f7e5bfa6e644bed95.converted {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:16 user nova-compute[72444]: DEBUG nova.network.neutron [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Successfully updated port: e6e423a5-90cd-466a-9a6f-6b99812426ee {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Acquiring lock "refresh_cache-87667868-78ed-4d9f-aff0-b6f0eda241bd" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Acquired lock "refresh_cache-87667868-78ed-4d9f-aff0-b6f0eda241bd" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG nova.network.neutron [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1efdd16df76198a83b6a587f7e5bfa6e644bed95.part /opt/stack/data/nova/instances/_base/1efdd16df76198a83b6a587f7e5bfa6e644bed95.converted" returned: 0 in 1.062s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1efdd16df76198a83b6a587f7e5bfa6e644bed95.converted --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG nova.compute.manager [req-21f53a79-d33c-42a2-8487-cd08850583c9 req-ab2e08e8-9c59-4e38-80dc-1eb532e2c6a7 service nova] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Received event network-changed-e6e423a5-90cd-466a-9a6f-6b99812426ee {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG nova.compute.manager [req-21f53a79-d33c-42a2-8487-cd08850583c9 req-ab2e08e8-9c59-4e38-80dc-1eb532e2c6a7 service nova] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Refreshing instance network info cache due to event network-changed-e6e423a5-90cd-466a-9a6f-6b99812426ee. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-21f53a79-d33c-42a2-8487-cd08850583c9 req-ab2e08e8-9c59-4e38-80dc-1eb532e2c6a7 service nova] Acquiring lock "refresh_cache-87667868-78ed-4d9f-aff0-b6f0eda241bd" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG nova.network.neutron [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1efdd16df76198a83b6a587f7e5bfa6e644bed95.converted --force-share --output=json" returned: 0 in 0.143s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "1efdd16df76198a83b6a587f7e5bfa6e644bed95" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.249s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1efdd16df76198a83b6a587f7e5bfa6e644bed95 --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1efdd16df76198a83b6a587f7e5bfa6e644bed95 --force-share --output=json" returned: 0 in 0.139s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Acquiring lock "1efdd16df76198a83b6a587f7e5bfa6e644bed95" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "1efdd16df76198a83b6a587f7e5bfa6e644bed95" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1efdd16df76198a83b6a587f7e5bfa6e644bed95 --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG nova.network.neutron [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Updating instance_info_cache with network_info: [{"id": "e6e423a5-90cd-466a-9a6f-6b99812426ee", "address": "fa:16:3e:98:7f:e7", "network": {"id": "bb35bc76-087b-4468-ba0c-3637873207f8", "bridge": "br-int", "label": "tempest-TestStampPattern-620416114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d114efe1dfc1424299621df67bf00863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e423a5-90", "ovs_interfaceid": "e6e423a5-90cd-466a-9a6f-6b99812426ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1efdd16df76198a83b6a587f7e5bfa6e644bed95 --force-share --output=json" returned: 0 in 0.146s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1efdd16df76198a83b6a587f7e5bfa6e644bed95,backing_fmt=raw /opt/stack/data/nova/instances/87667868-78ed-4d9f-aff0-b6f0eda241bd/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Releasing lock "refresh_cache-87667868-78ed-4d9f-aff0-b6f0eda241bd" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG nova.compute.manager [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Instance network_info: |[{"id": "e6e423a5-90cd-466a-9a6f-6b99812426ee", "address": "fa:16:3e:98:7f:e7", "network": {"id": "bb35bc76-087b-4468-ba0c-3637873207f8", "bridge": "br-int", "label": "tempest-TestStampPattern-620416114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d114efe1dfc1424299621df67bf00863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e423a5-90", "ovs_interfaceid": "e6e423a5-90cd-466a-9a6f-6b99812426ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-21f53a79-d33c-42a2-8487-cd08850583c9 req-ab2e08e8-9c59-4e38-80dc-1eb532e2c6a7 service nova] Acquired lock "refresh_cache-87667868-78ed-4d9f-aff0-b6f0eda241bd" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG nova.network.neutron [req-21f53a79-d33c-42a2-8487-cd08850583c9 req-ab2e08e8-9c59-4e38-80dc-1eb532e2c6a7 service nova] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Refreshing network info cache for port e6e423a5-90cd-466a-9a6f-6b99812426ee {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1efdd16df76198a83b6a587f7e5bfa6e644bed95,backing_fmt=raw /opt/stack/data/nova/instances/87667868-78ed-4d9f-aff0-b6f0eda241bd/disk 1073741824" returned: 0 in 0.062s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "1efdd16df76198a83b6a587f7e5bfa6e644bed95" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1efdd16df76198a83b6a587f7e5bfa6e644bed95 --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1efdd16df76198a83b6a587f7e5bfa6e644bed95 --force-share --output=json" returned: 0 in 0.136s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG nova.objects.instance [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lazy-loading 'migration_context' on Instance uuid 87667868-78ed-4d9f-aff0-b6f0eda241bd {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Ensure instance console log exists: /opt/stack/data/nova/instances/87667868-78ed-4d9f-aff0-b6f0eda241bd/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Start _get_guest_xml network_info=[{"id": "e6e423a5-90cd-466a-9a6f-6b99812426ee", "address": "fa:16:3e:98:7f:e7", "network": {"id": "bb35bc76-087b-4468-ba0c-3637873207f8", "bridge": "br-int", "label": "tempest-TestStampPattern-620416114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d114efe1dfc1424299621df67bf00863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e423a5-90", "ovs_interfaceid": "e6e423a5-90cd-466a-9a6f-6b99812426ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c2e7f1925f1baa56c38d0b6a6a3fff68',container_format='bare',created_at=2023-08-03T04:56:06Z,direct_url=<?>,disk_format='qcow2',id=bf5603b1-3e6f-4a73-a2d8-b0f2e741a9f1,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1993772235',owner='d114efe1dfc1424299621df67bf00863',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-03T04:56:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': 'bf5603b1-3e6f-4a73-a2d8-b0f2e741a9f1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:56:17 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:56:17 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:56:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c2e7f1925f1baa56c38d0b6a6a3fff68',container_format='bare',created_at=2023-08-03T04:56:06Z,direct_url=<?>,disk_format='qcow2',id=bf5603b1-3e6f-4a73-a2d8-b0f2e741a9f1,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1993772235',owner='d114efe1dfc1424299621df67bf00863',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-03T04:56:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:56:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-481630748',display_name='tempest-TestStampPattern-server-481630748',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-481630748',id=32,image_ref='bf5603b1-3e6f-4a73-a2d8-b0f2e741a9f1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0MFXjSU5PJXVROOnqeclCBxvU1Uyrwrp4WGd6L7LODOpU9OooUOpH73m523qz3COWVGWjrJJsa98O/ExJkhRZGY7wvCQTS/3+V2FidnkreOl/H1zHbvv0lhsewf7GMag==',key_name='tempest-TestStampPattern-164301022',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d114efe1dfc1424299621df67bf00863',ramdisk_id='',reservation_id='r-zsj6200c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='ae41789a-ebd1-4265-a903-32d2006e66d1',image_min_disk='1',image_min_ram='0',image_owner_id='d114efe1dfc1424299621df67bf00863',image_owner_project_name='tempest-TestStampPattern-786118238',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-786118238-project-member',image_user_id='cfb2412d135d4e45b5b1c2edf63a560c',network_allocated='True',owner_project_name='tempest-TestStampPattern-786118238',owner_user_name='tempest-TestStampPattern-786118238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:56:15Z,user_data=None,user_id='cfb2412d135d4e45b5b1c2edf63a560c',uuid=87667868-78ed-4d9f-aff0-b6f0eda241bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6e423a5-90cd-466a-9a6f-6b99812426ee", "address": "fa:16:3e:98:7f:e7", "network": {"id": "bb35bc76-087b-4468-ba0c-3637873207f8", "bridge": "br-int", "label": "tempest-TestStampPattern-620416114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d114efe1dfc1424299621df67bf00863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e423a5-90", "ovs_interfaceid": "e6e423a5-90cd-466a-9a6f-6b99812426ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Converting VIF {"id": "e6e423a5-90cd-466a-9a6f-6b99812426ee", "address": "fa:16:3e:98:7f:e7", "network": {"id": "bb35bc76-087b-4468-ba0c-3637873207f8", "bridge": "br-int", "label": "tempest-TestStampPattern-620416114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d114efe1dfc1424299621df67bf00863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e423a5-90", "ovs_interfaceid": "e6e423a5-90cd-466a-9a6f-6b99812426ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:7f:e7,bridge_name='br-int',has_traffic_filtering=True,id=e6e423a5-90cd-466a-9a6f-6b99812426ee,network=Network(bb35bc76-087b-4468-ba0c-3637873207f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6e423a5-90') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG nova.objects.instance [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lazy-loading 'pci_devices' on Instance uuid 87667868-78ed-4d9f-aff0-b6f0eda241bd {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:56:17 user nova-compute[72444]:   <uuid>87667868-78ed-4d9f-aff0-b6f0eda241bd</uuid>
Aug 03 04:56:17 user nova-compute[72444]:   <name>instance-00000020</name>
Aug 03 04:56:17 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:56:17 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:56:17 user nova-compute[72444]:   <metadata>
Aug 03 04:56:17 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:56:17 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:56:17 user nova-compute[72444]:       <nova:name>tempest-TestStampPattern-server-481630748</nova:name>
Aug 03 04:56:17 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:56:17</nova:creationTime>
Aug 03 04:56:17 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:56:17 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:56:17 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:56:17 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:56:17 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:56:17 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:56:17 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:56:17 user nova-compute[72444]:       <nova:owner>
Aug 03 04:56:17 user nova-compute[72444]:         <nova:user uuid="cfb2412d135d4e45b5b1c2edf63a560c">tempest-TestStampPattern-786118238-project-member</nova:user>
Aug 03 04:56:17 user nova-compute[72444]:         <nova:project uuid="d114efe1dfc1424299621df67bf00863">tempest-TestStampPattern-786118238</nova:project>
Aug 03 04:56:17 user nova-compute[72444]:       </nova:owner>
Aug 03 04:56:17 user nova-compute[72444]:       <nova:root type="image" uuid="bf5603b1-3e6f-4a73-a2d8-b0f2e741a9f1"/>
Aug 03 04:56:17 user nova-compute[72444]:       <nova:ports>
Aug 03 04:56:17 user nova-compute[72444]:         <nova:port uuid="e6e423a5-90cd-466a-9a6f-6b99812426ee">
Aug 03 04:56:17 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 03 04:56:17 user nova-compute[72444]:         </nova:port>
Aug 03 04:56:17 user nova-compute[72444]:       </nova:ports>
Aug 03 04:56:17 user nova-compute[72444]:     </nova:instance>
Aug 03 04:56:17 user nova-compute[72444]:   </metadata>
Aug 03 04:56:17 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:56:17 user nova-compute[72444]:     <system>
Aug 03 04:56:17 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:56:17 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:56:17 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:56:17 user nova-compute[72444]:       <entry name="serial">87667868-78ed-4d9f-aff0-b6f0eda241bd</entry>
Aug 03 04:56:17 user nova-compute[72444]:       <entry name="uuid">87667868-78ed-4d9f-aff0-b6f0eda241bd</entry>
Aug 03 04:56:17 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:56:17 user nova-compute[72444]:     </system>
Aug 03 04:56:17 user nova-compute[72444]:   </sysinfo>
Aug 03 04:56:17 user nova-compute[72444]:   <os>
Aug 03 04:56:17 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:56:17 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:56:17 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:56:17 user nova-compute[72444]:   </os>
Aug 03 04:56:17 user nova-compute[72444]:   <features>
Aug 03 04:56:17 user nova-compute[72444]:     <acpi/>
Aug 03 04:56:17 user nova-compute[72444]:     <apic/>
Aug 03 04:56:17 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:56:17 user nova-compute[72444]:   </features>
Aug 03 04:56:17 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:56:17 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:56:17 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:56:17 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:56:17 user nova-compute[72444]:   </clock>
Aug 03 04:56:17 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:56:17 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:56:17 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:56:17 user nova-compute[72444]:   </cpu>
Aug 03 04:56:17 user nova-compute[72444]:   <devices>
Aug 03 04:56:17 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:56:17 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:56:17 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/87667868-78ed-4d9f-aff0-b6f0eda241bd/disk"/>
Aug 03 04:56:17 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:56:17 user nova-compute[72444]:     </disk>
Aug 03 04:56:17 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:56:17 user nova-compute[72444]:       <mac address="fa:16:3e:98:7f:e7"/>
Aug 03 04:56:17 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:56:17 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:56:17 user nova-compute[72444]:       <target dev="tape6e423a5-90"/>
Aug 03 04:56:17 user nova-compute[72444]:     </interface>
Aug 03 04:56:17 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:56:17 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/87667868-78ed-4d9f-aff0-b6f0eda241bd/console.log" append="off"/>
Aug 03 04:56:17 user nova-compute[72444]:     </serial>
Aug 03 04:56:17 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:56:17 user nova-compute[72444]:     <video>
Aug 03 04:56:17 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:56:17 user nova-compute[72444]:     </video>
Aug 03 04:56:17 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:56:17 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:56:17 user nova-compute[72444]:     </rng>
Aug 03 04:56:17 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:56:17 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:56:17 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:56:17 user nova-compute[72444]:     </memballoon>
Aug 03 04:56:17 user nova-compute[72444]:   </devices>
Aug 03 04:56:17 user nova-compute[72444]: </domain>
Aug 03 04:56:17 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:56:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-481630748',display_name='tempest-TestStampPattern-server-481630748',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-481630748',id=32,image_ref='bf5603b1-3e6f-4a73-a2d8-b0f2e741a9f1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0MFXjSU5PJXVROOnqeclCBxvU1Uyrwrp4WGd6L7LODOpU9OooUOpH73m523qz3COWVGWjrJJsa98O/ExJkhRZGY7wvCQTS/3+V2FidnkreOl/H1zHbvv0lhsewf7GMag==',key_name='tempest-TestStampPattern-164301022',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d114efe1dfc1424299621df67bf00863',ramdisk_id='',reservation_id='r-zsj6200c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='ae41789a-ebd1-4265-a903-32d2006e66d1',image_min_disk='1',image_min_ram='0',image_owner_id='d114efe1dfc1424299621df67bf00863',image_owner_project_name='tempest-TestStampPattern-786118238',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-786118238-project-member',image_user_id='cfb2412d135d4e45b5b1c2edf63a560c',network_allocated='True',owner_project_name='tempest-TestStampPattern-786118238',owner_user_name='tempest-TestStampPattern-786118238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:56:15Z,user_data=None,user_id='cfb2412d135d4e45b5b1c2edf63a560c',uuid=87667868-78ed-4d9f-aff0-b6f0eda241bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6e423a5-90cd-466a-9a6f-6b99812426ee", "address": "fa:16:3e:98:7f:e7", "network": {"id": "bb35bc76-087b-4468-ba0c-3637873207f8", "bridge": "br-int", "label": "tempest-TestStampPattern-620416114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d114efe1dfc1424299621df67bf00863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e423a5-90", "ovs_interfaceid": "e6e423a5-90cd-466a-9a6f-6b99812426ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Converting VIF {"id": "e6e423a5-90cd-466a-9a6f-6b99812426ee", "address": "fa:16:3e:98:7f:e7", "network": {"id": "bb35bc76-087b-4468-ba0c-3637873207f8", "bridge": "br-int", "label": "tempest-TestStampPattern-620416114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d114efe1dfc1424299621df67bf00863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e423a5-90", "ovs_interfaceid": "e6e423a5-90cd-466a-9a6f-6b99812426ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:7f:e7,bridge_name='br-int',has_traffic_filtering=True,id=e6e423a5-90cd-466a-9a6f-6b99812426ee,network=Network(bb35bc76-087b-4468-ba0c-3637873207f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6e423a5-90') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG os_vif [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:7f:e7,bridge_name='br-int',has_traffic_filtering=True,id=e6e423a5-90cd-466a-9a6f-6b99812426ee,network=Network(bb35bc76-087b-4468-ba0c-3637873207f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6e423a5-90') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6e423a5-90, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape6e423a5-90, col_values=(('external_ids', {'iface-id': 'e6e423a5-90cd-466a-9a6f-6b99812426ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:7f:e7', 'vm-uuid': '87667868-78ed-4d9f-aff0-b6f0eda241bd'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:17 user nova-compute[72444]: INFO os_vif [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:7f:e7,bridge_name='br-int',has_traffic_filtering=True,id=e6e423a5-90cd-466a-9a6f-6b99812426ee,network=Network(bb35bc76-087b-4468-ba0c-3637873207f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6e423a5-90')
Aug 03 04:56:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:56:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] No VIF found with MAC fa:16:3e:98:7f:e7, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:56:18 user nova-compute[72444]: DEBUG nova.network.neutron [req-21f53a79-d33c-42a2-8487-cd08850583c9 req-ab2e08e8-9c59-4e38-80dc-1eb532e2c6a7 service nova] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Updated VIF entry in instance network info cache for port e6e423a5-90cd-466a-9a6f-6b99812426ee. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:56:18 user nova-compute[72444]: DEBUG nova.network.neutron [req-21f53a79-d33c-42a2-8487-cd08850583c9 req-ab2e08e8-9c59-4e38-80dc-1eb532e2c6a7 service nova] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Updating instance_info_cache with network_info: [{"id": "e6e423a5-90cd-466a-9a6f-6b99812426ee", "address": "fa:16:3e:98:7f:e7", "network": {"id": "bb35bc76-087b-4468-ba0c-3637873207f8", "bridge": "br-int", "label": "tempest-TestStampPattern-620416114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d114efe1dfc1424299621df67bf00863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e423a5-90", "ovs_interfaceid": "e6e423a5-90cd-466a-9a6f-6b99812426ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:56:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-21f53a79-d33c-42a2-8487-cd08850583c9 req-ab2e08e8-9c59-4e38-80dc-1eb532e2c6a7 service nova] Releasing lock "refresh_cache-87667868-78ed-4d9f-aff0-b6f0eda241bd" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:56:19 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:19 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:19 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:19 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:19 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:19 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:19 user nova-compute[72444]: DEBUG nova.compute.manager [req-268036db-3693-4b00-9594-22dc7e7fe8a8 req-e3fcef88-50b9-46dc-af75-6791f91cde5f service nova] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Received event network-vif-plugged-e6e423a5-90cd-466a-9a6f-6b99812426ee {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:56:19 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-268036db-3693-4b00-9594-22dc7e7fe8a8 req-e3fcef88-50b9-46dc-af75-6791f91cde5f service nova] Acquiring lock "87667868-78ed-4d9f-aff0-b6f0eda241bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:19 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-268036db-3693-4b00-9594-22dc7e7fe8a8 req-e3fcef88-50b9-46dc-af75-6791f91cde5f service nova] Lock "87667868-78ed-4d9f-aff0-b6f0eda241bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:19 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-268036db-3693-4b00-9594-22dc7e7fe8a8 req-e3fcef88-50b9-46dc-af75-6791f91cde5f service nova] Lock "87667868-78ed-4d9f-aff0-b6f0eda241bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:19 user nova-compute[72444]: DEBUG nova.compute.manager [req-268036db-3693-4b00-9594-22dc7e7fe8a8 req-e3fcef88-50b9-46dc-af75-6791f91cde5f service nova] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] No waiting events found dispatching network-vif-plugged-e6e423a5-90cd-466a-9a6f-6b99812426ee {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:56:19 user nova-compute[72444]: WARNING nova.compute.manager [req-268036db-3693-4b00-9594-22dc7e7fe8a8 req-e3fcef88-50b9-46dc-af75-6791f91cde5f service nova] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Received unexpected event network-vif-plugged-e6e423a5-90cd-466a-9a6f-6b99812426ee for instance with vm_state building and task_state spawning.
Aug 03 04:56:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:21 user nova-compute[72444]: DEBUG nova.compute.manager [req-94230b6a-fb4f-4405-b263-91db930145eb req-794a107c-d19b-48dd-b6b0-3a70e5ea67a4 service nova] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Received event network-vif-plugged-e6e423a5-90cd-466a-9a6f-6b99812426ee {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:56:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-94230b6a-fb4f-4405-b263-91db930145eb req-794a107c-d19b-48dd-b6b0-3a70e5ea67a4 service nova] Acquiring lock "87667868-78ed-4d9f-aff0-b6f0eda241bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-94230b6a-fb4f-4405-b263-91db930145eb req-794a107c-d19b-48dd-b6b0-3a70e5ea67a4 service nova] Lock "87667868-78ed-4d9f-aff0-b6f0eda241bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-94230b6a-fb4f-4405-b263-91db930145eb req-794a107c-d19b-48dd-b6b0-3a70e5ea67a4 service nova] Lock "87667868-78ed-4d9f-aff0-b6f0eda241bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:21 user nova-compute[72444]: DEBUG nova.compute.manager [req-94230b6a-fb4f-4405-b263-91db930145eb req-794a107c-d19b-48dd-b6b0-3a70e5ea67a4 service nova] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] No waiting events found dispatching network-vif-plugged-e6e423a5-90cd-466a-9a6f-6b99812426ee {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:56:21 user nova-compute[72444]: WARNING nova.compute.manager [req-94230b6a-fb4f-4405-b263-91db930145eb req-794a107c-d19b-48dd-b6b0-3a70e5ea67a4 service nova] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Received unexpected event network-vif-plugged-e6e423a5-90cd-466a-9a6f-6b99812426ee for instance with vm_state building and task_state spawning.
Aug 03 04:56:21 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038581.6802523, 87667868-78ed-4d9f-aff0-b6f0eda241bd => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:56:21 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] VM Resumed (Lifecycle Event)
Aug 03 04:56:21 user nova-compute[72444]: DEBUG nova.compute.manager [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:56:21 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 04:56:21 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Instance spawned successfully.
Aug 03 04:56:21 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 04:56:21 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:56:21 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:56:21 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:56:21 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:56:21 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:56:21 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038581.6836216, 87667868-78ed-4d9f-aff0-b6f0eda241bd => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:56:21 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] VM Started (Lifecycle Event)
Aug 03 04:56:21 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:56:21 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:56:21 user nova-compute[72444]: INFO nova.compute.manager [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Took 6.85 seconds to spawn the instance on the hypervisor.
Aug 03 04:56:21 user nova-compute[72444]: DEBUG nova.compute.manager [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:56:21 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:56:21 user nova-compute[72444]: INFO nova.compute.manager [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Took 7.83 seconds to build instance.
Aug 03 04:56:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-a49e6d74-8692-4154-9549-df47fcbd5c04 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "87667868-78ed-4d9f-aff0-b6f0eda241bd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.930s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:22 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:22 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:56:22 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wEuzakXA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:56:22 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:56:22 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:56:22 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:56:22 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:56:22 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:56:22 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:56:22 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:56:22 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[793ba82e-3aae-4939-8ab6-17f83ea22bc7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 04:56:23 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a73fa1a-2f78-416a-a6cd-60fc92f4b1b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa] added
Aug 03 04:56:23 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a556d5d1-060f-470a-92f5-26d58aab4f07]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c006a38-312e-4949-9ac6-d2cd66fc570a]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wEuzakXA {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wEuzakXA" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc28094-1580-46d6-9fa7-c3752e9cbad7]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wEuzakXA'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8b3e64-8656-42c5-9bad-b6b26e545344]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ae63c6-a9b2-46fa-a122-db1925abe800]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:56:23 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:56:23 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:56:23 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:56:23 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:56:23 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:56:23 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2675019-ee7c-4105-b0e9-ca8acbd6673f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa, portal: 172.16.0.220,3260]
Aug 03 04:56:23 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa, portal: 172.16.0.220,3260] successful.
Aug 03 04:56:23 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7982eff-0dc1-41c4-866b-d11302263898]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c36e196-c2f5-4a31-9c84-3904288b6967]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:56:23 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:56:23 user nova-compute[72444]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa (non-flash)
Aug 03 04:56:23 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:56:23 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:56:23 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:56:23 user nova-compute[72444]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa (non-flash)
Aug 03 04:56:23 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:56:23 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[30415a89-9f13-463b-a2c0-5dfa979d0c74]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:23 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: None {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:56:24 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:56:24 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wEuzakXA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:56:24 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:56:24 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23135303330353266', 'path': '/dev/sdb'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:56:24 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135303330353266', 'path': '/dev/sdb'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:56:24 user nova-compute[72444]: DEBUG nova.objects.instance [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lazy-loading 'flavor' on Instance uuid c94f537a-b1a1-4cea-996d-e1a88a2c9dac {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:56:24 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 04:56:24 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:56:24 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 04:56:24 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:56:24 user nova-compute[72444]:   <serial>774797b7-ffe4-45fb-848e-1813949df5aa</serial>
Aug 03 04:56:24 user nova-compute[72444]: </disk>
Aug 03 04:56:24 user nova-compute[72444]:  {{(pid=72444) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 04:56:24 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:56:24 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:56:24 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] No VIF found with MAC fa:16:3e:7f:5d:57, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:56:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7c75fc7a-1494-4896-bc55-5d2e1bcdcfdc tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.194s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-a8cf9e20-81c4-44bf-bdf7-e5938fb76c3f tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Acquiring lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-a8cf9e20-81c4-44bf-bdf7-e5938fb76c3f tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:26 user nova-compute[72444]: INFO nova.compute.manager [None req-a8cf9e20-81c4-44bf-bdf7-e5938fb76c3f tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Detaching volume 774797b7-ffe4-45fb-848e-1813949df5aa
Aug 03 04:56:26 user nova-compute[72444]: INFO nova.virt.block_device [None req-a8cf9e20-81c4-44bf-bdf7-e5938fb76c3f tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Attempting to driver detach volume 774797b7-ffe4-45fb-848e-1813949df5aa from mountpoint /dev/vdb
Aug 03 04:56:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-a8cf9e20-81c4-44bf-bdf7-e5938fb76c3f tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Attempting to detach device vdb from instance c94f537a-b1a1-4cea-996d-e1a88a2c9dac from the persistent domain config. {{(pid=72444) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 04:56:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-a8cf9e20-81c4-44bf-bdf7-e5938fb76c3f tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 04:56:26 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:56:26 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 04:56:26 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:56:26 user nova-compute[72444]:   <serial>774797b7-ffe4-45fb-848e-1813949df5aa</serial>
Aug 03 04:56:26 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 04:56:26 user nova-compute[72444]: </disk>
Aug 03 04:56:26 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:56:26 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-a8cf9e20-81c4-44bf-bdf7-e5938fb76c3f tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Successfully detached device vdb from instance c94f537a-b1a1-4cea-996d-e1a88a2c9dac from the persistent domain config.
Aug 03 04:56:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-a8cf9e20-81c4-44bf-bdf7-e5938fb76c3f tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c94f537a-b1a1-4cea-996d-e1a88a2c9dac from the live domain config. {{(pid=72444) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 04:56:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-a8cf9e20-81c4-44bf-bdf7-e5938fb76c3f tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 04:56:26 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:56:26 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 04:56:26 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:56:26 user nova-compute[72444]:   <serial>774797b7-ffe4-45fb-848e-1813949df5aa</serial>
Aug 03 04:56:26 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 04:56:26 user nova-compute[72444]: </disk>
Aug 03 04:56:26 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Received event <DeviceRemovedEvent: 1691038587.4152663, c94f537a-b1a1-4cea-996d-e1a88a2c9dac => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72444) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-a8cf9e20-81c4-44bf-bdf7-e5938fb76c3f tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c94f537a-b1a1-4cea-996d-e1a88a2c9dac {{(pid=72444) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 04:56:27 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-a8cf9e20-81c4-44bf-bdf7-e5938fb76c3f tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Successfully detached device vdb from instance c94f537a-b1a1-4cea-996d-e1a88a2c9dac from the live domain config.
Aug 03 04:56:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8cf9e20-81c4-44bf-bdf7-e5938fb76c3f tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cf9e20-81c4-44bf-bdf7-e5938fb76c3f tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wEuzakXA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:56:27 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-a8cf9e20-81c4-44bf-bdf7-e5938fb76c3f tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:56:27 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-a8cf9e20-81c4-44bf-bdf7-e5938fb76c3f tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-a8cf9e20-81c4-44bf-bdf7-e5938fb76c3f tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cf9e20-81c4-44bf-bdf7-e5938fb76c3f tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6fdfae-fadb-47c8-8a37-9c0c0f6e9e25]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a79331-72c3-463b-ab22-e6ee9c885138]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cf9e20-81c4-44bf-bdf7-e5938fb76c3f tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:56:27 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:56:27 user nova-compute[72444]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa (non-flash)
Aug 03 04:56:27 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:56:27 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cf9e20-81c4-44bf-bdf7-e5938fb76c3f tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:56:27 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:56:27 user nova-compute[72444]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa (non-flash)
Aug 03 04:56:27 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:56:27 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cf9e20-81c4-44bf-bdf7-e5938fb76c3f tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308c5e7eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa'): ({'sdb'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-a8cf9e20-81c4-44bf-bdf7-e5938fb76c3f tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Removing single pathed devices sdb {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab59aec-b30b-4681-bff9-0ccd95b84f4f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[76469f56-5656-45cc-b88a-6d91ff8012a7]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-a8cf9e20-81c4-44bf-bdf7-e5938fb76c3f tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Flushing IO for device /dev/sdb {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4fa5f5-81d9-49e0-8684-466c582e7d99]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-a8cf9e20-81c4-44bf-bdf7-e5938fb76c3f tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[de660edb-1083-4bc6-8233-33716f567105]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-a8cf9e20-81c4-44bf-bdf7-e5938fb76c3f tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-a8cf9e20-81c4-44bf-bdf7-e5938fb76c3f tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cf9e20-81c4-44bf-bdf7-e5938fb76c3f tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7636f2b3-47f8-41df-a335-79ae49f3503a]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cf9e20-81c4-44bf-bdf7-e5938fb76c3f tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[63775411-3aa6-4faf-8a4f-f20a1744a2bd]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cf9e20-81c4-44bf-bdf7-e5938fb76c3f tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa, portal: 172.16.0.220,3260]
Aug 03 04:56:27 user nova-compute[72444]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa, portal: 172.16.0.220,3260] successful.
Aug 03 04:56:27 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:774797b7-ffe4-45fb-848e-1813949df5aa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8157114-4b06-41d1-bc5e-4b67be0a4be2]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cf9e20-81c4-44bf-bdf7-e5938fb76c3f tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-a8cf9e20-81c4-44bf-bdf7-e5938fb76c3f tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cf9e20-81c4-44bf-bdf7-e5938fb76c3f tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] <== disconnect_volume: return (315ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8cf9e20-81c4-44bf-bdf7-e5938fb76c3f tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:56:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:28 user nova-compute[72444]: DEBUG nova.objects.instance [None req-a8cf9e20-81c4-44bf-bdf7-e5938fb76c3f tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lazy-loading 'flavor' on Instance uuid c94f537a-b1a1-4cea-996d-e1a88a2c9dac {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:56:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-a8cf9e20-81c4-44bf-bdf7-e5938fb76c3f tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.833s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Acquiring lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:29 user nova-compute[72444]: DEBUG nova.objects.instance [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lazy-loading 'flavor' on Instance uuid 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:56:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Acquiring lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:29 user nova-compute[72444]: INFO nova.compute.manager [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Attaching volume 5b877794-f7ef-40e2-80a9-f39ea90c2378 to /dev/vdb
Aug 03 04:56:29 user nova-compute[72444]: DEBUG os_brick.utils [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:56:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:29 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c9cf37-2463-4ab8-8cac-7a6327d83000]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:30 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47cef6d-9a1a-4fc5-a831-5d0831313f1e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:30 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2612040-adb6-43ef-8890-402fea3fde62]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:30 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[560c5547-5e6c-432f-84a9-93dce539ee4f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:56:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:30 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 04:56:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:56:30 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 04:56:30 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fade8b3-63e5-4673-8943-f6b5fa70c773]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:30 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 04:56:30 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 04:56:30 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 04:56:30 user nova-compute[72444]: DEBUG os_brick.utils [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:56:30 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Updating existing volume attachment record: f2a6e04d-2102-4f55-bf30-f63d086c69b1 {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 04:56:32 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "c4af22f7-45f8-4777-83ee-5cf1481c9fe8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "c4af22f7-45f8-4777-83ee-5cf1481c9fe8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "c4af22f7-45f8-4777-83ee-5cf1481c9fe8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "c4af22f7-45f8-4777-83ee-5cf1481c9fe8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "c4af22f7-45f8-4777-83ee-5cf1481c9fe8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:33 user nova-compute[72444]: INFO nova.compute.manager [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Terminating instance
Aug 03 04:56:33 user nova-compute[72444]: DEBUG nova.compute.manager [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 04:56:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:33 user nova-compute[72444]: DEBUG nova.compute.manager [req-6ea421a9-a77d-487f-be4b-6a78fe64e9bf req-cd6097b3-de64-405b-ac29-db34d9189d92 service nova] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Received event network-vif-unplugged-73526f5e-c0da-4686-b2ab-e3859a2d6c85 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:56:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6ea421a9-a77d-487f-be4b-6a78fe64e9bf req-cd6097b3-de64-405b-ac29-db34d9189d92 service nova] Acquiring lock "c4af22f7-45f8-4777-83ee-5cf1481c9fe8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6ea421a9-a77d-487f-be4b-6a78fe64e9bf req-cd6097b3-de64-405b-ac29-db34d9189d92 service nova] Lock "c4af22f7-45f8-4777-83ee-5cf1481c9fe8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6ea421a9-a77d-487f-be4b-6a78fe64e9bf req-cd6097b3-de64-405b-ac29-db34d9189d92 service nova] Lock "c4af22f7-45f8-4777-83ee-5cf1481c9fe8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:33 user nova-compute[72444]: DEBUG nova.compute.manager [req-6ea421a9-a77d-487f-be4b-6a78fe64e9bf req-cd6097b3-de64-405b-ac29-db34d9189d92 service nova] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] No waiting events found dispatching network-vif-unplugged-73526f5e-c0da-4686-b2ab-e3859a2d6c85 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:56:33 user nova-compute[72444]: DEBUG nova.compute.manager [req-6ea421a9-a77d-487f-be4b-6a78fe64e9bf req-cd6097b3-de64-405b-ac29-db34d9189d92 service nova] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Received event network-vif-unplugged-73526f5e-c0da-4686-b2ab-e3859a2d6c85 for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:56:33 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Instance destroyed successfully.
Aug 03 04:56:33 user nova-compute[72444]: DEBUG nova.objects.instance [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lazy-loading 'resources' on Instance uuid c4af22f7-45f8-4777-83ee-5cf1481c9fe8 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:56:33 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:49:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-469217001',display_name='tempest-ServerActionsTestOtherA-server-469217001',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-469217001',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDRHy6esW1Y8XjdGq8kBFPOjS8VFKeCY2PZq9mP7iSJL6lEWXDaTZRjD+kixW9a+QL5lbang2hEmB7Vd5YkTr9lWHW5QxoFRm5vUQ48SZ1Yf+s27SIuqNanyEMadE17HUA==',key_name='tempest-keypair-1657293229',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:52:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56d17468ddd64dfabba3a2c7b6df71ef',ramdisk_id='',reservation_id='r-s4u10w6o',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1629114222',owner_user_name='tempest-ServerActionsTestOtherA-1629114222-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:53:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7120445361dc4363b4cc6c7671a2716e',uuid=c4af22f7-45f8-4777-83ee-5cf1481c9fe8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "address": "fa:16:3e:5e:64:b2", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73526f5e-c0", "ovs_interfaceid": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:56:33 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Converting VIF {"id": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "address": "fa:16:3e:5e:64:b2", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73526f5e-c0", "ovs_interfaceid": "73526f5e-c0da-4686-b2ab-e3859a2d6c85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:56:33 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:64:b2,bridge_name='br-int',has_traffic_filtering=True,id=73526f5e-c0da-4686-b2ab-e3859a2d6c85,network=Network(95b97be9-d6db-45e9-b0f1-a72fc90b69d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73526f5e-c0') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:56:33 user nova-compute[72444]: DEBUG os_vif [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:64:b2,bridge_name='br-int',has_traffic_filtering=True,id=73526f5e-c0da-4686-b2ab-e3859a2d6c85,network=Network(95b97be9-d6db-45e9-b0f1-a72fc90b69d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73526f5e-c0') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:56:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73526f5e-c0, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:56:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:33 user nova-compute[72444]: INFO os_vif [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:64:b2,bridge_name='br-int',has_traffic_filtering=True,id=73526f5e-c0da-4686-b2ab-e3859a2d6c85,network=Network(95b97be9-d6db-45e9-b0f1-a72fc90b69d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73526f5e-c0')
Aug 03 04:56:33 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:56:33 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xJiGAEmX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:56:33 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:56:33 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:56:33 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:56:33 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:56:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2165d4-952a-4ec2-a4e6-39d546f9a2ef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[055a558a-595b-4b99-8ea1-71061371b213]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:56:34 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:56:34 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:56:34 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 (non-flash)
Aug 03 04:56:34 user nova-compute[72444]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:56:34 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:56:34 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308c41ca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86'): ({'sdd'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Removing single pathed devices sdd {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e27c0cb-c0c3-4353-af18-dc260a869718]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[25215647-e8cd-4e69-9aed-341f4eb22729]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Flushing IO for device /dev/sdd {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.027s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cdb869-89ad-4400-b1d8-20fda64e7ab4]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.064s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b099abd-ee52-4a9f-8d5b-332e9c2555cb]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] SCSI volumes sdd have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26231323539363265', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_9848c521', '/dev/disk/by-id/scsi-1SCST_BIO9848c521-b125962edea826c2') {{(pid=84280) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9a6963-34d6-4a65-8f50-254695ab2534]: (4, None) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f800cd41-e68f-4824-91b5-34c8f59db15c]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc00a4a-0b8b-4a28-b746-9d8af37390fd]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86, portal: 172.16.0.220,3260]
Aug 03 04:56:34 user nova-compute[72444]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86, portal: 172.16.0.220,3260] successful.
Aug 03 04:56:34 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a14d792b-d953-43f8-8af2-c2ac8f765b86 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[99af2124-21fc-4f92-bca3-2dd1420447f8]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] <== disconnect_volume: return (379ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:56:34 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Deleting instance files /opt/stack/data/nova/instances/c4af22f7-45f8-4777-83ee-5cf1481c9fe8_del
Aug 03 04:56:34 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Deletion of /opt/stack/data/nova/instances/c4af22f7-45f8-4777-83ee-5cf1481c9fe8_del complete
Aug 03 04:56:34 user nova-compute[72444]: INFO nova.compute.manager [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Took 1.43 seconds to destroy the instance on the hypervisor.
Aug 03 04:56:34 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 04:56:34 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 04:56:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:35 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:56:35 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Took 1.11 seconds to deallocate network for instance.
Aug 03 04:56:35 user nova-compute[72444]: DEBUG nova.compute.manager [req-aae15d15-7f03-47ff-bb3e-eef41507990a req-2303182c-f05e-45ff-884d-851a8081d6ee service nova] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Received event network-vif-deleted-73526f5e-c0da-4686-b2ab-e3859a2d6c85 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:56:35 user nova-compute[72444]: DEBUG nova.compute.manager [req-4b958de0-4d70-4ef5-b667-4775739fa461 req-886733c1-ad71-4712-b170-0ad3ca4737ec service nova] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Received event network-vif-plugged-73526f5e-c0da-4686-b2ab-e3859a2d6c85 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:56:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4b958de0-4d70-4ef5-b667-4775739fa461 req-886733c1-ad71-4712-b170-0ad3ca4737ec service nova] Acquiring lock "c4af22f7-45f8-4777-83ee-5cf1481c9fe8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4b958de0-4d70-4ef5-b667-4775739fa461 req-886733c1-ad71-4712-b170-0ad3ca4737ec service nova] Lock "c4af22f7-45f8-4777-83ee-5cf1481c9fe8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4b958de0-4d70-4ef5-b667-4775739fa461 req-886733c1-ad71-4712-b170-0ad3ca4737ec service nova] Lock "c4af22f7-45f8-4777-83ee-5cf1481c9fe8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:35 user nova-compute[72444]: DEBUG nova.compute.manager [req-4b958de0-4d70-4ef5-b667-4775739fa461 req-886733c1-ad71-4712-b170-0ad3ca4737ec service nova] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] No waiting events found dispatching network-vif-plugged-73526f5e-c0da-4686-b2ab-e3859a2d6c85 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:56:35 user nova-compute[72444]: WARNING nova.compute.manager [req-4b958de0-4d70-4ef5-b667-4775739fa461 req-886733c1-ad71-4712-b170-0ad3ca4737ec service nova] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Received unexpected event network-vif-plugged-73526f5e-c0da-4686-b2ab-e3859a2d6c85 for instance with vm_state active and task_state deleting.
Aug 03 04:56:36 user nova-compute[72444]: INFO nova.compute.manager [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Took 0.80 seconds to detach 1 volumes for instance.
Aug 03 04:56:36 user nova-compute[72444]: DEBUG nova.compute.manager [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Deleting volume: a14d792b-d953-43f8-8af2-c2ac8f765b86 {{(pid=72444) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 03 04:56:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:37 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:56:37 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:56:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.437s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:37 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Deleted allocations for instance c4af22f7-45f8-4777-83ee-5cf1481c9fe8
Aug 03 04:56:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c62ee15c-0a3c-46e7-8679-b0d5b216b93d tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "c4af22f7-45f8-4777-83ee-5cf1481c9fe8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.086s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:56:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YWKVPqzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:56:38 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:56:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:56:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:56:38 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:56:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:56:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:56:38 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:56:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9047603-fddf-44f3-b257-dcce7e9479f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 04:56:38 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:56:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[df875f3d-4b97-41d7-95a8-8022d68146e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378] added
Aug 03 04:56:38 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:56:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8b00c3-ca4a-4b5d-a17c-5bbe5b745e64]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:56:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4fb92c-5e8c-4b59-9031-9ffe2db95035]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:56:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YWKVPqzx {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YWKVPqzx" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1738f51-7703-422e-8da2-ff18d5b6cddb]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YWKVPqzx'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:56:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05d0783-9d43-4cd5-9a67-573aed2ab724]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:56:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f682380c-60b8-455d-8a22-359ca87e7f72]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:56:38 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:56:38 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:56:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:56:38 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:56:38 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:56:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7131ab20-c521-488e-8d30-d5b0a2268fc2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378, portal: 172.16.0.220,3260]
Aug 03 04:56:39 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378, portal: 172.16.0.220,3260] successful.
Aug 03 04:56:39 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:56:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:39 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[725604bc-2320-4915-961b-a795ec902e1c]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:56:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:39 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31f96e6-6d23-4f2e-987f-6d8231003768]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:56:39 user nova-compute[72444]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 (non-flash)
Aug 03 04:56:39 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:56:39 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:56:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:56:39 user nova-compute[72444]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 (non-flash)
Aug 03 04:56:39 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:56:39 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:56:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:56:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:56:39 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:56:39 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:56:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:39 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf092743-bf5f-4aa7-a1ec-7cde8e093a04]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:39 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:56:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YWKVPqzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:56:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:40 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:56:40 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23830313837313266', 'path': '/dev/sdb'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:56:40 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830313837313266', 'path': '/dev/sdb'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:56:40 user nova-compute[72444]: DEBUG nova.objects.instance [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lazy-loading 'flavor' on Instance uuid 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:56:40 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 04:56:40 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:56:40 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 04:56:40 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:56:40 user nova-compute[72444]:   <serial>5b877794-f7ef-40e2-80a9-f39ea90c2378</serial>
Aug 03 04:56:40 user nova-compute[72444]: </disk>
Aug 03 04:56:40 user nova-compute[72444]:  {{(pid=72444) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 04:56:40 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:56:40 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:56:40 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] No VIF found with MAC fa:16:3e:68:ec:25, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:56:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-3680de20-0247-4f4e-8a2c-1e8a5615c95d tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.780s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:42 user nova-compute[72444]: INFO nova.compute.manager [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Rescuing
Aug 03 04:56:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Acquiring lock "refresh_cache-27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:56:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Acquired lock "refresh_cache-27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:56:42 user nova-compute[72444]: DEBUG nova.network.neutron [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:56:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:42 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:56:42 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Cleaning up deleted instances {{(pid=72444) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 03 04:56:42 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] There are 0 instances to clean {{(pid=72444) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 03 04:56:43 user nova-compute[72444]: DEBUG nova.network.neutron [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Updating instance_info_cache with network_info: [{"id": "7a41fc62-2272-4198-99cb-19d77d1dc193", "address": "fa:16:3e:68:ec:25", "network": {"id": "d132f1d9-d7bd-4630-bd3d-e911f43d14bb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1090455023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08ed53988ee44a081db4223ad0a9264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a41fc62-22", "ovs_interfaceid": "7a41fc62-2272-4198-99cb-19d77d1dc193", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:56:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Releasing lock "refresh_cache-27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:56:43 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:43 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:43 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:43 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:43 user nova-compute[72444]: DEBUG nova.compute.manager [req-88866978-40aa-486b-a5fc-744c4ba949ec req-240d66b5-ea6d-49a8-bf84-7c0ec409dd23 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Received event network-vif-unplugged-7a41fc62-2272-4198-99cb-19d77d1dc193 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:56:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-88866978-40aa-486b-a5fc-744c4ba949ec req-240d66b5-ea6d-49a8-bf84-7c0ec409dd23 service nova] Acquiring lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-88866978-40aa-486b-a5fc-744c4ba949ec req-240d66b5-ea6d-49a8-bf84-7c0ec409dd23 service nova] Lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-88866978-40aa-486b-a5fc-744c4ba949ec req-240d66b5-ea6d-49a8-bf84-7c0ec409dd23 service nova] Lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:43 user nova-compute[72444]: DEBUG nova.compute.manager [req-88866978-40aa-486b-a5fc-744c4ba949ec req-240d66b5-ea6d-49a8-bf84-7c0ec409dd23 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] No waiting events found dispatching network-vif-unplugged-7a41fc62-2272-4198-99cb-19d77d1dc193 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:56:43 user nova-compute[72444]: WARNING nova.compute.manager [req-88866978-40aa-486b-a5fc-744c4ba949ec req-240d66b5-ea6d-49a8-bf84-7c0ec409dd23 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Received unexpected event network-vif-unplugged-7a41fc62-2272-4198-99cb-19d77d1dc193 for instance with vm_state active and task_state rescuing.
Aug 03 04:56:43 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:43 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:44 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:44 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Instance destroyed successfully.
Aug 03 04:56:44 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Attempting a stable device rescue
Aug 03 04:56:44 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72444) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 03 04:56:44 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Instance directory exists: not creating {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 03 04:56:44 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Creating image(s)
Aug 03 04:56:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Acquiring lock "/opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lock "/opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lock "/opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:44 user nova-compute[72444]: DEBUG nova.objects.instance [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lazy-loading 'trusted_certs' on Instance uuid 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:56:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Acquiring lock "b33b805235558cefcc6f2c9dad0d690fac5bda52" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lock "b33b805235558cefcc6f2c9dad0d690fac5bda52" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b33b805235558cefcc6f2c9dad0d690fac5bda52.part --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b33b805235558cefcc6f2c9dad0d690fac5bda52.part --force-share --output=json" returned: 0 in 0.153s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:45 user nova-compute[72444]: DEBUG nova.virt.images [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] 05b67065-d528-4689-b9af-4e5e3a52b297 was qcow2, converting to raw {{(pid=72444) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 03 04:56:45 user nova-compute[72444]: DEBUG nova.privsep.utils [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72444) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 03 04:56:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b33b805235558cefcc6f2c9dad0d690fac5bda52.part /opt/stack/data/nova/instances/_base/b33b805235558cefcc6f2c9dad0d690fac5bda52.converted {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:45 user nova-compute[72444]: DEBUG nova.compute.manager [req-1062a122-e1a9-48c2-8408-86d6590eae1e req-d2533925-f488-4f4b-99d2-a5680cd30521 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Received event network-vif-plugged-7a41fc62-2272-4198-99cb-19d77d1dc193 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:56:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-1062a122-e1a9-48c2-8408-86d6590eae1e req-d2533925-f488-4f4b-99d2-a5680cd30521 service nova] Acquiring lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-1062a122-e1a9-48c2-8408-86d6590eae1e req-d2533925-f488-4f4b-99d2-a5680cd30521 service nova] Lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-1062a122-e1a9-48c2-8408-86d6590eae1e req-d2533925-f488-4f4b-99d2-a5680cd30521 service nova] Lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:45 user nova-compute[72444]: DEBUG nova.compute.manager [req-1062a122-e1a9-48c2-8408-86d6590eae1e req-d2533925-f488-4f4b-99d2-a5680cd30521 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] No waiting events found dispatching network-vif-plugged-7a41fc62-2272-4198-99cb-19d77d1dc193 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:56:45 user nova-compute[72444]: WARNING nova.compute.manager [req-1062a122-e1a9-48c2-8408-86d6590eae1e req-d2533925-f488-4f4b-99d2-a5680cd30521 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Received unexpected event network-vif-plugged-7a41fc62-2272-4198-99cb-19d77d1dc193 for instance with vm_state active and task_state rescuing.
Aug 03 04:56:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b33b805235558cefcc6f2c9dad0d690fac5bda52.part /opt/stack/data/nova/instances/_base/b33b805235558cefcc6f2c9dad0d690fac5bda52.converted" returned: 0 in 0.541s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b33b805235558cefcc6f2c9dad0d690fac5bda52.converted --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b33b805235558cefcc6f2c9dad0d690fac5bda52.converted --force-share --output=json" returned: 0 in 0.158s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lock "b33b805235558cefcc6f2c9dad0d690fac5bda52" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.030s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Acquiring lock "b33b805235558cefcc6f2c9dad0d690fac5bda52" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lock "b33b805235558cefcc6f2c9dad0d690fac5bda52" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b33b805235558cefcc6f2c9dad0d690fac5bda52 --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b33b805235558cefcc6f2c9dad0d690fac5bda52 --force-share --output=json" returned: 0 in 0.148s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b33b805235558cefcc6f2c9dad0d690fac5bda52,backing_fmt=raw /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk.rescue {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b33b805235558cefcc6f2c9dad0d690fac5bda52,backing_fmt=raw /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk.rescue" returned: 0 in 0.062s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lock "b33b805235558cefcc6f2c9dad0d690fac5bda52" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG nova.objects.instance [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lazy-loading 'migration_context' on Instance uuid 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Start _get_guest_xml network_info=[{"id": "7a41fc62-2272-4198-99cb-19d77d1dc193", "address": "fa:16:3e:68:ec:25", "network": {"id": "d132f1d9-d7bd-4630-bd3d-e911f43d14bb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1090455023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1090455023-network", "vif_mac": "fa:16:3e:68:ec:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08ed53988ee44a081db4223ad0a9264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a41fc62-22", "ovs_interfaceid": "7a41fc62-2272-4198-99cb-19d77d1dc193", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '05b67065-d528-4689-b9af-4e5e3a52b297', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YWKVPqzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0', 'attached_at': '', 'detached_at': '', 'volume_id': '5b877794-f7ef-40e2-80a9-f39ea90c2378', 'serial': '5b877794-f7ef-40e2-80a9-f39ea90c2378'}, 'disk_bus': 'virtio', 'attachment_id': 'f2a6e04d-2102-4f55-bf30-f63d086c69b1', 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG nova.objects.instance [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lazy-loading 'resources' on Instance uuid 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG nova.objects.instance [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lazy-loading 'numa_topology' on Instance uuid 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:56:46 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:56:46 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:56:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG nova.objects.instance [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lazy-loading 'vcpu_model' on Instance uuid 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YWKVPqzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:56:46 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:56:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:56:46 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:56:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:56:46 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:56:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[27814989-eeef-4a84-95a0-00fef3472c09]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = YWKVPqzx\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 03 04:56:46 user nova-compute[72444]: node.name = iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378
Aug 03 04:56:46 user nova-compute[72444]: node.tpgt = -1
Aug 03 04:56:46 user nova-compute[72444]: node.startup = automatic
Aug 03 04:56:46 user nova-compute[72444]: node.leading_login = No
Aug 03 04:56:46 user nova-compute[72444]: iface.iscsi_ifacename = default
Aug 03 04:56:46 user nova-compute[72444]: iface.net_ifacename = <empty>
Aug 03 04:56:46 user nova-compute[72444]: iface.ipaddress = <empty>
Aug 03 04:56:46 user nova-compute[72444]: iface.prefix_len = 0
Aug 03 04:56:46 user nova-compute[72444]: iface.hwaddress = <empty>
Aug 03 04:56:46 user nova-compute[72444]: iface.transport_name = tcp
Aug 03 04:56:46 user nova-compute[72444]: iface.initiatorname = <empty>
Aug 03 04:56:46 user nova-compute[72444]: iface.state = <empty>
Aug 03 04:56:46 user nova-compute[72444]: iface.vlan_id = 0
Aug 03 04:56:46 user nova-compute[72444]: iface.vlan_priority = 0
Aug 03 04:56:46 user nova-compute[72444]: iface.vlan_state = <empty>
Aug 03 04:56:46 user nova-compute[72444]: iface.iface_num = 0
Aug 03 04:56:46 user nova-compute[72444]: iface.mtu = 0
Aug 03 04:56:46 user nova-compute[72444]: iface.port = 0
Aug 03 04:56:46 user nova-compute[72444]: iface.bootproto = <empty>
Aug 03 04:56:46 user nova-compute[72444]: iface.subnet_mask = <empty>
Aug 03 04:56:46 user nova-compute[72444]: iface.gateway = <empty>
Aug 03 04:56:46 user nova-compute[72444]: iface.dhcp_alt_client_id_state = <empty>
Aug 03 04:56:46 user nova-compute[72444]: iface.dhcp_alt_client_id = <empty>
Aug 03 04:56:46 user nova-compute[72444]: iface.dhcp_dns = <empty>
Aug 03 04:56:46 user nova-compute[72444]: iface.dhcp_learn_iqn = <empty>
Aug 03 04:56:46 user nova-compute[72444]: iface.dhcp_req_vendor_id_state = <empty>
Aug 03 04:56:46 user nova-compute[72444]: iface.dhcp_vendor_id_state = <empty>
Aug 03 04:56:46 user nova-compute[72444]: iface.dhcp_vendor_id = <empty>
Aug 03 04:56:46 user nova-compute[72444]: iface.dhcp_slp_da = <empty>
Aug 03 04:56:46 user nova-compute[72444]: iface.fragmentation = <empty>
Aug 03 04:56:46 user nova-compute[72444]: iface.gratuitous_arp = <empty>
Aug 03 04:56:46 user nova-compute[72444]: iface.incoming_forwarding = <empty>
Aug 03 04:56:46 user nova-compute[72444]: iface.tos_state = <empty>
Aug 03 04:56:46 user nova-compute[72444]: iface.tos = 0
Aug 03 04:56:46 user nova-compute[72444]: iface.ttl = 0
Aug 03 04:56:46 user nova-compute[72444]: iface.delayed_ack = <empty>
Aug 03 04:56:46 user nova-compute[72444]: iface.tcp_nagle = <empty>
Aug 03 04:56:46 user nova-compute[72444]: iface.tcp_wsf_state = <empty>
Aug 03 04:56:46 user nova-compute[72444]: iface.tcp_wsf = 0
Aug 03 04:56:46 user nova-compute[72444]: iface.tcp_timer_scale = 0
Aug 03 04:56:46 user nova-compute[72444]: iface.tcp_timestamp = <empty>
Aug 03 04:56:46 user nova-compute[72444]: iface.redirect = <empty>
Aug 03 04:56:46 user nova-compute[72444]: iface.def_task_mgmt_timeout = 0
Aug 03 04:56:46 user nova-compute[72444]: iface.header_digest = <empty>
Aug 03 04:56:46 user nova-compute[72444]: iface.data_digest = <empty>
Aug 03 04:56:46 user nova-compute[72444]: iface.immediate_data = <empty>
Aug 03 04:56:46 user nova-compute[72444]: iface.initial_r2t = <empty>
Aug 03 04:56:46 user nova-compute[72444]: iface.data_seq_inorder = <empty>
Aug 03 04:56:46 user nova-compute[72444]: iface.data_pdu_inorder = <empty>
Aug 03 04:56:46 user nova-compute[72444]: iface.erl = 0
Aug 03 04:56:46 user nova-compute[72444]: iface.max_receive_data_len = 0
Aug 03 04:56:46 user nova-compute[72444]: iface.first_burst_len = 0
Aug 03 04:56:46 user nova-compute[72444]: iface.max_outstanding_r2t = 0
Aug 03 04:56:46 user nova-compute[72444]: iface.max_burst_len = 0
Aug 03 04:56:46 user nova-compute[72444]: iface.chap_auth = <empty>
Aug 03 04:56:46 user nova-compute[72444]: iface.bidi_chap = <empty>
Aug 03 04:56:46 user nova-compute[72444]: iface.strict_login_compliance = <empty>
Aug 03 04:56:46 user nova-compute[72444]: iface.discovery_auth = <empty>
Aug 03 04:56:46 user nova-compute[72444]: iface.discovery_logout = <empty>
Aug 03 04:56:46 user nova-compute[72444]: node.discovery_address = <empty>
Aug 03 04:56:46 user nova-compute[72444]: node.discovery_port = 0
Aug 03 04:56:46 user nova-compute[72444]: node.discovery_type = static
Aug 03 04:56:46 user nova-compute[72444]: node.session.initial_cmdsn = 0
Aug 03 04:56:46 user nova-compute[72444]: node.session.initial_login_retry_max = 8
Aug 03 04:56:46 user nova-compute[72444]: node.session.xmit_thread_priority = -20
Aug 03 04:56:46 user nova-compute[72444]: node.session.cmds_max = 128
Aug 03 04:56:46 user nova-compute[72444]: node.session.queue_depth = 32
Aug 03 04:56:46 user nova-compute[72444]: node.session.nr_sessions = 1
Aug 03 04:56:46 user nova-compute[72444]: node.session.auth.authmethod = CHAP
Aug 03 04:56:46 user nova-compute[72444]: node.session.auth.username = YWKVPqzx
Aug 03 04:56:46 user nova-compute[72444]: node.session.auth.password = ***
Aug 03 04:56:46 user nova-compute[72444]: node.session.auth.username_in = <empty>
Aug 03 04:56:46 user nova-compute[72444]: node.session.auth.password_in = <empty>
Aug 03 04:56:46 user nova-compute[72444]: node.session.auth.chap_algs = MD5
Aug 03 04:56:46 user nova-compute[72444]: node.session.timeo.replacement_timeout = 120
Aug 03 04:56:46 user nova-compute[72444]: node.session.err_timeo.abort_timeout = 15
Aug 03 04:56:46 user nova-compute[72444]: node.session.err_timeo.lu_reset_timeout = 30
Aug 03 04:56:46 user nova-compute[72444]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 03 04:56:46 user nova-compute[72444]: node.session.err_timeo.host_reset_timeout = 60
Aug 03 04:56:46 user nova-compute[72444]: node.session.iscsi.FastAbort = Yes
Aug 03 04:56:46 user nova-compute[72444]: node.session.iscsi.InitialR2T = No
Aug 03 04:56:46 user nova-compute[72444]: node.session.iscsi.ImmediateData = Yes
Aug 03 04:56:46 user nova-compute[72444]: node.session.iscsi.FirstBurstLength = 262144
Aug 03 04:56:46 user nova-compute[72444]: node.session.iscsi.MaxBurstLength = 16776192
Aug 03 04:56:46 user nova-compute[72444]: node.session.iscsi.DefaultTime2Retain = 0
Aug 03 04:56:46 user nova-compute[72444]: node.session.iscsi.DefaultTime2Wait = 2
Aug 03 04:56:46 user nova-compute[72444]: node.session.iscsi.MaxConnections = 1
Aug 03 04:56:46 user nova-compute[72444]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 03 04:56:46 user nova-compute[72444]: node.session.iscsi.ERL = 0
Aug 03 04:56:46 user nova-compute[72444]: node.session.scan = manual
Aug 03 04:56:46 user nova-compute[72444]: node.session.reopen_max = 0
Aug 03 04:56:46 user nova-compute[72444]: node.conn[0].address = 172.16.0.220
Aug 03 04:56:46 user nova-compute[72444]: node.conn[0].port = 3260
Aug 03 04:56:46 user nova-compute[72444]: node.conn[0].startup = manual
Aug 03 04:56:46 user nova-compute[72444]: node.conn[0].tcp.window_size = 524288
Aug 03 04:56:46 user nova-compute[72444]: node.conn[0].tcp.type_of_service = 0
Aug 03 04:56:46 user nova-compute[72444]: node.conn[0].timeo.logout_timeout = 15
Aug 03 04:56:46 user nova-compute[72444]: node.conn[0].timeo.login_timeout = 15
Aug 03 04:56:46 user nova-compute[72444]: node.conn[0].timeo.auth_timeout = 45
Aug 03 04:56:46 user nova-compute[72444]: node.conn[0].timeo.noop_out_interval = 5
Aug 03 04:56:46 user nova-compute[72444]: node.conn[0].timeo.noop_out_timeout = 5
Aug 03 04:56:46 user nova-compute[72444]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 03 04:56:46 user nova-compute[72444]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 03 04:56:46 user nova-compute[72444]: node.conn[0].iscsi.HeaderDigest = None
Aug 03 04:56:46 user nova-compute[72444]: node.conn[0].iscsi.DataDigest = None
Aug 03 04:56:46 user nova-compute[72444]: node.conn[0].iscsi.IFMarker = No
Aug 03 04:56:46 user nova-compute[72444]: node.conn[0].iscsi.OFMarker = No
Aug 03 04:56:46 user nova-compute[72444]: # END RECORD
Aug 03 04:56:46 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9673571-b495-425c-94a4-40052f892f9a]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[33614742-a7f4-45b7-a767-28b97ec38cc5]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YWKVPqzx {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YWKVPqzx" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c995694-2913-4bc0-97da-d994b5cb3ee5]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YWKVPqzx'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[74461d19-0256-4b12-8400-22af7d1d1c74]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1693ea-8d67-47e7-b8f0-2037cd17cb59]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:56:46 user nova-compute[72444]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 (non-flash)
Aug 03 04:56:46 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:56:46 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:56:46 user nova-compute[72444]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 (non-flash)
Aug 03 04:56:46 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:56:46 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.149s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] HCTL ('33', '0', '0', 0) found on session 37 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[026c95fb-f4b7-49a9-b783-98f2e40b292a]: (4, ('0 0 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Searching for a device in session 37 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YWKVPqzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.182s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] <== connect_volume: return (184ms) {'type': 'block', 'scsi_wwn': '23830313837313266', 'path': '/dev/sdb'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830313837313266', 'path': '/dev/sdb'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:52:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1025958151',display_name='tempest-ServerStableDeviceRescueTest-server-1025958151',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1025958151',id=30,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4jDFxvmvEZS4Z7JXz0hT1lDcLp6u3gZwEbKEc2hoK4M3fMHWAWzjuuHOscgaraFZ39VjXIwo94mfkQIR25KIRAWCbmQSZmJCp9YRgX8UCvMh39yqLkLrbMM3cXGBxglg==',key_name='tempest-keypair-1152104865',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:52:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c08ed53988ee44a081db4223ad0a9264',ramdisk_id='',reservation_id='r-tum413w7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-849887263',owner_user_name='tempest-ServerStableDeviceRescueTest-849887263-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:54:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0747a6dda85f48ddbcc4564bc5980b99',uuid=27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a41fc62-2272-4198-99cb-19d77d1dc193", "address": "fa:16:3e:68:ec:25", "network": {"id": "d132f1d9-d7bd-4630-bd3d-e911f43d14bb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1090455023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1090455023-network", "vif_mac": "fa:16:3e:68:ec:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08ed53988ee44a081db4223ad0a9264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a41fc62-22", "ovs_interfaceid": "7a41fc62-2272-4198-99cb-19d77d1dc193", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Converting VIF {"id": "7a41fc62-2272-4198-99cb-19d77d1dc193", "address": "fa:16:3e:68:ec:25", "network": {"id": "d132f1d9-d7bd-4630-bd3d-e911f43d14bb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1090455023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1090455023-network", "vif_mac": "fa:16:3e:68:ec:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08ed53988ee44a081db4223ad0a9264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a41fc62-22", "ovs_interfaceid": "7a41fc62-2272-4198-99cb-19d77d1dc193", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:ec:25,bridge_name='br-int',has_traffic_filtering=True,id=7a41fc62-2272-4198-99cb-19d77d1dc193,network=Network(d132f1d9-d7bd-4630-bd3d-e911f43d14bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a41fc62-22') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG nova.objects.instance [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lazy-loading 'pci_devices' on Instance uuid 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:56:46 user nova-compute[72444]:   <uuid>27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0</uuid>
Aug 03 04:56:46 user nova-compute[72444]:   <name>instance-0000001e</name>
Aug 03 04:56:46 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:56:46 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:56:46 user nova-compute[72444]:   <metadata>
Aug 03 04:56:46 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:56:46 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:56:46 user nova-compute[72444]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1025958151</nova:name>
Aug 03 04:56:46 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:56:46</nova:creationTime>
Aug 03 04:56:46 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:56:46 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:56:46 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:56:46 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:56:46 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:56:46 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:56:46 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:56:46 user nova-compute[72444]:       <nova:owner>
Aug 03 04:56:46 user nova-compute[72444]:         <nova:user uuid="0747a6dda85f48ddbcc4564bc5980b99">tempest-ServerStableDeviceRescueTest-849887263-project-member</nova:user>
Aug 03 04:56:46 user nova-compute[72444]:         <nova:project uuid="c08ed53988ee44a081db4223ad0a9264">tempest-ServerStableDeviceRescueTest-849887263</nova:project>
Aug 03 04:56:46 user nova-compute[72444]:       </nova:owner>
Aug 03 04:56:46 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:56:46 user nova-compute[72444]:       <nova:ports>
Aug 03 04:56:46 user nova-compute[72444]:         <nova:port uuid="7a41fc62-2272-4198-99cb-19d77d1dc193">
Aug 03 04:56:46 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 03 04:56:46 user nova-compute[72444]:         </nova:port>
Aug 03 04:56:46 user nova-compute[72444]:       </nova:ports>
Aug 03 04:56:46 user nova-compute[72444]:     </nova:instance>
Aug 03 04:56:46 user nova-compute[72444]:   </metadata>
Aug 03 04:56:46 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:56:46 user nova-compute[72444]:     <system>
Aug 03 04:56:46 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:56:46 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:56:46 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:56:46 user nova-compute[72444]:       <entry name="serial">27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0</entry>
Aug 03 04:56:46 user nova-compute[72444]:       <entry name="uuid">27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0</entry>
Aug 03 04:56:46 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:56:46 user nova-compute[72444]:     </system>
Aug 03 04:56:46 user nova-compute[72444]:   </sysinfo>
Aug 03 04:56:46 user nova-compute[72444]:   <os>
Aug 03 04:56:46 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:56:46 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:56:46 user nova-compute[72444]:   </os>
Aug 03 04:56:46 user nova-compute[72444]:   <features>
Aug 03 04:56:46 user nova-compute[72444]:     <acpi/>
Aug 03 04:56:46 user nova-compute[72444]:     <apic/>
Aug 03 04:56:46 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:56:46 user nova-compute[72444]:   </features>
Aug 03 04:56:46 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:56:46 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:56:46 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:56:46 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:56:46 user nova-compute[72444]:   </clock>
Aug 03 04:56:46 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:56:46 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:56:46 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:56:46 user nova-compute[72444]:   </cpu>
Aug 03 04:56:46 user nova-compute[72444]:   <devices>
Aug 03 04:56:46 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:56:46 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:56:46 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk"/>
Aug 03 04:56:46 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:56:46 user nova-compute[72444]:     </disk>
Aug 03 04:56:46 user nova-compute[72444]:     <disk type="block" device="disk">
Aug 03 04:56:46 user nova-compute[72444]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:56:46 user nova-compute[72444]:       <source dev="/dev/sdb"/>
Aug 03 04:56:46 user nova-compute[72444]:       <target dev="vdb" bus="virtio"/>
Aug 03 04:56:46 user nova-compute[72444]:       <serial>5b877794-f7ef-40e2-80a9-f39ea90c2378</serial>
Aug 03 04:56:46 user nova-compute[72444]:     </disk>
Aug 03 04:56:46 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:56:46 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:56:46 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk.rescue"/>
Aug 03 04:56:46 user nova-compute[72444]:       <target dev="vdc" bus="virtio"/>
Aug 03 04:56:46 user nova-compute[72444]:       <boot order="1"/>
Aug 03 04:56:46 user nova-compute[72444]:     </disk>
Aug 03 04:56:46 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:56:46 user nova-compute[72444]:       <mac address="fa:16:3e:68:ec:25"/>
Aug 03 04:56:46 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:56:46 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:56:46 user nova-compute[72444]:       <target dev="tap7a41fc62-22"/>
Aug 03 04:56:46 user nova-compute[72444]:     </interface>
Aug 03 04:56:46 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:56:46 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/console.log" append="off"/>
Aug 03 04:56:46 user nova-compute[72444]:     </serial>
Aug 03 04:56:46 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:56:46 user nova-compute[72444]:     <video>
Aug 03 04:56:46 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:56:46 user nova-compute[72444]:     </video>
Aug 03 04:56:46 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:56:46 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:56:46 user nova-compute[72444]:     </rng>
Aug 03 04:56:46 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:56:46 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:56:46 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:56:46 user nova-compute[72444]:     </memballoon>
Aug 03 04:56:46 user nova-compute[72444]:   </devices>
Aug 03 04:56:46 user nova-compute[72444]: </domain>
Aug 03 04:56:46 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:56:46 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Instance destroyed successfully.
Aug 03 04:56:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:56:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] No VIF found with MAC fa:16:3e:68:ec:25, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:56:48 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:48 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:48 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:48 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:48 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:48 user nova-compute[72444]: DEBUG nova.compute.manager [req-c8b7c301-deac-4ee1-be53-f00990b2265a req-c0719a0a-7094-43d6-a09a-5c67d33df098 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Received event network-vif-plugged-7a41fc62-2272-4198-99cb-19d77d1dc193 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:56:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-c8b7c301-deac-4ee1-be53-f00990b2265a req-c0719a0a-7094-43d6-a09a-5c67d33df098 service nova] Acquiring lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-c8b7c301-deac-4ee1-be53-f00990b2265a req-c0719a0a-7094-43d6-a09a-5c67d33df098 service nova] Lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-c8b7c301-deac-4ee1-be53-f00990b2265a req-c0719a0a-7094-43d6-a09a-5c67d33df098 service nova] Lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:48 user nova-compute[72444]: DEBUG nova.compute.manager [req-c8b7c301-deac-4ee1-be53-f00990b2265a req-c0719a0a-7094-43d6-a09a-5c67d33df098 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] No waiting events found dispatching network-vif-plugged-7a41fc62-2272-4198-99cb-19d77d1dc193 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:56:48 user nova-compute[72444]: WARNING nova.compute.manager [req-c8b7c301-deac-4ee1-be53-f00990b2265a req-c0719a0a-7094-43d6-a09a-5c67d33df098 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Received unexpected event network-vif-plugged-7a41fc62-2272-4198-99cb-19d77d1dc193 for instance with vm_state active and task_state rescuing.
Aug 03 04:56:48 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:48 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:48 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:48 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691038593.9219537, c4af22f7-45f8-4777-83ee-5cf1481c9fe8 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:56:48 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] VM Stopped (Lifecycle Event)
Aug 03 04:56:48 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:56:48 user nova-compute[72444]: DEBUG nova.compute.manager [None req-743715da-bc47-48ef-9d31-5c9823f278bd None None] [instance: c4af22f7-45f8-4777-83ee-5cf1481c9fe8] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:56:48 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:49 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:56:49 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 04:56:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquiring lock "a9b960cb-39bd-4f31-9920-5ce31d5db139" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "a9b960cb-39bd-4f31-9920-5ce31d5db139" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:50 user nova-compute[72444]: DEBUG nova.compute.manager [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 04:56:50 user nova-compute[72444]: DEBUG nova.compute.manager [req-d43f8e66-966e-4ce8-8e83-390c742c5723 req-f67a9651-22c9-4f9d-af31-22d36dc2d8da service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Received event network-vif-plugged-7a41fc62-2272-4198-99cb-19d77d1dc193 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:56:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d43f8e66-966e-4ce8-8e83-390c742c5723 req-f67a9651-22c9-4f9d-af31-22d36dc2d8da service nova] Acquiring lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d43f8e66-966e-4ce8-8e83-390c742c5723 req-f67a9651-22c9-4f9d-af31-22d36dc2d8da service nova] Lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d43f8e66-966e-4ce8-8e83-390c742c5723 req-f67a9651-22c9-4f9d-af31-22d36dc2d8da service nova] Lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:50 user nova-compute[72444]: DEBUG nova.compute.manager [req-d43f8e66-966e-4ce8-8e83-390c742c5723 req-f67a9651-22c9-4f9d-af31-22d36dc2d8da service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] No waiting events found dispatching network-vif-plugged-7a41fc62-2272-4198-99cb-19d77d1dc193 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:56:50 user nova-compute[72444]: WARNING nova.compute.manager [req-d43f8e66-966e-4ce8-8e83-390c742c5723 req-f67a9651-22c9-4f9d-af31-22d36dc2d8da service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Received unexpected event network-vif-plugged-7a41fc62-2272-4198-99cb-19d77d1dc193 for instance with vm_state active and task_state rescuing.
Aug 03 04:56:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:50 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 04:56:50 user nova-compute[72444]: INFO nova.compute.claims [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Claim successful on node user
Aug 03 04:56:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:50 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Removed pending event for 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0 due to event {{(pid=72444) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 03 04:56:50 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038610.9051461, 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:56:50 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] VM Resumed (Lifecycle Event)
Aug 03 04:56:50 user nova-compute[72444]: DEBUG nova.compute.manager [None req-63b4e9ee-e059-4f5f-8329-438485176aab tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:56:50 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:56:50 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:56:50 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038610.907137, 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:56:50 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] VM Started (Lifecycle Event)
Aug 03 04:56:51 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:56:51 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:56:51 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:56:51 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:56:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.671s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:51 user nova-compute[72444]: DEBUG nova.compute.manager [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 04:56:51 user nova-compute[72444]: DEBUG nova.compute.manager [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 04:56:51 user nova-compute[72444]: DEBUG nova.network.neutron [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 04:56:51 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 04:56:51 user nova-compute[72444]: DEBUG nova.compute.manager [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 04:56:51 user nova-compute[72444]: DEBUG nova.policy [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9458c7bd532e4451904ca404bf35427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd787b7db6a684a008a03c55e292b0d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 04:56:51 user nova-compute[72444]: DEBUG nova.compute.manager [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 04:56:51 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 04:56:51 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Creating image(s)
Aug 03 04:56:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquiring lock "/opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "/opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "/opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquiring lock "e268fc11716d4f0234addcf0a05158bc52f1db71" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "e268fc11716d4f0234addcf0a05158bc52f1db71" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e268fc11716d4f0234addcf0a05158bc52f1db71.part --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e268fc11716d4f0234addcf0a05158bc52f1db71.part --force-share --output=json" returned: 0 in 0.137s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:51 user nova-compute[72444]: DEBUG nova.virt.images [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] 8e18af3a-7ab1-40b2-9a01-456e56c71296 was qcow2, converting to raw {{(pid=72444) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 03 04:56:51 user nova-compute[72444]: DEBUG nova.privsep.utils [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72444) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 03 04:56:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e268fc11716d4f0234addcf0a05158bc52f1db71.part /opt/stack/data/nova/instances/_base/e268fc11716d4f0234addcf0a05158bc52f1db71.converted {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e268fc11716d4f0234addcf0a05158bc52f1db71.part /opt/stack/data/nova/instances/_base/e268fc11716d4f0234addcf0a05158bc52f1db71.converted" returned: 0 in 0.275s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e268fc11716d4f0234addcf0a05158bc52f1db71.converted --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:52 user nova-compute[72444]: DEBUG nova.network.neutron [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Successfully created port: 68a682f5-6dbc-4c9b-ab56-b91c8cb93810 {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:56:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e268fc11716d4f0234addcf0a05158bc52f1db71.converted --force-share --output=json" returned: 0 in 0.137s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "e268fc11716d4f0234addcf0a05158bc52f1db71" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.014s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e268fc11716d4f0234addcf0a05158bc52f1db71 --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e268fc11716d4f0234addcf0a05158bc52f1db71 --force-share --output=json" returned: 0 in 0.135s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquiring lock "e268fc11716d4f0234addcf0a05158bc52f1db71" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "e268fc11716d4f0234addcf0a05158bc52f1db71" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e268fc11716d4f0234addcf0a05158bc52f1db71 --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e268fc11716d4f0234addcf0a05158bc52f1db71 --force-share --output=json" returned: 0 in 0.156s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e268fc11716d4f0234addcf0a05158bc52f1db71,backing_fmt=raw /opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e268fc11716d4f0234addcf0a05158bc52f1db71,backing_fmt=raw /opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/disk 1073741824" returned: 0 in 0.054s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "e268fc11716d4f0234addcf0a05158bc52f1db71" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e268fc11716d4f0234addcf0a05158bc52f1db71 --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:52 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:56:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e268fc11716d4f0234addcf0a05158bc52f1db71 --force-share --output=json" returned: 0 in 0.175s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:52 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 04:56:52 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Cannot resize image /opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG nova.objects.instance [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lazy-loading 'migration_context' on Instance uuid a9b960cb-39bd-4f31-9920-5ce31d5db139 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Ensure instance console log exists: /opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG nova.network.neutron [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Successfully updated port: 68a682f5-6dbc-4c9b-ab56-b91c8cb93810 {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquiring lock "refresh_cache-a9b960cb-39bd-4f31-9920-5ce31d5db139" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquired lock "refresh_cache-a9b960cb-39bd-4f31-9920-5ce31d5db139" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG nova.network.neutron [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG nova.compute.manager [req-ce42dbad-3a2e-4c2d-a0f1-27d84b303b18 req-7163ef65-eed6-43b7-80f6-d6abf34a5079 service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Received event network-changed-68a682f5-6dbc-4c9b-ab56-b91c8cb93810 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG nova.compute.manager [req-ce42dbad-3a2e-4c2d-a0f1-27d84b303b18 req-7163ef65-eed6-43b7-80f6-d6abf34a5079 service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Refreshing instance network info cache due to event network-changed-68a682f5-6dbc-4c9b-ab56-b91c8cb93810. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ce42dbad-3a2e-4c2d-a0f1-27d84b303b18 req-7163ef65-eed6-43b7-80f6-d6abf34a5079 service nova] Acquiring lock "refresh_cache-a9b960cb-39bd-4f31-9920-5ce31d5db139" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG nova.network.neutron [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG nova.network.neutron [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Updating instance_info_cache with network_info: [{"id": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "address": "fa:16:3e:b5:15:1e", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a682f5-6d", "ovs_interfaceid": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Releasing lock "refresh_cache-a9b960cb-39bd-4f31-9920-5ce31d5db139" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG nova.compute.manager [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Instance network_info: |[{"id": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "address": "fa:16:3e:b5:15:1e", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a682f5-6d", "ovs_interfaceid": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ce42dbad-3a2e-4c2d-a0f1-27d84b303b18 req-7163ef65-eed6-43b7-80f6-d6abf34a5079 service nova] Acquired lock "refresh_cache-a9b960cb-39bd-4f31-9920-5ce31d5db139" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG nova.network.neutron [req-ce42dbad-3a2e-4c2d-a0f1-27d84b303b18 req-7163ef65-eed6-43b7-80f6-d6abf34a5079 service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Refreshing network info cache for port 68a682f5-6dbc-4c9b-ab56-b91c8cb93810 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Start _get_guest_xml network_info=[{"id": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "address": "fa:16:3e:b5:15:1e", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a682f5-6d", "ovs_interfaceid": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:56:47Z,direct_url=<?>,disk_format='qcow2',id=8e18af3a-7ab1-40b2-9a01-456e56c71296,min_disk=0,min_ram=0,name='tempest-scenario-img--203698426',owner='d787b7db6a684a008a03c55e292b0d5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:56:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '8e18af3a-7ab1-40b2-9a01-456e56c71296'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:56:53 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:56:53 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:56:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:56:47Z,direct_url=<?>,disk_format='qcow2',id=8e18af3a-7ab1-40b2-9a01-456e56c71296,min_disk=0,min_ram=0,name='tempest-scenario-img--203698426',owner='d787b7db6a684a008a03c55e292b0d5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:56:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:56:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1751002867',display_name='tempest-TestMinimumBasicScenario-server-1751002867',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1751002867',id=33,image_ref='8e18af3a-7ab1-40b2-9a01-456e56c71296',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcHfxO2CJZwlfrKEV+BCKKA3mm2Qu1C0XwTCU49QSlfy4GtfOuw1uap5TaNJn3JTTUIHR9cd/KVOmyFHg2ffBTJNBWsd9JhffQaYQWGjqb5ClOLv5HgkGXnryOGHCRpGA==',key_name='tempest-TestMinimumBasicScenario-1010540444',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d787b7db6a684a008a03c55e292b0d5c',ramdisk_id='',reservation_id='r-rxwa2ccf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8e18af3a-7ab1-40b2-9a01-456e56c71296',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1132477023',owner_user_name='tempest-TestMinimumBasicScenario-1132477023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:56:51Z,user_data=None,user_id='9458c7bd532e4451904ca404bf35427b',uuid=a9b960cb-39bd-4f31-9920-5ce31d5db139,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "address": "fa:16:3e:b5:15:1e", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a682f5-6d", "ovs_interfaceid": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Converting VIF {"id": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "address": "fa:16:3e:b5:15:1e", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a682f5-6d", "ovs_interfaceid": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:15:1e,bridge_name='br-int',has_traffic_filtering=True,id=68a682f5-6dbc-4c9b-ab56-b91c8cb93810,network=Network(87c23a2e-233d-487e-9789-d4eb24a63856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68a682f5-6d') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG nova.objects.instance [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lazy-loading 'pci_devices' on Instance uuid a9b960cb-39bd-4f31-9920-5ce31d5db139 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:56:53 user nova-compute[72444]:   <uuid>a9b960cb-39bd-4f31-9920-5ce31d5db139</uuid>
Aug 03 04:56:53 user nova-compute[72444]:   <name>instance-00000021</name>
Aug 03 04:56:53 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:56:53 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:56:53 user nova-compute[72444]:   <metadata>
Aug 03 04:56:53 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:56:53 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:56:53 user nova-compute[72444]:       <nova:name>tempest-TestMinimumBasicScenario-server-1751002867</nova:name>
Aug 03 04:56:53 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:56:53</nova:creationTime>
Aug 03 04:56:53 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:56:53 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:56:53 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:56:53 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:56:53 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:56:53 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:56:53 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:56:53 user nova-compute[72444]:       <nova:owner>
Aug 03 04:56:53 user nova-compute[72444]:         <nova:user uuid="9458c7bd532e4451904ca404bf35427b">tempest-TestMinimumBasicScenario-1132477023-project-member</nova:user>
Aug 03 04:56:53 user nova-compute[72444]:         <nova:project uuid="d787b7db6a684a008a03c55e292b0d5c">tempest-TestMinimumBasicScenario-1132477023</nova:project>
Aug 03 04:56:53 user nova-compute[72444]:       </nova:owner>
Aug 03 04:56:53 user nova-compute[72444]:       <nova:root type="image" uuid="8e18af3a-7ab1-40b2-9a01-456e56c71296"/>
Aug 03 04:56:53 user nova-compute[72444]:       <nova:ports>
Aug 03 04:56:53 user nova-compute[72444]:         <nova:port uuid="68a682f5-6dbc-4c9b-ab56-b91c8cb93810">
Aug 03 04:56:53 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 03 04:56:53 user nova-compute[72444]:         </nova:port>
Aug 03 04:56:53 user nova-compute[72444]:       </nova:ports>
Aug 03 04:56:53 user nova-compute[72444]:     </nova:instance>
Aug 03 04:56:53 user nova-compute[72444]:   </metadata>
Aug 03 04:56:53 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:56:53 user nova-compute[72444]:     <system>
Aug 03 04:56:53 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:56:53 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:56:53 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:56:53 user nova-compute[72444]:       <entry name="serial">a9b960cb-39bd-4f31-9920-5ce31d5db139</entry>
Aug 03 04:56:53 user nova-compute[72444]:       <entry name="uuid">a9b960cb-39bd-4f31-9920-5ce31d5db139</entry>
Aug 03 04:56:53 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:56:53 user nova-compute[72444]:     </system>
Aug 03 04:56:53 user nova-compute[72444]:   </sysinfo>
Aug 03 04:56:53 user nova-compute[72444]:   <os>
Aug 03 04:56:53 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:56:53 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:56:53 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:56:53 user nova-compute[72444]:   </os>
Aug 03 04:56:53 user nova-compute[72444]:   <features>
Aug 03 04:56:53 user nova-compute[72444]:     <acpi/>
Aug 03 04:56:53 user nova-compute[72444]:     <apic/>
Aug 03 04:56:53 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:56:53 user nova-compute[72444]:   </features>
Aug 03 04:56:53 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:56:53 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:56:53 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:56:53 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:56:53 user nova-compute[72444]:   </clock>
Aug 03 04:56:53 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:56:53 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:56:53 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:56:53 user nova-compute[72444]:   </cpu>
Aug 03 04:56:53 user nova-compute[72444]:   <devices>
Aug 03 04:56:53 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:56:53 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:56:53 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/disk"/>
Aug 03 04:56:53 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:56:53 user nova-compute[72444]:     </disk>
Aug 03 04:56:53 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:56:53 user nova-compute[72444]:       <mac address="fa:16:3e:b5:15:1e"/>
Aug 03 04:56:53 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:56:53 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:56:53 user nova-compute[72444]:       <target dev="tap68a682f5-6d"/>
Aug 03 04:56:53 user nova-compute[72444]:     </interface>
Aug 03 04:56:53 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:56:53 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/console.log" append="off"/>
Aug 03 04:56:53 user nova-compute[72444]:     </serial>
Aug 03 04:56:53 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:56:53 user nova-compute[72444]:     <video>
Aug 03 04:56:53 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:56:53 user nova-compute[72444]:     </video>
Aug 03 04:56:53 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:56:53 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:56:53 user nova-compute[72444]:     </rng>
Aug 03 04:56:53 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:56:53 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:56:53 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:56:53 user nova-compute[72444]:     </memballoon>
Aug 03 04:56:53 user nova-compute[72444]:   </devices>
Aug 03 04:56:53 user nova-compute[72444]: </domain>
Aug 03 04:56:53 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:56:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1751002867',display_name='tempest-TestMinimumBasicScenario-server-1751002867',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1751002867',id=33,image_ref='8e18af3a-7ab1-40b2-9a01-456e56c71296',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcHfxO2CJZwlfrKEV+BCKKA3mm2Qu1C0XwTCU49QSlfy4GtfOuw1uap5TaNJn3JTTUIHR9cd/KVOmyFHg2ffBTJNBWsd9JhffQaYQWGjqb5ClOLv5HgkGXnryOGHCRpGA==',key_name='tempest-TestMinimumBasicScenario-1010540444',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d787b7db6a684a008a03c55e292b0d5c',ramdisk_id='',reservation_id='r-rxwa2ccf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8e18af3a-7ab1-40b2-9a01-456e56c71296',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1132477023',owner_user_name='tempest-TestMinimumBasicScenario-1132477023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:56:51Z,user_data=None,user_id='9458c7bd532e4451904ca404bf35427b',uuid=a9b960cb-39bd-4f31-9920-5ce31d5db139,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "address": "fa:16:3e:b5:15:1e", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a682f5-6d", "ovs_interfaceid": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Converting VIF {"id": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "address": "fa:16:3e:b5:15:1e", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a682f5-6d", "ovs_interfaceid": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:15:1e,bridge_name='br-int',has_traffic_filtering=True,id=68a682f5-6dbc-4c9b-ab56-b91c8cb93810,network=Network(87c23a2e-233d-487e-9789-d4eb24a63856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68a682f5-6d') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG os_vif [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:15:1e,bridge_name='br-int',has_traffic_filtering=True,id=68a682f5-6dbc-4c9b-ab56-b91c8cb93810,network=Network(87c23a2e-233d-487e-9789-d4eb24a63856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68a682f5-6d') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68a682f5-6d, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap68a682f5-6d, col_values=(('external_ids', {'iface-id': '68a682f5-6dbc-4c9b-ab56-b91c8cb93810', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:15:1e', 'vm-uuid': 'a9b960cb-39bd-4f31-9920-5ce31d5db139'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:56:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:54 user nova-compute[72444]: INFO os_vif [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:15:1e,bridge_name='br-int',has_traffic_filtering=True,id=68a682f5-6dbc-4c9b-ab56-b91c8cb93810,network=Network(87c23a2e-233d-487e-9789-d4eb24a63856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68a682f5-6d')
Aug 03 04:56:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:56:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] No VIF found with MAC fa:16:3e:b5:15:1e, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:56:54 user nova-compute[72444]: DEBUG nova.network.neutron [req-ce42dbad-3a2e-4c2d-a0f1-27d84b303b18 req-7163ef65-eed6-43b7-80f6-d6abf34a5079 service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Updated VIF entry in instance network info cache for port 68a682f5-6dbc-4c9b-ab56-b91c8cb93810. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:56:54 user nova-compute[72444]: DEBUG nova.network.neutron [req-ce42dbad-3a2e-4c2d-a0f1-27d84b303b18 req-7163ef65-eed6-43b7-80f6-d6abf34a5079 service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Updating instance_info_cache with network_info: [{"id": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "address": "fa:16:3e:b5:15:1e", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a682f5-6d", "ovs_interfaceid": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:56:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ce42dbad-3a2e-4c2d-a0f1-27d84b303b18 req-7163ef65-eed6-43b7-80f6-d6abf34a5079 service nova] Releasing lock "refresh_cache-a9b960cb-39bd-4f31-9920-5ce31d5db139" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:56:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:55 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:56:55 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:56:55 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:56:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:55 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 04:56:55 user nova-compute[72444]: DEBUG nova.compute.manager [req-06ff98eb-861b-47d7-af0f-61f336c5643c req-34dee0f4-9ddf-4962-9a3c-954a13c8ba10 service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Received event network-vif-plugged-68a682f5-6dbc-4c9b-ab56-b91c8cb93810 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:56:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-06ff98eb-861b-47d7-af0f-61f336c5643c req-34dee0f4-9ddf-4962-9a3c-954a13c8ba10 service nova] Acquiring lock "a9b960cb-39bd-4f31-9920-5ce31d5db139-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-06ff98eb-861b-47d7-af0f-61f336c5643c req-34dee0f4-9ddf-4962-9a3c-954a13c8ba10 service nova] Lock "a9b960cb-39bd-4f31-9920-5ce31d5db139-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-06ff98eb-861b-47d7-af0f-61f336c5643c req-34dee0f4-9ddf-4962-9a3c-954a13c8ba10 service nova] Lock "a9b960cb-39bd-4f31-9920-5ce31d5db139-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:55 user nova-compute[72444]: DEBUG nova.compute.manager [req-06ff98eb-861b-47d7-af0f-61f336c5643c req-34dee0f4-9ddf-4962-9a3c-954a13c8ba10 service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] No waiting events found dispatching network-vif-plugged-68a682f5-6dbc-4c9b-ab56-b91c8cb93810 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:56:55 user nova-compute[72444]: WARNING nova.compute.manager [req-06ff98eb-861b-47d7-af0f-61f336c5643c req-34dee0f4-9ddf-4962-9a3c-954a13c8ba10 service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Received unexpected event network-vif-plugged-68a682f5-6dbc-4c9b-ab56-b91c8cb93810 for instance with vm_state building and task_state spawning.
Aug 03 04:56:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:58 user nova-compute[72444]: DEBUG nova.compute.manager [req-c25fefc2-3aa3-459d-9b31-a0f9bfb710d7 req-386d7f27-0c78-478c-af26-ff1f36161a57 service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Received event network-vif-plugged-68a682f5-6dbc-4c9b-ab56-b91c8cb93810 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:56:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-c25fefc2-3aa3-459d-9b31-a0f9bfb710d7 req-386d7f27-0c78-478c-af26-ff1f36161a57 service nova] Acquiring lock "a9b960cb-39bd-4f31-9920-5ce31d5db139-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:56:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-c25fefc2-3aa3-459d-9b31-a0f9bfb710d7 req-386d7f27-0c78-478c-af26-ff1f36161a57 service nova] Lock "a9b960cb-39bd-4f31-9920-5ce31d5db139-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:56:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-c25fefc2-3aa3-459d-9b31-a0f9bfb710d7 req-386d7f27-0c78-478c-af26-ff1f36161a57 service nova] Lock "a9b960cb-39bd-4f31-9920-5ce31d5db139-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:58 user nova-compute[72444]: DEBUG nova.compute.manager [req-c25fefc2-3aa3-459d-9b31-a0f9bfb710d7 req-386d7f27-0c78-478c-af26-ff1f36161a57 service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] No waiting events found dispatching network-vif-plugged-68a682f5-6dbc-4c9b-ab56-b91c8cb93810 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:56:58 user nova-compute[72444]: WARNING nova.compute.manager [req-c25fefc2-3aa3-459d-9b31-a0f9bfb710d7 req-386d7f27-0c78-478c-af26-ff1f36161a57 service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Received unexpected event network-vif-plugged-68a682f5-6dbc-4c9b-ab56-b91c8cb93810 for instance with vm_state building and task_state spawning.
Aug 03 04:56:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:56:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 04:56:58 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038618.1362226, a9b960cb-39bd-4f31-9920-5ce31d5db139 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:56:58 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] VM Resumed (Lifecycle Event)
Aug 03 04:56:58 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Instance spawned successfully.
Aug 03 04:56:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 04:56:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:56:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:56:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:56:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:56:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:56:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:56:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:56:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:56:58 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:56:58 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038618.137661, a9b960cb-39bd-4f31-9920-5ce31d5db139 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:56:58 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] VM Started (Lifecycle Event)
Aug 03 04:56:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:56:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:56:58 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:56:58 user nova-compute[72444]: INFO nova.compute.manager [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Took 7.13 seconds to spawn the instance on the hypervisor.
Aug 03 04:56:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:56:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:58 user nova-compute[72444]: INFO nova.compute.manager [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Took 8.17 seconds to build instance.
Aug 03 04:56:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2d99a930-cb41-48b0-9d07-abbb8a0de36d tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "a9b960cb-39bd-4f31-9920-5ce31d5db139" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.286s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:56:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:56:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:56:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:56:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:00 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:57:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:00 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:57:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87667868-78ed-4d9f-aff0-b6f0eda241bd/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87667868-78ed-4d9f-aff0-b6f0eda241bd/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87667868-78ed-4d9f-aff0-b6f0eda241bd/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87667868-78ed-4d9f-aff0-b6f0eda241bd/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Acquiring lock "df31afec-a5b7-4b2a-a062-f489429c6fef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "df31afec-a5b7-4b2a-a062-f489429c6fef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:01 user nova-compute[72444]: DEBUG nova.compute.manager [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 04:57:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:01 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 04:57:01 user nova-compute[72444]: INFO nova.compute.claims [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Claim successful on node user
Aug 03 04:57:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:01 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:57:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0233267f-f474-43cb-b8b3-6bed5146d2ed tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "b6ed9c42-fa6e-4a0d-8312-588471e157f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0233267f-f474-43cb-b8b3-6bed5146d2ed tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "b6ed9c42-fa6e-4a0d-8312-588471e157f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0233267f-f474-43cb-b8b3-6bed5146d2ed tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "b6ed9c42-fa6e-4a0d-8312-588471e157f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0233267f-f474-43cb-b8b3-6bed5146d2ed tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "b6ed9c42-fa6e-4a0d-8312-588471e157f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0233267f-f474-43cb-b8b3-6bed5146d2ed tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "b6ed9c42-fa6e-4a0d-8312-588471e157f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:01 user nova-compute[72444]: INFO nova.compute.manager [None req-0233267f-f474-43cb-b8b3-6bed5146d2ed tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Terminating instance
Aug 03 04:57:01 user nova-compute[72444]: DEBUG nova.compute.manager [None req-0233267f-f474-43cb-b8b3-6bed5146d2ed tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 04:57:02 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Refreshing inventories for resource provider b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 03 04:57:02 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Updating ProviderTree inventory for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 03 04:57:02 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Updating inventory in ProviderTree for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 03 04:57:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:02 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Refreshing aggregate associations for resource provider b624a913-bb6b-4a17-8cd7-7b0950cff161, aggregates: None {{(pid=72444) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 03 04:57:02 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:02 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:02 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Refreshing trait associations for resource provider b624a913-bb6b-4a17-8cd7-7b0950cff161, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=72444) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 03 04:57:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:02 user nova-compute[72444]: DEBUG nova.compute.manager [req-a4099a3d-5ddd-4a58-8265-70d36bef1a6d req-01d0f8a2-2396-4a50-900c-c5238df7f2dd service nova] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Received event network-vif-unplugged-bd9827e6-3c6f-4bb3-8889-1ae45107f6f0 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:57:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a4099a3d-5ddd-4a58-8265-70d36bef1a6d req-01d0f8a2-2396-4a50-900c-c5238df7f2dd service nova] Acquiring lock "b6ed9c42-fa6e-4a0d-8312-588471e157f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a4099a3d-5ddd-4a58-8265-70d36bef1a6d req-01d0f8a2-2396-4a50-900c-c5238df7f2dd service nova] Lock "b6ed9c42-fa6e-4a0d-8312-588471e157f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a4099a3d-5ddd-4a58-8265-70d36bef1a6d req-01d0f8a2-2396-4a50-900c-c5238df7f2dd service nova] Lock "b6ed9c42-fa6e-4a0d-8312-588471e157f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:02 user nova-compute[72444]: DEBUG nova.compute.manager [req-a4099a3d-5ddd-4a58-8265-70d36bef1a6d req-01d0f8a2-2396-4a50-900c-c5238df7f2dd service nova] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] No waiting events found dispatching network-vif-unplugged-bd9827e6-3c6f-4bb3-8889-1ae45107f6f0 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:57:02 user nova-compute[72444]: DEBUG nova.compute.manager [req-a4099a3d-5ddd-4a58-8265-70d36bef1a6d req-01d0f8a2-2396-4a50-900c-c5238df7f2dd service nova] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Received event network-vif-unplugged-bd9827e6-3c6f-4bb3-8889-1ae45107f6f0 for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:57:02 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:02 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:02 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:57:02 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:02 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:57:02 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:02 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.683s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 04:57:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:03 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:57:03 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:57:03 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=7442MB free_disk=24.999652862548828GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 04:57:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:03 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Instance destroyed successfully.
Aug 03 04:57:03 user nova-compute[72444]: DEBUG nova.objects.instance [None req-0233267f-f474-43cb-b8b3-6bed5146d2ed tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lazy-loading 'resources' on Instance uuid b6ed9c42-fa6e-4a0d-8312-588471e157f7 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:57:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-0233267f-f474-43cb-b8b3-6bed5146d2ed tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:40:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-418117262',display_name='tempest-ServerRescueNegativeTestJSON-server-418117262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-418117262',id=3,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:42:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='063a2a64796f4b87a44383014f0af3dc',ramdisk_id='',reservation_id='r-791q0qth',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-665683708',owner_user_name='tempest-ServerRescueNegativeTestJSON-665683708-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:42:41Z,user_data=None,user_id='07e8b540c9194e1195cb898ad08acaa0',uuid=b6ed9c42-fa6e-4a0d-8312-588471e157f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "bd9827e6-3c6f-4bb3-8889-1ae45107f6f0", "address": "fa:16:3e:61:54:b7", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd9827e6-3c", "ovs_interfaceid": "bd9827e6-3c6f-4bb3-8889-1ae45107f6f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:57:03 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-0233267f-f474-43cb-b8b3-6bed5146d2ed tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Converting VIF {"id": "bd9827e6-3c6f-4bb3-8889-1ae45107f6f0", "address": "fa:16:3e:61:54:b7", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd9827e6-3c", "ovs_interfaceid": "bd9827e6-3c6f-4bb3-8889-1ae45107f6f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:57:03 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-0233267f-f474-43cb-b8b3-6bed5146d2ed tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:54:b7,bridge_name='br-int',has_traffic_filtering=True,id=bd9827e6-3c6f-4bb3-8889-1ae45107f6f0,network=Network(bc85da72-7764-4b65-a071-aec46e3a2398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd9827e6-3c') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:57:03 user nova-compute[72444]: DEBUG os_vif [None req-0233267f-f474-43cb-b8b3-6bed5146d2ed tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:54:b7,bridge_name='br-int',has_traffic_filtering=True,id=bd9827e6-3c6f-4bb3-8889-1ae45107f6f0,network=Network(bc85da72-7764-4b65-a071-aec46e3a2398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd9827e6-3c') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:57:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd9827e6-3c, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:57:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:57:03 user nova-compute[72444]: INFO os_vif [None req-0233267f-f474-43cb-b8b3-6bed5146d2ed tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:54:b7,bridge_name='br-int',has_traffic_filtering=True,id=bd9827e6-3c6f-4bb3-8889-1ae45107f6f0,network=Network(bc85da72-7764-4b65-a071-aec46e3a2398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd9827e6-3c')
Aug 03 04:57:03 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-0233267f-f474-43cb-b8b3-6bed5146d2ed tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Deleting instance files /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7_del
Aug 03 04:57:03 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-0233267f-f474-43cb-b8b3-6bed5146d2ed tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Deletion of /opt/stack/data/nova/instances/b6ed9c42-fa6e-4a0d-8312-588471e157f7_del complete
Aug 03 04:57:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 04:57:03 user nova-compute[72444]: DEBUG nova.network.neutron [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 04:57:03 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 04:57:03 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:57:03 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 81725845-6158-4e34-bedb-6e41219bc227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:57:03 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance b6ed9c42-fa6e-4a0d-8312-588471e157f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:57:03 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance e2859322-6f99-442d-bee1-65fe49ce6360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:57:03 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:57:03 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 0b219bf3-a3b6-44b5-946e-c10e7498e1d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:57:03 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance c94f537a-b1a1-4cea-996d-e1a88a2c9dac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:57:03 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 863f0679-c64c-4a13-8028-4cb194f8f99f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:57:03 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:57:03 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance ae41789a-ebd1-4265-a903-32d2006e66d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:57:03 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 87667868-78ed-4d9f-aff0-b6f0eda241bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:57:03 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance a9b960cb-39bd-4f31-9920-5ce31d5db139 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:57:03 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance df31afec-a5b7-4b2a-a062-f489429c6fef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:57:03 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 04:57:03 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 04:57:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 04:57:03 user nova-compute[72444]: INFO nova.compute.manager [None req-0233267f-f474-43cb-b8b3-6bed5146d2ed tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Took 1.73 seconds to destroy the instance on the hypervisor.
Aug 03 04:57:03 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-0233267f-f474-43cb-b8b3-6bed5146d2ed tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 04:57:03 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 04:57:03 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 04:57:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 04:57:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 04:57:03 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Creating image(s)
Aug 03 04:57:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Acquiring lock "/opt/stack/data/nova/instances/df31afec-a5b7-4b2a-a062-f489429c6fef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "/opt/stack/data/nova/instances/df31afec-a5b7-4b2a-a062-f489429c6fef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "/opt/stack/data/nova/instances/df31afec-a5b7-4b2a-a062-f489429c6fef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.152s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.007s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG nova.policy [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be669ca3889044c7920db180a9a82ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff54227e82764df6abd50b83068c64de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.162s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/df31afec-a5b7-4b2a-a062-f489429c6fef/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/df31afec-a5b7-4b2a-a062-f489429c6fef/disk 1073741824" returned: 0 in 0.074s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:57:04 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Took 0.69 seconds to deallocate network for instance.
Aug 03 04:57:04 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.887s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72444) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG nova.compute.manager [req-4f9dd867-39c4-4052-8a09-e05933ad3f98 req-7757e28b-8e9c-47d5-9d16-ecbfd8bfce09 service nova] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Received event network-vif-deleted-bd9827e6-3c6f-4bb3-8889-1ae45107f6f0 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:57:04 user nova-compute[72444]: INFO nova.compute.manager [req-4f9dd867-39c4-4052-8a09-e05933ad3f98 req-7757e28b-8e9c-47d5-9d16-ecbfd8bfce09 service nova] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Neutron deleted interface bd9827e6-3c6f-4bb3-8889-1ae45107f6f0; detaching it from the instance and deleting it from the info cache
Aug 03 04:57:04 user nova-compute[72444]: DEBUG nova.network.neutron [req-4f9dd867-39c4-4052-8a09-e05933ad3f98 req-7757e28b-8e9c-47d5-9d16-ecbfd8bfce09 service nova] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG nova.compute.manager [req-4f9d5162-3e31-4f38-93e1-9c1f9b1259a1 req-f80d0ef0-cb7d-4c6c-a9b4-125a97bc1026 service nova] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Received event network-vif-plugged-bd9827e6-3c6f-4bb3-8889-1ae45107f6f0 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4f9d5162-3e31-4f38-93e1-9c1f9b1259a1 req-f80d0ef0-cb7d-4c6c-a9b4-125a97bc1026 service nova] Acquiring lock "b6ed9c42-fa6e-4a0d-8312-588471e157f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4f9d5162-3e31-4f38-93e1-9c1f9b1259a1 req-f80d0ef0-cb7d-4c6c-a9b4-125a97bc1026 service nova] Lock "b6ed9c42-fa6e-4a0d-8312-588471e157f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4f9d5162-3e31-4f38-93e1-9c1f9b1259a1 req-f80d0ef0-cb7d-4c6c-a9b4-125a97bc1026 service nova] Lock "b6ed9c42-fa6e-4a0d-8312-588471e157f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG nova.compute.manager [req-4f9d5162-3e31-4f38-93e1-9c1f9b1259a1 req-f80d0ef0-cb7d-4c6c-a9b4-125a97bc1026 service nova] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] No waiting events found dispatching network-vif-plugged-bd9827e6-3c6f-4bb3-8889-1ae45107f6f0 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:57:04 user nova-compute[72444]: WARNING nova.compute.manager [req-4f9d5162-3e31-4f38-93e1-9c1f9b1259a1 req-f80d0ef0-cb7d-4c6c-a9b4-125a97bc1026 service nova] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Received unexpected event network-vif-plugged-bd9827e6-3c6f-4bb3-8889-1ae45107f6f0 for instance with vm_state rescued and task_state deleting.
Aug 03 04:57:04 user nova-compute[72444]: DEBUG nova.compute.manager [req-4f9d5162-3e31-4f38-93e1-9c1f9b1259a1 req-f80d0ef0-cb7d-4c6c-a9b4-125a97bc1026 service nova] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Received event network-vif-plugged-bd9827e6-3c6f-4bb3-8889-1ae45107f6f0 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4f9d5162-3e31-4f38-93e1-9c1f9b1259a1 req-f80d0ef0-cb7d-4c6c-a9b4-125a97bc1026 service nova] Acquiring lock "b6ed9c42-fa6e-4a0d-8312-588471e157f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4f9d5162-3e31-4f38-93e1-9c1f9b1259a1 req-f80d0ef0-cb7d-4c6c-a9b4-125a97bc1026 service nova] Lock "b6ed9c42-fa6e-4a0d-8312-588471e157f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4f9d5162-3e31-4f38-93e1-9c1f9b1259a1 req-f80d0ef0-cb7d-4c6c-a9b4-125a97bc1026 service nova] Lock "b6ed9c42-fa6e-4a0d-8312-588471e157f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG nova.compute.manager [req-4f9d5162-3e31-4f38-93e1-9c1f9b1259a1 req-f80d0ef0-cb7d-4c6c-a9b4-125a97bc1026 service nova] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] No waiting events found dispatching network-vif-plugged-bd9827e6-3c6f-4bb3-8889-1ae45107f6f0 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:57:04 user nova-compute[72444]: WARNING nova.compute.manager [req-4f9d5162-3e31-4f38-93e1-9c1f9b1259a1 req-f80d0ef0-cb7d-4c6c-a9b4-125a97bc1026 service nova] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Received unexpected event network-vif-plugged-bd9827e6-3c6f-4bb3-8889-1ae45107f6f0 for instance with vm_state rescued and task_state deleting.
Aug 03 04:57:04 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.196s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Checking if we can resize image /opt/stack/data/nova/instances/df31afec-a5b7-4b2a-a062-f489429c6fef/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df31afec-a5b7-4b2a-a062-f489429c6fef/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG nova.compute.manager [req-4f9dd867-39c4-4052-8a09-e05933ad3f98 req-7757e28b-8e9c-47d5-9d16-ecbfd8bfce09 service nova] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Detach interface failed, port_id=bd9827e6-3c6f-4bb3-8889-1ae45107f6f0, reason: Instance b6ed9c42-fa6e-4a0d-8312-588471e157f7 could not be found. {{(pid=72444) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0233267f-f474-43cb-b8b3-6bed5146d2ed tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0233267f-f474-43cb-b8b3-6bed5146d2ed tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df31afec-a5b7-4b2a-a062-f489429c6fef/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Cannot resize image /opt/stack/data/nova/instances/df31afec-a5b7-4b2a-a062-f489429c6fef/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG nova.objects.instance [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lazy-loading 'migration_context' on Instance uuid df31afec-a5b7-4b2a-a062-f489429c6fef {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Ensure instance console log exists: /opt/stack/data/nova/instances/df31afec-a5b7-4b2a-a062-f489429c6fef/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:05 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-0233267f-f474-43cb-b8b3-6bed5146d2ed tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:57:05 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-0233267f-f474-43cb-b8b3-6bed5146d2ed tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:57:05 user nova-compute[72444]: DEBUG nova.network.neutron [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Successfully created port: 97c29a7f-61e6-47c1-8eef-579f3c615e98 {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:57:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0233267f-f474-43cb-b8b3-6bed5146d2ed tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.554s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:05 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-0233267f-f474-43cb-b8b3-6bed5146d2ed tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Deleted allocations for instance b6ed9c42-fa6e-4a0d-8312-588471e157f7
Aug 03 04:57:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0233267f-f474-43cb-b8b3-6bed5146d2ed tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "b6ed9c42-fa6e-4a0d-8312-588471e157f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.261s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:05 user nova-compute[72444]: DEBUG nova.network.neutron [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Successfully updated port: 97c29a7f-61e6-47c1-8eef-579f3c615e98 {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:57:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Acquiring lock "refresh_cache-df31afec-a5b7-4b2a-a062-f489429c6fef" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:57:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Acquired lock "refresh_cache-df31afec-a5b7-4b2a-a062-f489429c6fef" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:57:05 user nova-compute[72444]: DEBUG nova.network.neutron [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG nova.network.neutron [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG nova.network.neutron [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Updating instance_info_cache with network_info: [{"id": "97c29a7f-61e6-47c1-8eef-579f3c615e98", "address": "fa:16:3e:aa:d9:50", "network": {"id": "81d682a4-018d-4927-866c-2b16d48f16e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-921368252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff54227e82764df6abd50b83068c64de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c29a7f-61", "ovs_interfaceid": "97c29a7f-61e6-47c1-8eef-579f3c615e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Releasing lock "refresh_cache-df31afec-a5b7-4b2a-a062-f489429c6fef" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG nova.compute.manager [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Instance network_info: |[{"id": "97c29a7f-61e6-47c1-8eef-579f3c615e98", "address": "fa:16:3e:aa:d9:50", "network": {"id": "81d682a4-018d-4927-866c-2b16d48f16e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-921368252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff54227e82764df6abd50b83068c64de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c29a7f-61", "ovs_interfaceid": "97c29a7f-61e6-47c1-8eef-579f3c615e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Start _get_guest_xml network_info=[{"id": "97c29a7f-61e6-47c1-8eef-579f3c615e98", "address": "fa:16:3e:aa:d9:50", "network": {"id": "81d682a4-018d-4927-866c-2b16d48f16e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-921368252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff54227e82764df6abd50b83068c64de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c29a7f-61", "ovs_interfaceid": "97c29a7f-61e6-47c1-8eef-579f3c615e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:57:06 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:57:06 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:57:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:57:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-766125429',display_name='tempest-VolumesSnapshotTestJSON-instance-766125429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-766125429',id=34,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3CUXBKR6/+O9UOzCZr/zSq9JZAmCVTSC0r22rJhaaKrzKiY/zgdlnb/kb2itAB2+nMYEqLeP8T6Wxv6z4a+cE4WZFvwETSdYgC6Rlx9JlYEyTyuuM1sV7pjcoEBEid3w==',key_name='tempest-keypair-1146252995',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff54227e82764df6abd50b83068c64de',ramdisk_id='',reservation_id='r-9k7vkir4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1757877731',owner_user_name='tempest-VolumesSnapshotTestJSON-1757877731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:57:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be669ca3889044c7920db180a9a82ae2',uuid=df31afec-a5b7-4b2a-a062-f489429c6fef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97c29a7f-61e6-47c1-8eef-579f3c615e98", "address": "fa:16:3e:aa:d9:50", "network": {"id": "81d682a4-018d-4927-866c-2b16d48f16e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-921368252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff54227e82764df6abd50b83068c64de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c29a7f-61", "ovs_interfaceid": "97c29a7f-61e6-47c1-8eef-579f3c615e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Converting VIF {"id": "97c29a7f-61e6-47c1-8eef-579f3c615e98", "address": "fa:16:3e:aa:d9:50", "network": {"id": "81d682a4-018d-4927-866c-2b16d48f16e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-921368252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff54227e82764df6abd50b83068c64de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c29a7f-61", "ovs_interfaceid": "97c29a7f-61e6-47c1-8eef-579f3c615e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:d9:50,bridge_name='br-int',has_traffic_filtering=True,id=97c29a7f-61e6-47c1-8eef-579f3c615e98,network=Network(81d682a4-018d-4927-866c-2b16d48f16e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97c29a7f-61') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG nova.objects.instance [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lazy-loading 'pci_devices' on Instance uuid df31afec-a5b7-4b2a-a062-f489429c6fef {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:57:06 user nova-compute[72444]:   <uuid>df31afec-a5b7-4b2a-a062-f489429c6fef</uuid>
Aug 03 04:57:06 user nova-compute[72444]:   <name>instance-00000022</name>
Aug 03 04:57:06 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:57:06 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:57:06 user nova-compute[72444]:   <metadata>
Aug 03 04:57:06 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:57:06 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:57:06 user nova-compute[72444]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-766125429</nova:name>
Aug 03 04:57:06 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:57:06</nova:creationTime>
Aug 03 04:57:06 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:57:06 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:57:06 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:57:06 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:57:06 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:57:06 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:57:06 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:57:06 user nova-compute[72444]:       <nova:owner>
Aug 03 04:57:06 user nova-compute[72444]:         <nova:user uuid="be669ca3889044c7920db180a9a82ae2">tempest-VolumesSnapshotTestJSON-1757877731-project-member</nova:user>
Aug 03 04:57:06 user nova-compute[72444]:         <nova:project uuid="ff54227e82764df6abd50b83068c64de">tempest-VolumesSnapshotTestJSON-1757877731</nova:project>
Aug 03 04:57:06 user nova-compute[72444]:       </nova:owner>
Aug 03 04:57:06 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:57:06 user nova-compute[72444]:       <nova:ports>
Aug 03 04:57:06 user nova-compute[72444]:         <nova:port uuid="97c29a7f-61e6-47c1-8eef-579f3c615e98">
Aug 03 04:57:06 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 03 04:57:06 user nova-compute[72444]:         </nova:port>
Aug 03 04:57:06 user nova-compute[72444]:       </nova:ports>
Aug 03 04:57:06 user nova-compute[72444]:     </nova:instance>
Aug 03 04:57:06 user nova-compute[72444]:   </metadata>
Aug 03 04:57:06 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:57:06 user nova-compute[72444]:     <system>
Aug 03 04:57:06 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:57:06 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:57:06 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:57:06 user nova-compute[72444]:       <entry name="serial">df31afec-a5b7-4b2a-a062-f489429c6fef</entry>
Aug 03 04:57:06 user nova-compute[72444]:       <entry name="uuid">df31afec-a5b7-4b2a-a062-f489429c6fef</entry>
Aug 03 04:57:06 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:57:06 user nova-compute[72444]:     </system>
Aug 03 04:57:06 user nova-compute[72444]:   </sysinfo>
Aug 03 04:57:06 user nova-compute[72444]:   <os>
Aug 03 04:57:06 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:57:06 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:57:06 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:57:06 user nova-compute[72444]:   </os>
Aug 03 04:57:06 user nova-compute[72444]:   <features>
Aug 03 04:57:06 user nova-compute[72444]:     <acpi/>
Aug 03 04:57:06 user nova-compute[72444]:     <apic/>
Aug 03 04:57:06 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:57:06 user nova-compute[72444]:   </features>
Aug 03 04:57:06 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:57:06 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:57:06 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:57:06 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:57:06 user nova-compute[72444]:   </clock>
Aug 03 04:57:06 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:57:06 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:57:06 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:57:06 user nova-compute[72444]:   </cpu>
Aug 03 04:57:06 user nova-compute[72444]:   <devices>
Aug 03 04:57:06 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:57:06 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:57:06 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/df31afec-a5b7-4b2a-a062-f489429c6fef/disk"/>
Aug 03 04:57:06 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:57:06 user nova-compute[72444]:     </disk>
Aug 03 04:57:06 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:57:06 user nova-compute[72444]:       <mac address="fa:16:3e:aa:d9:50"/>
Aug 03 04:57:06 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:57:06 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:57:06 user nova-compute[72444]:       <target dev="tap97c29a7f-61"/>
Aug 03 04:57:06 user nova-compute[72444]:     </interface>
Aug 03 04:57:06 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:57:06 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/df31afec-a5b7-4b2a-a062-f489429c6fef/console.log" append="off"/>
Aug 03 04:57:06 user nova-compute[72444]:     </serial>
Aug 03 04:57:06 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:57:06 user nova-compute[72444]:     <video>
Aug 03 04:57:06 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:57:06 user nova-compute[72444]:     </video>
Aug 03 04:57:06 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:57:06 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:57:06 user nova-compute[72444]:     </rng>
Aug 03 04:57:06 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:57:06 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:57:06 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:57:06 user nova-compute[72444]:     </memballoon>
Aug 03 04:57:06 user nova-compute[72444]:   </devices>
Aug 03 04:57:06 user nova-compute[72444]: </domain>
Aug 03 04:57:06 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:57:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-766125429',display_name='tempest-VolumesSnapshotTestJSON-instance-766125429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-766125429',id=34,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3CUXBKR6/+O9UOzCZr/zSq9JZAmCVTSC0r22rJhaaKrzKiY/zgdlnb/kb2itAB2+nMYEqLeP8T6Wxv6z4a+cE4WZFvwETSdYgC6Rlx9JlYEyTyuuM1sV7pjcoEBEid3w==',key_name='tempest-keypair-1146252995',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff54227e82764df6abd50b83068c64de',ramdisk_id='',reservation_id='r-9k7vkir4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1757877731',owner_user_name='tempest-VolumesSnapshotTestJSON-1757877731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:57:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be669ca3889044c7920db180a9a82ae2',uuid=df31afec-a5b7-4b2a-a062-f489429c6fef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97c29a7f-61e6-47c1-8eef-579f3c615e98", "address": "fa:16:3e:aa:d9:50", "network": {"id": "81d682a4-018d-4927-866c-2b16d48f16e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-921368252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff54227e82764df6abd50b83068c64de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c29a7f-61", "ovs_interfaceid": "97c29a7f-61e6-47c1-8eef-579f3c615e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Converting VIF {"id": "97c29a7f-61e6-47c1-8eef-579f3c615e98", "address": "fa:16:3e:aa:d9:50", "network": {"id": "81d682a4-018d-4927-866c-2b16d48f16e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-921368252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff54227e82764df6abd50b83068c64de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c29a7f-61", "ovs_interfaceid": "97c29a7f-61e6-47c1-8eef-579f3c615e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:d9:50,bridge_name='br-int',has_traffic_filtering=True,id=97c29a7f-61e6-47c1-8eef-579f3c615e98,network=Network(81d682a4-018d-4927-866c-2b16d48f16e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97c29a7f-61') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG os_vif [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:d9:50,bridge_name='br-int',has_traffic_filtering=True,id=97c29a7f-61e6-47c1-8eef-579f3c615e98,network=Network(81d682a4-018d-4927-866c-2b16d48f16e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97c29a7f-61') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap97c29a7f-61, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap97c29a7f-61, col_values=(('external_ids', {'iface-id': '97c29a7f-61e6-47c1-8eef-579f3c615e98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:d9:50', 'vm-uuid': 'df31afec-a5b7-4b2a-a062-f489429c6fef'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:06 user nova-compute[72444]: INFO os_vif [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:d9:50,bridge_name='br-int',has_traffic_filtering=True,id=97c29a7f-61e6-47c1-8eef-579f3c615e98,network=Network(81d682a4-018d-4927-866c-2b16d48f16e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97c29a7f-61')
Aug 03 04:57:06 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Rebuilding the list of instances to heal {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG nova.compute.manager [req-18b071f7-eab0-4ce9-9fe8-4fff1b41b816 req-2ce54ae8-0b64-417f-9c99-4817ec87d257 service nova] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Received event network-changed-97c29a7f-61e6-47c1-8eef-579f3c615e98 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG nova.compute.manager [req-18b071f7-eab0-4ce9-9fe8-4fff1b41b816 req-2ce54ae8-0b64-417f-9c99-4817ec87d257 service nova] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Refreshing instance network info cache due to event network-changed-97c29a7f-61e6-47c1-8eef-579f3c615e98. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-18b071f7-eab0-4ce9-9fe8-4fff1b41b816 req-2ce54ae8-0b64-417f-9c99-4817ec87d257 service nova] Acquiring lock "refresh_cache-df31afec-a5b7-4b2a-a062-f489429c6fef" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-18b071f7-eab0-4ce9-9fe8-4fff1b41b816 req-2ce54ae8-0b64-417f-9c99-4817ec87d257 service nova] Acquired lock "refresh_cache-df31afec-a5b7-4b2a-a062-f489429c6fef" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG nova.network.neutron [req-18b071f7-eab0-4ce9-9fe8-4fff1b41b816 req-2ce54ae8-0b64-417f-9c99-4817ec87d257 service nova] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Refreshing network info cache for port 97c29a7f-61e6-47c1-8eef-579f3c615e98 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Skipping network cache update for instance because it is Building. {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] No VIF found with MAC fa:16:3e:aa:d9:50, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 04:57:06 user nova-compute[72444]: DEBUG nova.objects.instance [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lazy-loading 'info_cache' on Instance uuid 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:57:07 user nova-compute[72444]: DEBUG nova.network.neutron [req-18b071f7-eab0-4ce9-9fe8-4fff1b41b816 req-2ce54ae8-0b64-417f-9c99-4817ec87d257 service nova] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Updated VIF entry in instance network info cache for port 97c29a7f-61e6-47c1-8eef-579f3c615e98. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:57:07 user nova-compute[72444]: DEBUG nova.network.neutron [req-18b071f7-eab0-4ce9-9fe8-4fff1b41b816 req-2ce54ae8-0b64-417f-9c99-4817ec87d257 service nova] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Updating instance_info_cache with network_info: [{"id": "97c29a7f-61e6-47c1-8eef-579f3c615e98", "address": "fa:16:3e:aa:d9:50", "network": {"id": "81d682a4-018d-4927-866c-2b16d48f16e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-921368252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff54227e82764df6abd50b83068c64de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c29a7f-61", "ovs_interfaceid": "97c29a7f-61e6-47c1-8eef-579f3c615e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:57:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-18b071f7-eab0-4ce9-9fe8-4fff1b41b816 req-2ce54ae8-0b64-417f-9c99-4817ec87d257 service nova] Releasing lock "refresh_cache-df31afec-a5b7-4b2a-a062-f489429c6fef" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:57:07 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Updating instance_info_cache with network_info: [{"id": "d0cfd0c0-ac67-4335-85d2-6f0b956fae5b", "address": "fa:16:3e:e0:f6:85", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cfd0c0-ac", "ovs_interfaceid": "d0cfd0c0-ac67-4335-85d2-6f0b956fae5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:57:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:57:07 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 04:57:07 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:57:07 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:07 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:07 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:08 user nova-compute[72444]: DEBUG nova.compute.manager [req-3c1dc55f-8dfb-4f44-bd23-cce3a60a0850 req-170f16b1-c0e1-41dc-a84b-f84c471f4108 service nova] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Received event network-vif-plugged-97c29a7f-61e6-47c1-8eef-579f3c615e98 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:57:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3c1dc55f-8dfb-4f44-bd23-cce3a60a0850 req-170f16b1-c0e1-41dc-a84b-f84c471f4108 service nova] Acquiring lock "df31afec-a5b7-4b2a-a062-f489429c6fef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3c1dc55f-8dfb-4f44-bd23-cce3a60a0850 req-170f16b1-c0e1-41dc-a84b-f84c471f4108 service nova] Lock "df31afec-a5b7-4b2a-a062-f489429c6fef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3c1dc55f-8dfb-4f44-bd23-cce3a60a0850 req-170f16b1-c0e1-41dc-a84b-f84c471f4108 service nova] Lock "df31afec-a5b7-4b2a-a062-f489429c6fef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:08 user nova-compute[72444]: DEBUG nova.compute.manager [req-3c1dc55f-8dfb-4f44-bd23-cce3a60a0850 req-170f16b1-c0e1-41dc-a84b-f84c471f4108 service nova] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] No waiting events found dispatching network-vif-plugged-97c29a7f-61e6-47c1-8eef-579f3c615e98 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:57:08 user nova-compute[72444]: WARNING nova.compute.manager [req-3c1dc55f-8dfb-4f44-bd23-cce3a60a0850 req-170f16b1-c0e1-41dc-a84b-f84c471f4108 service nova] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Received unexpected event network-vif-plugged-97c29a7f-61e6-47c1-8eef-579f3c615e98 for instance with vm_state building and task_state spawning.
Aug 03 04:57:08 user nova-compute[72444]: DEBUG nova.compute.manager [req-3c1dc55f-8dfb-4f44-bd23-cce3a60a0850 req-170f16b1-c0e1-41dc-a84b-f84c471f4108 service nova] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Received event network-vif-plugged-97c29a7f-61e6-47c1-8eef-579f3c615e98 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:57:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3c1dc55f-8dfb-4f44-bd23-cce3a60a0850 req-170f16b1-c0e1-41dc-a84b-f84c471f4108 service nova] Acquiring lock "df31afec-a5b7-4b2a-a062-f489429c6fef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3c1dc55f-8dfb-4f44-bd23-cce3a60a0850 req-170f16b1-c0e1-41dc-a84b-f84c471f4108 service nova] Lock "df31afec-a5b7-4b2a-a062-f489429c6fef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3c1dc55f-8dfb-4f44-bd23-cce3a60a0850 req-170f16b1-c0e1-41dc-a84b-f84c471f4108 service nova] Lock "df31afec-a5b7-4b2a-a062-f489429c6fef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:08 user nova-compute[72444]: DEBUG nova.compute.manager [req-3c1dc55f-8dfb-4f44-bd23-cce3a60a0850 req-170f16b1-c0e1-41dc-a84b-f84c471f4108 service nova] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] No waiting events found dispatching network-vif-plugged-97c29a7f-61e6-47c1-8eef-579f3c615e98 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:57:08 user nova-compute[72444]: WARNING nova.compute.manager [req-3c1dc55f-8dfb-4f44-bd23-cce3a60a0850 req-170f16b1-c0e1-41dc-a84b-f84c471f4108 service nova] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Received unexpected event network-vif-plugged-97c29a7f-61e6-47c1-8eef-579f3c615e98 for instance with vm_state building and task_state spawning.
Aug 03 04:57:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:10 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038630.2924006, df31afec-a5b7-4b2a-a062-f489429c6fef => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:57:10 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] VM Resumed (Lifecycle Event)
Aug 03 04:57:10 user nova-compute[72444]: DEBUG nova.compute.manager [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:57:10 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 04:57:10 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Instance spawned successfully.
Aug 03 04:57:10 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 04:57:10 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:57:10 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:57:10 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:57:10 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:57:10 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:57:10 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:57:10 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:57:10 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:57:10 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:57:10 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038630.294244, df31afec-a5b7-4b2a-a062-f489429c6fef => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:57:10 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] VM Started (Lifecycle Event)
Aug 03 04:57:10 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:57:10 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:57:10 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:57:10 user nova-compute[72444]: INFO nova.compute.manager [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Took 6.53 seconds to spawn the instance on the hypervisor.
Aug 03 04:57:10 user nova-compute[72444]: DEBUG nova.compute.manager [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:57:10 user nova-compute[72444]: INFO nova.compute.manager [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Took 8.72 seconds to build instance.
Aug 03 04:57:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c4ed243b-0d40-4151-b3c0-f074b8083976 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "df31afec-a5b7-4b2a-a062-f489429c6fef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.843s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:18 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691038622.969267, b6ed9c42-fa6e-4a0d-8312-588471e157f7 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:57:18 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] VM Stopped (Lifecycle Event)
Aug 03 04:57:18 user nova-compute[72444]: DEBUG nova.compute.manager [None req-3ff6c7f9-6bbd-47d4-8bbc-5803ebb04e74 None None] [instance: b6ed9c42-fa6e-4a0d-8312-588471e157f7] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:57:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-02b89436-f668-4a91-9271-d42cb117ed1f tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "e2859322-6f99-442d-bee1-65fe49ce6360" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-02b89436-f668-4a91-9271-d42cb117ed1f tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "e2859322-6f99-442d-bee1-65fe49ce6360" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-02b89436-f668-4a91-9271-d42cb117ed1f tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "e2859322-6f99-442d-bee1-65fe49ce6360-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-02b89436-f668-4a91-9271-d42cb117ed1f tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "e2859322-6f99-442d-bee1-65fe49ce6360-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-02b89436-f668-4a91-9271-d42cb117ed1f tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "e2859322-6f99-442d-bee1-65fe49ce6360-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:29 user nova-compute[72444]: INFO nova.compute.manager [None req-02b89436-f668-4a91-9271-d42cb117ed1f tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Terminating instance
Aug 03 04:57:29 user nova-compute[72444]: DEBUG nova.compute.manager [None req-02b89436-f668-4a91-9271-d42cb117ed1f tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 04:57:29 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:29 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:29 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:29 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:29 user nova-compute[72444]: DEBUG nova.compute.manager [req-8706caeb-0b92-4539-9f34-925ec7007626 req-a31cd847-b1e6-4927-bc62-a658d4106d49 service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Received event network-vif-unplugged-269c2e0d-94ee-4084-985a-58c5afed4411 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:57:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8706caeb-0b92-4539-9f34-925ec7007626 req-a31cd847-b1e6-4927-bc62-a658d4106d49 service nova] Acquiring lock "e2859322-6f99-442d-bee1-65fe49ce6360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8706caeb-0b92-4539-9f34-925ec7007626 req-a31cd847-b1e6-4927-bc62-a658d4106d49 service nova] Lock "e2859322-6f99-442d-bee1-65fe49ce6360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8706caeb-0b92-4539-9f34-925ec7007626 req-a31cd847-b1e6-4927-bc62-a658d4106d49 service nova] Lock "e2859322-6f99-442d-bee1-65fe49ce6360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:29 user nova-compute[72444]: DEBUG nova.compute.manager [req-8706caeb-0b92-4539-9f34-925ec7007626 req-a31cd847-b1e6-4927-bc62-a658d4106d49 service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] No waiting events found dispatching network-vif-unplugged-269c2e0d-94ee-4084-985a-58c5afed4411 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:57:29 user nova-compute[72444]: DEBUG nova.compute.manager [req-8706caeb-0b92-4539-9f34-925ec7007626 req-a31cd847-b1e6-4927-bc62-a658d4106d49 service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Received event network-vif-unplugged-269c2e0d-94ee-4084-985a-58c5afed4411 for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:57:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:30 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Instance destroyed successfully.
Aug 03 04:57:30 user nova-compute[72444]: DEBUG nova.objects.instance [None req-02b89436-f668-4a91-9271-d42cb117ed1f tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lazy-loading 'resources' on Instance uuid e2859322-6f99-442d-bee1-65fe49ce6360 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:57:30 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-02b89436-f668-4a91-9271-d42cb117ed1f tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-03T04:40:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-809781841',display_name='tempest-ServerActionsTestOtherA-server-2077801933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-809781841',id=6,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDRHy6esW1Y8XjdGq8kBFPOjS8VFKeCY2PZq9mP7iSJL6lEWXDaTZRjD+kixW9a+QL5lbang2hEmB7Vd5YkTr9lWHW5QxoFRm5vUQ48SZ1Yf+s27SIuqNanyEMadE17HUA==',key_name='tempest-keypair-1657293229',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:45:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56d17468ddd64dfabba3a2c7b6df71ef',ramdisk_id='',reservation_id='r-msbwrlvq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1629114222',owner_user_name='tempest-ServerActionsTestOtherA-1629114222-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:45:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7120445361dc4363b4cc6c7671a2716e',uuid=e2859322-6f99-442d-bee1-65fe49ce6360,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "269c2e0d-94ee-4084-985a-58c5afed4411", "address": "fa:16:3e:bd:11:20", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap269c2e0d-94", "ovs_interfaceid": "269c2e0d-94ee-4084-985a-58c5afed4411", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:57:30 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-02b89436-f668-4a91-9271-d42cb117ed1f tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Converting VIF {"id": "269c2e0d-94ee-4084-985a-58c5afed4411", "address": "fa:16:3e:bd:11:20", "network": {"id": "95b97be9-d6db-45e9-b0f1-a72fc90b69d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-918052058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d17468ddd64dfabba3a2c7b6df71ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap269c2e0d-94", "ovs_interfaceid": "269c2e0d-94ee-4084-985a-58c5afed4411", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:57:30 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-02b89436-f668-4a91-9271-d42cb117ed1f tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:11:20,bridge_name='br-int',has_traffic_filtering=True,id=269c2e0d-94ee-4084-985a-58c5afed4411,network=Network(95b97be9-d6db-45e9-b0f1-a72fc90b69d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap269c2e0d-94') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:57:30 user nova-compute[72444]: DEBUG os_vif [None req-02b89436-f668-4a91-9271-d42cb117ed1f tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:11:20,bridge_name='br-int',has_traffic_filtering=True,id=269c2e0d-94ee-4084-985a-58c5afed4411,network=Network(95b97be9-d6db-45e9-b0f1-a72fc90b69d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap269c2e0d-94') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:57:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap269c2e0d-94, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:57:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:30 user nova-compute[72444]: INFO os_vif [None req-02b89436-f668-4a91-9271-d42cb117ed1f tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:11:20,bridge_name='br-int',has_traffic_filtering=True,id=269c2e0d-94ee-4084-985a-58c5afed4411,network=Network(95b97be9-d6db-45e9-b0f1-a72fc90b69d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap269c2e0d-94')
Aug 03 04:57:30 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-02b89436-f668-4a91-9271-d42cb117ed1f tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Deleting instance files /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360_del
Aug 03 04:57:30 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-02b89436-f668-4a91-9271-d42cb117ed1f tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Deletion of /opt/stack/data/nova/instances/e2859322-6f99-442d-bee1-65fe49ce6360_del complete
Aug 03 04:57:30 user nova-compute[72444]: INFO nova.compute.manager [None req-02b89436-f668-4a91-9271-d42cb117ed1f tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 03 04:57:30 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-02b89436-f668-4a91-9271-d42cb117ed1f tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 04:57:30 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 04:57:30 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 04:57:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:30 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:57:30 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Took 0.58 seconds to deallocate network for instance.
Aug 03 04:57:30 user nova-compute[72444]: DEBUG nova.compute.manager [req-1a0f2444-4b1b-477d-9562-e9622d0b099c req-34539b5b-313d-4159-832d-c41df352ce0b service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Received event network-vif-deleted-269c2e0d-94ee-4084-985a-58c5afed4411 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:57:30 user nova-compute[72444]: INFO nova.compute.manager [req-1a0f2444-4b1b-477d-9562-e9622d0b099c req-34539b5b-313d-4159-832d-c41df352ce0b service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Neutron deleted interface 269c2e0d-94ee-4084-985a-58c5afed4411; detaching it from the instance and deleting it from the info cache
Aug 03 04:57:30 user nova-compute[72444]: DEBUG nova.network.neutron [req-1a0f2444-4b1b-477d-9562-e9622d0b099c req-34539b5b-313d-4159-832d-c41df352ce0b service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:57:30 user nova-compute[72444]: DEBUG nova.compute.manager [req-1a0f2444-4b1b-477d-9562-e9622d0b099c req-34539b5b-313d-4159-832d-c41df352ce0b service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Detach interface failed, port_id=269c2e0d-94ee-4084-985a-58c5afed4411, reason: Instance e2859322-6f99-442d-bee1-65fe49ce6360 could not be found. {{(pid=72444) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 03 04:57:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-02b89436-f668-4a91-9271-d42cb117ed1f tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-02b89436-f668-4a91-9271-d42cb117ed1f tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:31 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-02b89436-f668-4a91-9271-d42cb117ed1f tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:57:31 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-02b89436-f668-4a91-9271-d42cb117ed1f tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:57:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-02b89436-f668-4a91-9271-d42cb117ed1f tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.388s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:31 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-02b89436-f668-4a91-9271-d42cb117ed1f tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Deleted allocations for instance e2859322-6f99-442d-bee1-65fe49ce6360
Aug 03 04:57:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-02b89436-f668-4a91-9271-d42cb117ed1f tempest-ServerActionsTestOtherA-1629114222 tempest-ServerActionsTestOtherA-1629114222-project-member] Lock "e2859322-6f99-442d-bee1-65fe49ce6360" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.992s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:31 user nova-compute[72444]: DEBUG nova.compute.manager [req-2f8dc932-9b3e-491e-a900-f284b3a373a4 req-c177fbf3-901a-4624-9097-8e6eb950f174 service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Received event network-vif-plugged-269c2e0d-94ee-4084-985a-58c5afed4411 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:57:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2f8dc932-9b3e-491e-a900-f284b3a373a4 req-c177fbf3-901a-4624-9097-8e6eb950f174 service nova] Acquiring lock "e2859322-6f99-442d-bee1-65fe49ce6360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2f8dc932-9b3e-491e-a900-f284b3a373a4 req-c177fbf3-901a-4624-9097-8e6eb950f174 service nova] Lock "e2859322-6f99-442d-bee1-65fe49ce6360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2f8dc932-9b3e-491e-a900-f284b3a373a4 req-c177fbf3-901a-4624-9097-8e6eb950f174 service nova] Lock "e2859322-6f99-442d-bee1-65fe49ce6360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:31 user nova-compute[72444]: DEBUG nova.compute.manager [req-2f8dc932-9b3e-491e-a900-f284b3a373a4 req-c177fbf3-901a-4624-9097-8e6eb950f174 service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] No waiting events found dispatching network-vif-plugged-269c2e0d-94ee-4084-985a-58c5afed4411 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:57:31 user nova-compute[72444]: WARNING nova.compute.manager [req-2f8dc932-9b3e-491e-a900-f284b3a373a4 req-c177fbf3-901a-4624-9097-8e6eb950f174 service nova] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Received unexpected event network-vif-plugged-269c2e0d-94ee-4084-985a-58c5afed4411 for instance with vm_state deleted and task_state None.
Aug 03 04:57:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:43 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Triggering sync for uuid 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 {{(pid=72444) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Triggering sync for uuid 81725845-6158-4e34-bedb-6e41219bc227 {{(pid=72444) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Triggering sync for uuid 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15 {{(pid=72444) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Triggering sync for uuid 0b219bf3-a3b6-44b5-946e-c10e7498e1d3 {{(pid=72444) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Triggering sync for uuid c94f537a-b1a1-4cea-996d-e1a88a2c9dac {{(pid=72444) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Triggering sync for uuid 863f0679-c64c-4a13-8028-4cb194f8f99f {{(pid=72444) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Triggering sync for uuid 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0 {{(pid=72444) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Triggering sync for uuid ae41789a-ebd1-4265-a903-32d2006e66d1 {{(pid=72444) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Triggering sync for uuid 87667868-78ed-4d9f-aff0-b6f0eda241bd {{(pid=72444) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Triggering sync for uuid a9b960cb-39bd-4f31-9920-5ce31d5db139 {{(pid=72444) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Triggering sync for uuid df31afec-a5b7-4b2a-a062-f489429c6fef {{(pid=72444) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "81725845-6158-4e34-bedb-6e41219bc227" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "81725845-6158-4e34-bedb-6e41219bc227" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "0b219bf3-a3b6-44b5-946e-c10e7498e1d3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "0b219bf3-a3b6-44b5-946e-c10e7498e1d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "863f0679-c64c-4a13-8028-4cb194f8f99f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "863f0679-c64c-4a13-8028-4cb194f8f99f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "ae41789a-ebd1-4265-a903-32d2006e66d1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "ae41789a-ebd1-4265-a903-32d2006e66d1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "87667868-78ed-4d9f-aff0-b6f0eda241bd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "87667868-78ed-4d9f-aff0-b6f0eda241bd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "a9b960cb-39bd-4f31-9920-5ce31d5db139" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "a9b960cb-39bd-4f31-9920-5ce31d5db139" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "df31afec-a5b7-4b2a-a062-f489429c6fef" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "df31afec-a5b7-4b2a-a062-f489429c6fef" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "81725845-6158-4e34-bedb-6e41219bc227" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "863f0679-c64c-4a13-8028-4cb194f8f99f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "ae41789a-ebd1-4265-a903-32d2006e66d1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "87667868-78ed-4d9f-aff0-b6f0eda241bd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "0b219bf3-a3b6-44b5-946e-c10e7498e1d3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "df31afec-a5b7-4b2a-a062-f489429c6fef" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "a9b960cb-39bd-4f31-9920-5ce31d5db139" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:45 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691038650.2794855, e2859322-6f99-442d-bee1-65fe49ce6360 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:57:45 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] VM Stopped (Lifecycle Event)
Aug 03 04:57:45 user nova-compute[72444]: DEBUG nova.compute.manager [None req-14b0e8e1-89ae-4f3b-9abc-aca8035ff451 None None] [instance: e2859322-6f99-442d-bee1-65fe49ce6360] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:57:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-579be9d8-128d-4551-97a5-109664ecc2d5 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Acquiring lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-579be9d8-128d-4551-97a5-109664ecc2d5 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-579be9d8-128d-4551-97a5-109664ecc2d5 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Acquiring lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-579be9d8-128d-4551-97a5-109664ecc2d5 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-579be9d8-128d-4551-97a5-109664ecc2d5 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:45 user nova-compute[72444]: INFO nova.compute.manager [None req-579be9d8-128d-4551-97a5-109664ecc2d5 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Terminating instance
Aug 03 04:57:45 user nova-compute[72444]: DEBUG nova.compute.manager [None req-579be9d8-128d-4551-97a5-109664ecc2d5 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 04:57:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:45 user nova-compute[72444]: DEBUG nova.compute.manager [req-3fefd6ee-c761-44ad-91e5-3eddd4ff4989 req-d844fc35-6fad-4f94-9fd0-876c1d31c86e service nova] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Received event network-vif-unplugged-b1d5afe6-1a33-4b79-a06b-79f4ea86652a {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:57:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3fefd6ee-c761-44ad-91e5-3eddd4ff4989 req-d844fc35-6fad-4f94-9fd0-876c1d31c86e service nova] Acquiring lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3fefd6ee-c761-44ad-91e5-3eddd4ff4989 req-d844fc35-6fad-4f94-9fd0-876c1d31c86e service nova] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3fefd6ee-c761-44ad-91e5-3eddd4ff4989 req-d844fc35-6fad-4f94-9fd0-876c1d31c86e service nova] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:45 user nova-compute[72444]: DEBUG nova.compute.manager [req-3fefd6ee-c761-44ad-91e5-3eddd4ff4989 req-d844fc35-6fad-4f94-9fd0-876c1d31c86e service nova] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] No waiting events found dispatching network-vif-unplugged-b1d5afe6-1a33-4b79-a06b-79f4ea86652a {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:57:45 user nova-compute[72444]: DEBUG nova.compute.manager [req-3fefd6ee-c761-44ad-91e5-3eddd4ff4989 req-d844fc35-6fad-4f94-9fd0-876c1d31c86e service nova] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Received event network-vif-unplugged-b1d5afe6-1a33-4b79-a06b-79f4ea86652a for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:57:46 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Instance destroyed successfully.
Aug 03 04:57:46 user nova-compute[72444]: DEBUG nova.objects.instance [None req-579be9d8-128d-4551-97a5-109664ecc2d5 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lazy-loading 'resources' on Instance uuid c94f537a-b1a1-4cea-996d-e1a88a2c9dac {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:57:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-579be9d8-128d-4551-97a5-109664ecc2d5 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:50:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1422343999',display_name='tempest-SnapshotDataIntegrityTests-server-1422343999',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1422343999',id=26,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYRDdh8WMuKqd0C2ip1qkT34LF5rBYi+C+tFBo0jTQJ3zeV1Z8Nh9W7FE3hUxElsJFvaOy84yUa9z8PXDzZkHs+AFADUzz2IO0+dlGOVkABaIqmGpjcFyLRMcFdEw1Irw==',key_name='tempest-keypair-840943572',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:50:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='34c9730911c84c0fa38568d481753766',ramdisk_id='',reservation_id='r-c32owu20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-2003248722',owner_user_name='tempest-SnapshotDataIntegrityTests-2003248722-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:50:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f29b6876e1a4bddab9a9a78b5a62863',uuid=c94f537a-b1a1-4cea-996d-e1a88a2c9dac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1d5afe6-1a33-4b79-a06b-79f4ea86652a", "address": "fa:16:3e:7f:5d:57", "network": {"id": "912c9d5f-3b43-4977-a056-cf05688bee52", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1503012962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9730911c84c0fa38568d481753766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1d5afe6-1a", "ovs_interfaceid": "b1d5afe6-1a33-4b79-a06b-79f4ea86652a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:57:46 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-579be9d8-128d-4551-97a5-109664ecc2d5 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Converting VIF {"id": "b1d5afe6-1a33-4b79-a06b-79f4ea86652a", "address": "fa:16:3e:7f:5d:57", "network": {"id": "912c9d5f-3b43-4977-a056-cf05688bee52", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1503012962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9730911c84c0fa38568d481753766", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1d5afe6-1a", "ovs_interfaceid": "b1d5afe6-1a33-4b79-a06b-79f4ea86652a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:57:46 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-579be9d8-128d-4551-97a5-109664ecc2d5 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:5d:57,bridge_name='br-int',has_traffic_filtering=True,id=b1d5afe6-1a33-4b79-a06b-79f4ea86652a,network=Network(912c9d5f-3b43-4977-a056-cf05688bee52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1d5afe6-1a') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:57:46 user nova-compute[72444]: DEBUG os_vif [None req-579be9d8-128d-4551-97a5-109664ecc2d5 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:5d:57,bridge_name='br-int',has_traffic_filtering=True,id=b1d5afe6-1a33-4b79-a06b-79f4ea86652a,network=Network(912c9d5f-3b43-4977-a056-cf05688bee52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1d5afe6-1a') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:57:46 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:46 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1d5afe6-1a, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:57:46 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:46 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:46 user nova-compute[72444]: INFO os_vif [None req-579be9d8-128d-4551-97a5-109664ecc2d5 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:5d:57,bridge_name='br-int',has_traffic_filtering=True,id=b1d5afe6-1a33-4b79-a06b-79f4ea86652a,network=Network(912c9d5f-3b43-4977-a056-cf05688bee52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1d5afe6-1a')
Aug 03 04:57:46 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-579be9d8-128d-4551-97a5-109664ecc2d5 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Deleting instance files /opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac_del
Aug 03 04:57:46 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-579be9d8-128d-4551-97a5-109664ecc2d5 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Deletion of /opt/stack/data/nova/instances/c94f537a-b1a1-4cea-996d-e1a88a2c9dac_del complete
Aug 03 04:57:46 user nova-compute[72444]: INFO nova.compute.manager [None req-579be9d8-128d-4551-97a5-109664ecc2d5 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 03 04:57:46 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-579be9d8-128d-4551-97a5-109664ecc2d5 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 04:57:46 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 04:57:46 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 04:57:47 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:57:47 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Took 0.92 seconds to deallocate network for instance.
Aug 03 04:57:47 user nova-compute[72444]: DEBUG nova.compute.manager [req-a759f87a-70d6-42f1-bf89-b3d1e332354c req-f7f6f385-5940-4473-9f54-bc5b19b4968b service nova] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Received event network-vif-deleted-b1d5afe6-1a33-4b79-a06b-79f4ea86652a {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:57:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-579be9d8-128d-4551-97a5-109664ecc2d5 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-579be9d8-128d-4551-97a5-109664ecc2d5 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:47 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-579be9d8-128d-4551-97a5-109664ecc2d5 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:57:47 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-579be9d8-128d-4551-97a5-109664ecc2d5 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:57:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-579be9d8-128d-4551-97a5-109664ecc2d5 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:47 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-579be9d8-128d-4551-97a5-109664ecc2d5 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Deleted allocations for instance c94f537a-b1a1-4cea-996d-e1a88a2c9dac
Aug 03 04:57:47 user nova-compute[72444]: DEBUG nova.compute.manager [req-a0b45bfd-c1f3-4fc6-8640-c18d5c4c7386 req-4013b46c-5a00-4353-b8f3-35c8bd3b5937 service nova] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Received event network-vif-plugged-b1d5afe6-1a33-4b79-a06b-79f4ea86652a {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:57:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a0b45bfd-c1f3-4fc6-8640-c18d5c4c7386 req-4013b46c-5a00-4353-b8f3-35c8bd3b5937 service nova] Acquiring lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a0b45bfd-c1f3-4fc6-8640-c18d5c4c7386 req-4013b46c-5a00-4353-b8f3-35c8bd3b5937 service nova] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a0b45bfd-c1f3-4fc6-8640-c18d5c4c7386 req-4013b46c-5a00-4353-b8f3-35c8bd3b5937 service nova] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:47 user nova-compute[72444]: DEBUG nova.compute.manager [req-a0b45bfd-c1f3-4fc6-8640-c18d5c4c7386 req-4013b46c-5a00-4353-b8f3-35c8bd3b5937 service nova] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] No waiting events found dispatching network-vif-plugged-b1d5afe6-1a33-4b79-a06b-79f4ea86652a {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:57:47 user nova-compute[72444]: WARNING nova.compute.manager [req-a0b45bfd-c1f3-4fc6-8640-c18d5c4c7386 req-4013b46c-5a00-4353-b8f3-35c8bd3b5937 service nova] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Received unexpected event network-vif-plugged-b1d5afe6-1a33-4b79-a06b-79f4ea86652a for instance with vm_state deleted and task_state None.
Aug 03 04:57:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-579be9d8-128d-4551-97a5-109664ecc2d5 tempest-SnapshotDataIntegrityTests-2003248722 tempest-SnapshotDataIntegrityTests-2003248722-project-member] Lock "c94f537a-b1a1-4cea-996d-e1a88a2c9dac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.365s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "863f0679-c64c-4a13-8028-4cb194f8f99f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "863f0679-c64c-4a13-8028-4cb194f8f99f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "863f0679-c64c-4a13-8028-4cb194f8f99f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "863f0679-c64c-4a13-8028-4cb194f8f99f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "863f0679-c64c-4a13-8028-4cb194f8f99f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:49 user nova-compute[72444]: INFO nova.compute.manager [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Terminating instance
Aug 03 04:57:49 user nova-compute[72444]: DEBUG nova.compute.manager [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 04:57:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:49 user nova-compute[72444]: DEBUG nova.compute.manager [req-f8b32c52-91a9-4581-9a13-3d9d4caaf942 req-39f531ff-36f4-4359-956d-ec6dedb4c307 service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Received event network-vif-unplugged-74465661-452c-4dba-b207-94f35c3fa50d {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:57:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f8b32c52-91a9-4581-9a13-3d9d4caaf942 req-39f531ff-36f4-4359-956d-ec6dedb4c307 service nova] Acquiring lock "863f0679-c64c-4a13-8028-4cb194f8f99f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f8b32c52-91a9-4581-9a13-3d9d4caaf942 req-39f531ff-36f4-4359-956d-ec6dedb4c307 service nova] Lock "863f0679-c64c-4a13-8028-4cb194f8f99f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f8b32c52-91a9-4581-9a13-3d9d4caaf942 req-39f531ff-36f4-4359-956d-ec6dedb4c307 service nova] Lock "863f0679-c64c-4a13-8028-4cb194f8f99f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:49 user nova-compute[72444]: DEBUG nova.compute.manager [req-f8b32c52-91a9-4581-9a13-3d9d4caaf942 req-39f531ff-36f4-4359-956d-ec6dedb4c307 service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] No waiting events found dispatching network-vif-unplugged-74465661-452c-4dba-b207-94f35c3fa50d {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:57:49 user nova-compute[72444]: DEBUG nova.compute.manager [req-f8b32c52-91a9-4581-9a13-3d9d4caaf942 req-39f531ff-36f4-4359-956d-ec6dedb4c307 service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Received event network-vif-unplugged-74465661-452c-4dba-b207-94f35c3fa50d for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:57:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:49 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:57:50 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Instance destroyed successfully.
Aug 03 04:57:50 user nova-compute[72444]: DEBUG nova.objects.instance [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lazy-loading 'resources' on Instance uuid 863f0679-c64c-4a13-8028-4cb194f8f99f {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:52:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1691297042',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1691297042',id=28,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:54:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='929fd4a3127b475282426d4412e58def',ramdisk_id='',reservation_id='r-c97ymyhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1082770125',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:56:04Z,user_data=None,user_id='ceede92aa3a74060a7f57d29d0d97aee',uuid=863f0679-c64c-4a13-8028-4cb194f8f99f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74465661-452c-4dba-b207-94f35c3fa50d", "address": "fa:16:3e:ea:30:b2", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74465661-45", "ovs_interfaceid": "74465661-452c-4dba-b207-94f35c3fa50d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Converting VIF {"id": "74465661-452c-4dba-b207-94f35c3fa50d", "address": "fa:16:3e:ea:30:b2", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74465661-45", "ovs_interfaceid": "74465661-452c-4dba-b207-94f35c3fa50d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:30:b2,bridge_name='br-int',has_traffic_filtering=True,id=74465661-452c-4dba-b207-94f35c3fa50d,network=Network(0e8b3ddd-e35a-45eb-a34c-614654c25549),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74465661-45') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG os_vif [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:30:b2,bridge_name='br-int',has_traffic_filtering=True,id=74465661-452c-4dba-b207-94f35c3fa50d,network=Network(0e8b3ddd-e35a-45eb-a34c-614654c25549),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74465661-45') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74465661-45, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:50 user nova-compute[72444]: INFO os_vif [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:30:b2,bridge_name='br-int',has_traffic_filtering=True,id=74465661-452c-4dba-b207-94f35c3fa50d,network=Network(0e8b3ddd-e35a-45eb-a34c-614654c25549),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74465661-45')
Aug 03 04:57:50 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pumHUtGc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:57:50 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:57:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[add5dfef-6bf0-4ee3-b560-2ea420d47e0f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[06133277-1c86-4706-b58a-c0f99207a303]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:57:50 user nova-compute[72444]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 (non-flash)
Aug 03 04:57:50 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:57:50 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 (non-flash)
Aug 03 04:57:50 user nova-compute[72444]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 (non-flash)
Aug 03 04:57:50 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:57:50 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308c422950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3'): ({'sde'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Removing single pathed devices sde {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a23be4-b949-488c-ac4c-ca8a38c51b17]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4a6885-a905-4885-8abb-7991d9a026bb]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Flushing IO for device /dev/sde {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c77b3f7-1d17-4e06-b621-46fa4eb4d71c]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.056s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e10cc6-2dec-48f8-ac08-81b050b3bbcb]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] SCSI volumes sde have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO9e601009-82784593b9cd1d34', '/dev/disk/by-id/scsi-23832373834353933', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_9e601009') {{(pid=84280) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f41df9-02a4-47d3-a802-579fbe9acbe0]: (4, None) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dee3fa8-41e1-4491-b6ab-ade87b6180ae]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17c5f21-656a-4205-93a7-d8c6a899ba60]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3, portal: 172.16.0.220,3260]
Aug 03 04:57:50 user nova-compute[72444]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3, portal: 172.16.0.220,3260] successful.
Aug 03 04:57:50 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9476a5-82bf-4497-8f44-a7d6a95b0da3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf48e5e3-41ad-4079-866b-3fb3e091f40d]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] <== disconnect_volume: return (305ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:57:50 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Deleting instance files /opt/stack/data/nova/instances/863f0679-c64c-4a13-8028-4cb194f8f99f_del
Aug 03 04:57:50 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Deletion of /opt/stack/data/nova/instances/863f0679-c64c-4a13-8028-4cb194f8f99f_del complete
Aug 03 04:57:50 user nova-compute[72444]: INFO nova.compute.manager [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 03 04:57:50 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:57:50 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 04:57:51 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:57:51 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Took 0.52 seconds to deallocate network for instance.
Aug 03 04:57:51 user nova-compute[72444]: DEBUG nova.compute.manager [req-6c287164-8334-4b24-bede-95aa52121027 req-5b945639-a83e-4218-9feb-1dc5e4857afb service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Received event network-vif-deleted-74465661-452c-4dba-b207-94f35c3fa50d {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:57:51 user nova-compute[72444]: INFO nova.compute.manager [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Took 0.73 seconds to detach 1 volumes for instance.
Aug 03 04:57:51 user nova-compute[72444]: DEBUG nova.compute.manager [req-92dabd12-c621-4fc2-ab63-266def79039a req-1c9d6f6c-0397-4fc1-afac-b4695c34b0c1 service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Received event network-vif-plugged-74465661-452c-4dba-b207-94f35c3fa50d {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:57:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-92dabd12-c621-4fc2-ab63-266def79039a req-1c9d6f6c-0397-4fc1-afac-b4695c34b0c1 service nova] Acquiring lock "863f0679-c64c-4a13-8028-4cb194f8f99f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-92dabd12-c621-4fc2-ab63-266def79039a req-1c9d6f6c-0397-4fc1-afac-b4695c34b0c1 service nova] Lock "863f0679-c64c-4a13-8028-4cb194f8f99f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-92dabd12-c621-4fc2-ab63-266def79039a req-1c9d6f6c-0397-4fc1-afac-b4695c34b0c1 service nova] Lock "863f0679-c64c-4a13-8028-4cb194f8f99f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:51 user nova-compute[72444]: DEBUG nova.compute.manager [req-92dabd12-c621-4fc2-ab63-266def79039a req-1c9d6f6c-0397-4fc1-afac-b4695c34b0c1 service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] No waiting events found dispatching network-vif-plugged-74465661-452c-4dba-b207-94f35c3fa50d {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:57:51 user nova-compute[72444]: WARNING nova.compute.manager [req-92dabd12-c621-4fc2-ab63-266def79039a req-1c9d6f6c-0397-4fc1-afac-b4695c34b0c1 service nova] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Received unexpected event network-vif-plugged-74465661-452c-4dba-b207-94f35c3fa50d for instance with vm_state active and task_state deleting.
Aug 03 04:57:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:52 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:57:52 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:57:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.400s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:52 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Deleted allocations for instance 863f0679-c64c-4a13-8028-4cb194f8f99f
Aug 03 04:57:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-94a3f1db-f156-44a2-a501-53fc4ff6d9b4 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "863f0679-c64c-4a13-8028-4cb194f8f99f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.970s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ddf1d348-b6aa-49c3-8130-d40a4b4b7998 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ddf1d348-b6aa-49c3-8130-d40a4b4b7998 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ddf1d348-b6aa-49c3-8130-d40a4b4b7998 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ddf1d348-b6aa-49c3-8130-d40a4b4b7998 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ddf1d348-b6aa-49c3-8130-d40a4b4b7998 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:52 user nova-compute[72444]: INFO nova.compute.manager [None req-ddf1d348-b6aa-49c3-8130-d40a4b4b7998 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Terminating instance
Aug 03 04:57:52 user nova-compute[72444]: DEBUG nova.compute.manager [None req-ddf1d348-b6aa-49c3-8130-d40a4b4b7998 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 04:57:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:53 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Instance destroyed successfully.
Aug 03 04:57:53 user nova-compute[72444]: DEBUG nova.objects.instance [None req-ddf1d348-b6aa-49c3-8130-d40a4b4b7998 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lazy-loading 'resources' on Instance uuid 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:57:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-ddf1d348-b6aa-49c3-8130-d40a4b4b7998 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:40:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-394752472',display_name='tempest-ServerRescueNegativeTestJSON-server-394752472',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-394752472',id=1,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:45:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='063a2a64796f4b87a44383014f0af3dc',ramdisk_id='',reservation_id='r-5uc5v2n5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-665683708',owner_user_name='tempest-ServerRescueNegativeTestJSON-665683708-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:47:26Z,user_data=None,user_id='07e8b540c9194e1195cb898ad08acaa0',uuid=4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0cfd0c0-ac67-4335-85d2-6f0b956fae5b", "address": "fa:16:3e:e0:f6:85", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cfd0c0-ac", "ovs_interfaceid": "d0cfd0c0-ac67-4335-85d2-6f0b956fae5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:57:53 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-ddf1d348-b6aa-49c3-8130-d40a4b4b7998 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Converting VIF {"id": "d0cfd0c0-ac67-4335-85d2-6f0b956fae5b", "address": "fa:16:3e:e0:f6:85", "network": {"id": "bc85da72-7764-4b65-a071-aec46e3a2398", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1135101543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "063a2a64796f4b87a44383014f0af3dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cfd0c0-ac", "ovs_interfaceid": "d0cfd0c0-ac67-4335-85d2-6f0b956fae5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:57:53 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-ddf1d348-b6aa-49c3-8130-d40a4b4b7998 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:f6:85,bridge_name='br-int',has_traffic_filtering=True,id=d0cfd0c0-ac67-4335-85d2-6f0b956fae5b,network=Network(bc85da72-7764-4b65-a071-aec46e3a2398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0cfd0c0-ac') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:57:53 user nova-compute[72444]: DEBUG os_vif [None req-ddf1d348-b6aa-49c3-8130-d40a4b4b7998 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:f6:85,bridge_name='br-int',has_traffic_filtering=True,id=d0cfd0c0-ac67-4335-85d2-6f0b956fae5b,network=Network(bc85da72-7764-4b65-a071-aec46e3a2398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0cfd0c0-ac') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:57:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0cfd0c0-ac, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:57:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:53 user nova-compute[72444]: INFO os_vif [None req-ddf1d348-b6aa-49c3-8130-d40a4b4b7998 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:f6:85,bridge_name='br-int',has_traffic_filtering=True,id=d0cfd0c0-ac67-4335-85d2-6f0b956fae5b,network=Network(bc85da72-7764-4b65-a071-aec46e3a2398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0cfd0c0-ac')
Aug 03 04:57:53 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-ddf1d348-b6aa-49c3-8130-d40a4b4b7998 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Deleting instance files /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0_del
Aug 03 04:57:53 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-ddf1d348-b6aa-49c3-8130-d40a4b4b7998 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Deletion of /opt/stack/data/nova/instances/4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0_del complete
Aug 03 04:57:53 user nova-compute[72444]: INFO nova.compute.manager [None req-ddf1d348-b6aa-49c3-8130-d40a4b4b7998 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 03 04:57:53 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-ddf1d348-b6aa-49c3-8130-d40a4b4b7998 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 04:57:53 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 04:57:53 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 04:57:53 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:57:53 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Took 0.51 seconds to deallocate network for instance.
Aug 03 04:57:53 user nova-compute[72444]: DEBUG nova.compute.manager [req-68393578-87d3-4b37-9e7e-9e08136ce143 req-3ba3abef-bc5b-4fd7-8066-bc49273dc04d service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Received event network-vif-deleted-d0cfd0c0-ac67-4335-85d2-6f0b956fae5b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:57:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ddf1d348-b6aa-49c3-8130-d40a4b4b7998 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ddf1d348-b6aa-49c3-8130-d40a4b4b7998 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:53 user nova-compute[72444]: DEBUG nova.compute.manager [req-d7bdf0f4-8f2b-4b24-8575-6e01fe64e6d5 req-b4b47bce-9be2-4106-bd31-96e4d87d9a64 service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Received event network-vif-unplugged-d0cfd0c0-ac67-4335-85d2-6f0b956fae5b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:57:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d7bdf0f4-8f2b-4b24-8575-6e01fe64e6d5 req-b4b47bce-9be2-4106-bd31-96e4d87d9a64 service nova] Acquiring lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d7bdf0f4-8f2b-4b24-8575-6e01fe64e6d5 req-b4b47bce-9be2-4106-bd31-96e4d87d9a64 service nova] Lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d7bdf0f4-8f2b-4b24-8575-6e01fe64e6d5 req-b4b47bce-9be2-4106-bd31-96e4d87d9a64 service nova] Lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:53 user nova-compute[72444]: DEBUG nova.compute.manager [req-d7bdf0f4-8f2b-4b24-8575-6e01fe64e6d5 req-b4b47bce-9be2-4106-bd31-96e4d87d9a64 service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] No waiting events found dispatching network-vif-unplugged-d0cfd0c0-ac67-4335-85d2-6f0b956fae5b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:57:53 user nova-compute[72444]: WARNING nova.compute.manager [req-d7bdf0f4-8f2b-4b24-8575-6e01fe64e6d5 req-b4b47bce-9be2-4106-bd31-96e4d87d9a64 service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Received unexpected event network-vif-unplugged-d0cfd0c0-ac67-4335-85d2-6f0b956fae5b for instance with vm_state deleted and task_state None.
Aug 03 04:57:53 user nova-compute[72444]: DEBUG nova.compute.manager [req-d7bdf0f4-8f2b-4b24-8575-6e01fe64e6d5 req-b4b47bce-9be2-4106-bd31-96e4d87d9a64 service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Received event network-vif-plugged-d0cfd0c0-ac67-4335-85d2-6f0b956fae5b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:57:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d7bdf0f4-8f2b-4b24-8575-6e01fe64e6d5 req-b4b47bce-9be2-4106-bd31-96e4d87d9a64 service nova] Acquiring lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d7bdf0f4-8f2b-4b24-8575-6e01fe64e6d5 req-b4b47bce-9be2-4106-bd31-96e4d87d9a64 service nova] Lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d7bdf0f4-8f2b-4b24-8575-6e01fe64e6d5 req-b4b47bce-9be2-4106-bd31-96e4d87d9a64 service nova] Lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:53 user nova-compute[72444]: DEBUG nova.compute.manager [req-d7bdf0f4-8f2b-4b24-8575-6e01fe64e6d5 req-b4b47bce-9be2-4106-bd31-96e4d87d9a64 service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] No waiting events found dispatching network-vif-plugged-d0cfd0c0-ac67-4335-85d2-6f0b956fae5b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:57:53 user nova-compute[72444]: WARNING nova.compute.manager [req-d7bdf0f4-8f2b-4b24-8575-6e01fe64e6d5 req-b4b47bce-9be2-4106-bd31-96e4d87d9a64 service nova] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Received unexpected event network-vif-plugged-d0cfd0c0-ac67-4335-85d2-6f0b956fae5b for instance with vm_state deleted and task_state None.
Aug 03 04:57:54 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-ddf1d348-b6aa-49c3-8130-d40a4b4b7998 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:57:54 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-ddf1d348-b6aa-49c3-8130-d40a4b4b7998 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:57:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ddf1d348-b6aa-49c3-8130-d40a4b4b7998 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.274s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:54 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-ddf1d348-b6aa-49c3-8130-d40a4b4b7998 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Deleted allocations for instance 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0
Aug 03 04:57:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ddf1d348-b6aa-49c3-8130-d40a4b4b7998 tempest-ServerRescueNegativeTestJSON-665683708 tempest-ServerRescueNegativeTestJSON-665683708-project-member] Lock "4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.816s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:54 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:57:54 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:57:57 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:57:57 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:57:57 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:57:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:57:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:57:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:57:57 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 04:57:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df31afec-a5b7-4b2a-a062-f489429c6fef/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:57:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df31afec-a5b7-4b2a-a062-f489429c6fef/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df31afec-a5b7-4b2a-a062-f489429c6fef/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df31afec-a5b7-4b2a-a062-f489429c6fef/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:57:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk.rescue --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:57:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87667868-78ed-4d9f-aff0-b6f0eda241bd/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87667868-78ed-4d9f-aff0-b6f0eda241bd/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87667868-78ed-4d9f-aff0-b6f0eda241bd/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:57:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87667868-78ed-4d9f-aff0-b6f0eda241bd/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:57:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:00 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:58:00 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:58:00 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=7537MB free_disk=25.043636322021484GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 04:58:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:58:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:58:00 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 81725845-6158-4e34-bedb-6e41219bc227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:58:00 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:58:00 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 0b219bf3-a3b6-44b5-946e-c10e7498e1d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:58:00 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:58:00 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance ae41789a-ebd1-4265-a903-32d2006e66d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:58:00 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 87667868-78ed-4d9f-aff0-b6f0eda241bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:58:00 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance a9b960cb-39bd-4f31-9920-5ce31d5db139 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:58:00 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance df31afec-a5b7-4b2a-a062-f489429c6fef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:58:00 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 04:58:00 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 04:58:01 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:58:01 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:58:01 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 04:58:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.388s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:58:01 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691038666.2874188, c94f537a-b1a1-4cea-996d-e1a88a2c9dac => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:58:01 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] VM Stopped (Lifecycle Event)
Aug 03 04:58:01 user nova-compute[72444]: DEBUG nova.compute.manager [None req-fdb78b5d-d918-4a99-91d9-3c5067602a73 None None] [instance: c94f537a-b1a1-4cea-996d-e1a88a2c9dac] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:58:02 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:58:02 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 04:58:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-81725845-6158-4e34-bedb-6e41219bc227" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:58:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-81725845-6158-4e34-bedb-6e41219bc227" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:58:02 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 04:58:02 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Updating instance_info_cache with network_info: [{"id": "9b1b9675-c2df-4b16-ba94-807765bab119", "address": "fa:16:3e:e6:7a:2e", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b1b9675-c2", "ovs_interfaceid": "9b1b9675-c2df-4b16-ba94-807765bab119", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:58:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-81725845-6158-4e34-bedb-6e41219bc227" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:58:02 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 04:58:02 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:58:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:58:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 04:58:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 04:58:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 04:58:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:05 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691038670.1650467, 863f0679-c64c-4a13-8028-4cb194f8f99f => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:58:05 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] VM Stopped (Lifecycle Event)
Aug 03 04:58:05 user nova-compute[72444]: DEBUG nova.compute.manager [None req-e0ffb188-264b-4235-bc0a-d5686c8cf093 None None] [instance: 863f0679-c64c-4a13-8028-4cb194f8f99f] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:58:06 user nova-compute[72444]: DEBUG nova.compute.manager [req-368e24b9-efc4-4856-89b4-ceb7ad590336 req-a8ef227f-d41e-41f1-b3a7-a92909c019ed service nova] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Received event network-changed-e6e423a5-90cd-466a-9a6f-6b99812426ee {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:58:06 user nova-compute[72444]: DEBUG nova.compute.manager [req-368e24b9-efc4-4856-89b4-ceb7ad590336 req-a8ef227f-d41e-41f1-b3a7-a92909c019ed service nova] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Refreshing instance network info cache due to event network-changed-e6e423a5-90cd-466a-9a6f-6b99812426ee. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:58:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-368e24b9-efc4-4856-89b4-ceb7ad590336 req-a8ef227f-d41e-41f1-b3a7-a92909c019ed service nova] Acquiring lock "refresh_cache-87667868-78ed-4d9f-aff0-b6f0eda241bd" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:58:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-368e24b9-efc4-4856-89b4-ceb7ad590336 req-a8ef227f-d41e-41f1-b3a7-a92909c019ed service nova] Acquired lock "refresh_cache-87667868-78ed-4d9f-aff0-b6f0eda241bd" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:58:06 user nova-compute[72444]: DEBUG nova.network.neutron [req-368e24b9-efc4-4856-89b4-ceb7ad590336 req-a8ef227f-d41e-41f1-b3a7-a92909c019ed service nova] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Refreshing network info cache for port e6e423a5-90cd-466a-9a6f-6b99812426ee {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:58:06 user nova-compute[72444]: DEBUG nova.network.neutron [req-368e24b9-efc4-4856-89b4-ceb7ad590336 req-a8ef227f-d41e-41f1-b3a7-a92909c019ed service nova] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Updated VIF entry in instance network info cache for port e6e423a5-90cd-466a-9a6f-6b99812426ee. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:58:06 user nova-compute[72444]: DEBUG nova.network.neutron [req-368e24b9-efc4-4856-89b4-ceb7ad590336 req-a8ef227f-d41e-41f1-b3a7-a92909c019ed service nova] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Updating instance_info_cache with network_info: [{"id": "e6e423a5-90cd-466a-9a6f-6b99812426ee", "address": "fa:16:3e:98:7f:e7", "network": {"id": "bb35bc76-087b-4468-ba0c-3637873207f8", "bridge": "br-int", "label": "tempest-TestStampPattern-620416114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d114efe1dfc1424299621df67bf00863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e423a5-90", "ovs_interfaceid": "e6e423a5-90cd-466a-9a6f-6b99812426ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:58:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-368e24b9-efc4-4856-89b4-ceb7ad590336 req-a8ef227f-d41e-41f1-b3a7-a92909c019ed service nova] Releasing lock "refresh_cache-87667868-78ed-4d9f-aff0-b6f0eda241bd" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:58:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Acquiring lock "87667868-78ed-4d9f-aff0-b6f0eda241bd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:58:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "87667868-78ed-4d9f-aff0-b6f0eda241bd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:58:06 user nova-compute[72444]: DEBUG nova.objects.instance [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lazy-loading 'flavor' on Instance uuid 87667868-78ed-4d9f-aff0-b6f0eda241bd {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:58:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "87667868-78ed-4d9f-aff0-b6f0eda241bd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:58:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Acquiring lock "87667868-78ed-4d9f-aff0-b6f0eda241bd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:58:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "87667868-78ed-4d9f-aff0-b6f0eda241bd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:58:06 user nova-compute[72444]: INFO nova.compute.manager [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Attaching volume 456bd100-77f4-4e67-a502-6c636b255588 to /dev/vdb
Aug 03 04:58:06 user nova-compute[72444]: DEBUG os_brick.utils [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:58:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:06 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe64c77-3f87-43ca-ac45-ab55938befbd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:06 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b78c93e-aafa-4c6d-a9d3-fddebc024250]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:06 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbab3cf-9e03-46a6-a3aa-a6af5c47d6ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:06 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ba21b8-b35a-4cd2-b24e-6a5762358525]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:58:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 04:58:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:58:07 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 04:58:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9c3163-c0ac-4fd4-9e3c-6542d70ed473]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 04:58:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 04:58:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 04:58:07 user nova-compute[72444]: DEBUG os_brick.utils [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:58:07 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Updating existing volume attachment record: 2d29b085-cb47-4e93-8d4c-01fc925e9e1b {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 04:58:08 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691038673.1520417, 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:58:08 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] VM Stopped (Lifecycle Event)
Aug 03 04:58:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:58:08 user nova-compute[72444]: DEBUG nova.compute.manager [None req-980316bc-5d21-48c5-bab4-1606b809a81e None None] [instance: 4c6eb8ce-fb98-4d78-9cc8-32029d0b55d0] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:58:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XYrKRljc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:58:14 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:58:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:58:14 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:58:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:58:14 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:58:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1e278a-0eba-4c64-89df-1b0043ace825]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 04:58:14 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588 -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6701ad42-dbd5-4285-b065-42a5be11a5b4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588] added
Aug 03 04:58:14 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ac9c29-c854-4cda-90ef-f88e88c1f65e]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7455cfdf-ec55-4549-b5ed-51b9be1f5027]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XYrKRljc {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XYrKRljc" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09ae5b2-94cd-4192-9630-a69f398b1926]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XYrKRljc'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88b1d8d-f113-4ce0-b5ca-7d2476a215c0]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0508aa3e-b822-4651-9488-e3692a7b2fa1]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 (non-flash)
Aug 03 04:58:14 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:58:14 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 (non-flash)
Aug 03 04:58:14 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:58:14 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588 -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cc2669-e136-46c6-a777-0cb7b21cd51c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588, portal: 172.16.0.220,3260]
Aug 03 04:58:14 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588, portal: 172.16.0.220,3260] successful.
Aug 03 04:58:14 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4aea33-105a-44e5-8cd2-6a0204165775]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcc0bbc-edb3-4f64-8430-c01f99c23a80]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 (non-flash)
Aug 03 04:58:14 user nova-compute[72444]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588 (non-flash)
Aug 03 04:58:14 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:58:14 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 (non-flash)
Aug 03 04:58:14 user nova-compute[72444]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588 (non-flash)
Aug 03 04:58:14 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:58:14 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9119b0ae-f3d5-46c8-8441-c4d4c007f504]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:58:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XYrKRljc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:58:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:58:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23766353137353966', 'path': '/dev/sdc'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:58:15 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766353137353966', 'path': '/dev/sdc'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:58:15 user nova-compute[72444]: DEBUG nova.objects.instance [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lazy-loading 'flavor' on Instance uuid 87667868-78ed-4d9f-aff0-b6f0eda241bd {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:58:15 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 04:58:15 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:58:15 user nova-compute[72444]:   <source dev="/dev/sdc"/>
Aug 03 04:58:15 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:58:15 user nova-compute[72444]:   <serial>456bd100-77f4-4e67-a502-6c636b255588</serial>
Aug 03 04:58:15 user nova-compute[72444]: </disk>
Aug 03 04:58:15 user nova-compute[72444]:  {{(pid=72444) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 04:58:16 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:58:16 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:58:16 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] No VIF found with MAC fa:16:3e:98:7f:e7, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:58:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-3ef5a966-7a08-4a66-af5f-ae4f8bffac1a tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "87667868-78ed-4d9f-aff0-b6f0eda241bd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.500s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:58:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2c67ae73-f711-4e91-92e2-6e32af75f58e tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Acquiring lock "87667868-78ed-4d9f-aff0-b6f0eda241bd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:58:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2c67ae73-f711-4e91-92e2-6e32af75f58e tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "87667868-78ed-4d9f-aff0-b6f0eda241bd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:58:17 user nova-compute[72444]: INFO nova.compute.manager [None req-2c67ae73-f711-4e91-92e2-6e32af75f58e tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Detaching volume 456bd100-77f4-4e67-a502-6c636b255588
Aug 03 04:58:17 user nova-compute[72444]: INFO nova.virt.block_device [None req-2c67ae73-f711-4e91-92e2-6e32af75f58e tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Attempting to driver detach volume 456bd100-77f4-4e67-a502-6c636b255588 from mountpoint /dev/vdb
Aug 03 04:58:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2c67ae73-f711-4e91-92e2-6e32af75f58e tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Attempting to detach device vdb from instance 87667868-78ed-4d9f-aff0-b6f0eda241bd from the persistent domain config. {{(pid=72444) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 04:58:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-2c67ae73-f711-4e91-92e2-6e32af75f58e tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 04:58:17 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:58:17 user nova-compute[72444]:   <source dev="/dev/sdc"/>
Aug 03 04:58:17 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:58:17 user nova-compute[72444]:   <serial>456bd100-77f4-4e67-a502-6c636b255588</serial>
Aug 03 04:58:17 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 04:58:17 user nova-compute[72444]: </disk>
Aug 03 04:58:17 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:58:17 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-2c67ae73-f711-4e91-92e2-6e32af75f58e tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Successfully detached device vdb from instance 87667868-78ed-4d9f-aff0-b6f0eda241bd from the persistent domain config.
Aug 03 04:58:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2c67ae73-f711-4e91-92e2-6e32af75f58e tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 87667868-78ed-4d9f-aff0-b6f0eda241bd from the live domain config. {{(pid=72444) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 04:58:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-2c67ae73-f711-4e91-92e2-6e32af75f58e tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 04:58:17 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:58:17 user nova-compute[72444]:   <source dev="/dev/sdc"/>
Aug 03 04:58:17 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:58:17 user nova-compute[72444]:   <serial>456bd100-77f4-4e67-a502-6c636b255588</serial>
Aug 03 04:58:17 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 04:58:17 user nova-compute[72444]: </disk>
Aug 03 04:58:17 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Received event <DeviceRemovedEvent: 1691038698.075063, 87667868-78ed-4d9f-aff0-b6f0eda241bd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72444) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2c67ae73-f711-4e91-92e2-6e32af75f58e tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 87667868-78ed-4d9f-aff0-b6f0eda241bd {{(pid=72444) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 04:58:18 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-2c67ae73-f711-4e91-92e2-6e32af75f58e tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Successfully detached device vdb from instance 87667868-78ed-4d9f-aff0-b6f0eda241bd from the live domain config.
Aug 03 04:58:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c67ae73-f711-4e91-92e2-6e32af75f58e tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c67ae73-f711-4e91-92e2-6e32af75f58e tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XYrKRljc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:58:18 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-2c67ae73-f711-4e91-92e2-6e32af75f58e tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:58:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-2c67ae73-f711-4e91-92e2-6e32af75f58e tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-2c67ae73-f711-4e91-92e2-6e32af75f58e tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c67ae73-f711-4e91-92e2-6e32af75f58e tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[792acc09-0d36-4b7c-8468-e73b5d1d3a24]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a85d51d-931f-4cea-9108-7e697a6cc30d]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c67ae73-f711-4e91-92e2-6e32af75f58e tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 (non-flash)
Aug 03 04:58:18 user nova-compute[72444]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588 (non-flash)
Aug 03 04:58:18 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:58:18 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c67ae73-f711-4e91-92e2-6e32af75f58e tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 (non-flash)
Aug 03 04:58:18 user nova-compute[72444]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588 (non-flash)
Aug 03 04:58:18 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:58:18 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c67ae73-f711-4e91-92e2-6e32af75f58e tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308c41c820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588'): ({'sdc'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-2c67ae73-f711-4e91-92e2-6e32af75f58e tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Removing single pathed devices sdc {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f648dd8a-3a4e-483f-aaf2-68159c378ec1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fbe3d9-0af6-42e6-a37e-145f5099cc74]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-2c67ae73-f711-4e91-92e2-6e32af75f58e tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Flushing IO for device /dev/sdc {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba55092-b5bd-460f-9dce-0cee79d27770]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-2c67ae73-f711-4e91-92e2-6e32af75f58e tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4693507a-dafa-47a8-a066-ddff29a0596a]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-2c67ae73-f711-4e91-92e2-6e32af75f58e tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-2c67ae73-f711-4e91-92e2-6e32af75f58e tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] SCSI volumes sdc have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c67ae73-f711-4e91-92e2-6e32af75f58e tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7941c323-a47c-4aab-9a35-64ad797de7b9]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c67ae73-f711-4e91-92e2-6e32af75f58e tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588 -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a438e2d-01d9-4ec5-ae1d-78bfbb87488c]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c67ae73-f711-4e91-92e2-6e32af75f58e tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588, portal: 172.16.0.220,3260]
Aug 03 04:58:18 user nova-compute[72444]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588, portal: 172.16.0.220,3260] successful.
Aug 03 04:58:18 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588 -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:456bd100-77f4-4e67-a502-6c636b255588 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0fc273-758e-4335-bc4b-ad05e923e331]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c67ae73-f711-4e91-92e2-6e32af75f58e tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-2c67ae73-f711-4e91-92e2-6e32af75f58e tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.246s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c67ae73-f711-4e91-92e2-6e32af75f58e tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] <== disconnect_volume: return (247ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:58:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c67ae73-f711-4e91-92e2-6e32af75f58e tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:58:19 user nova-compute[72444]: DEBUG nova.objects.instance [None req-2c67ae73-f711-4e91-92e2-6e32af75f58e tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lazy-loading 'flavor' on Instance uuid 87667868-78ed-4d9f-aff0-b6f0eda241bd {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:58:19 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2c67ae73-f711-4e91-92e2-6e32af75f58e tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "87667868-78ed-4d9f-aff0-b6f0eda241bd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.511s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:58:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:32 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:33 user nova-compute[72444]: INFO nova.compute.manager [None req-c90ecc9f-a71c-495e-8961-fdd16099299a tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Unrescuing
Aug 03 04:58:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c90ecc9f-a71c-495e-8961-fdd16099299a tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Acquiring lock "refresh_cache-27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:58:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c90ecc9f-a71c-495e-8961-fdd16099299a tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Acquired lock "refresh_cache-27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:58:33 user nova-compute[72444]: DEBUG nova.network.neutron [None req-c90ecc9f-a71c-495e-8961-fdd16099299a tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:58:33 user nova-compute[72444]: DEBUG nova.network.neutron [None req-c90ecc9f-a71c-495e-8961-fdd16099299a tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Updating instance_info_cache with network_info: [{"id": "7a41fc62-2272-4198-99cb-19d77d1dc193", "address": "fa:16:3e:68:ec:25", "network": {"id": "d132f1d9-d7bd-4630-bd3d-e911f43d14bb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1090455023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08ed53988ee44a081db4223ad0a9264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a41fc62-22", "ovs_interfaceid": "7a41fc62-2272-4198-99cb-19d77d1dc193", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:58:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c90ecc9f-a71c-495e-8961-fdd16099299a tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Releasing lock "refresh_cache-27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:58:33 user nova-compute[72444]: DEBUG nova.objects.instance [None req-c90ecc9f-a71c-495e-8961-fdd16099299a tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lazy-loading 'flavor' on Instance uuid 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:58:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:34 user nova-compute[72444]: DEBUG nova.compute.manager [req-f3919748-b878-4a60-b212-f49a20f1cd73 req-f0f64ff3-fc10-4065-88ff-50ddd0e643f8 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Received event network-vif-unplugged-7a41fc62-2272-4198-99cb-19d77d1dc193 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:58:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f3919748-b878-4a60-b212-f49a20f1cd73 req-f0f64ff3-fc10-4065-88ff-50ddd0e643f8 service nova] Acquiring lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:58:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f3919748-b878-4a60-b212-f49a20f1cd73 req-f0f64ff3-fc10-4065-88ff-50ddd0e643f8 service nova] Lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:58:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f3919748-b878-4a60-b212-f49a20f1cd73 req-f0f64ff3-fc10-4065-88ff-50ddd0e643f8 service nova] Lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:58:34 user nova-compute[72444]: DEBUG nova.compute.manager [req-f3919748-b878-4a60-b212-f49a20f1cd73 req-f0f64ff3-fc10-4065-88ff-50ddd0e643f8 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] No waiting events found dispatching network-vif-unplugged-7a41fc62-2272-4198-99cb-19d77d1dc193 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:58:34 user nova-compute[72444]: WARNING nova.compute.manager [req-f3919748-b878-4a60-b212-f49a20f1cd73 req-f0f64ff3-fc10-4065-88ff-50ddd0e643f8 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Received unexpected event network-vif-unplugged-7a41fc62-2272-4198-99cb-19d77d1dc193 for instance with vm_state rescued and task_state unrescuing.
Aug 03 04:58:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:34 user nova-compute[72444]: DEBUG nova.compute.manager [req-eff29743-0a20-4ae5-a760-5939eb4f3b4e req-3b6a944c-5c96-4b22-97f1-5feb266ce002 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Received event network-changed-7a41fc62-2272-4198-99cb-19d77d1dc193 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:58:34 user nova-compute[72444]: DEBUG nova.compute.manager [req-eff29743-0a20-4ae5-a760-5939eb4f3b4e req-3b6a944c-5c96-4b22-97f1-5feb266ce002 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Refreshing instance network info cache due to event network-changed-7a41fc62-2272-4198-99cb-19d77d1dc193. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:58:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-eff29743-0a20-4ae5-a760-5939eb4f3b4e req-3b6a944c-5c96-4b22-97f1-5feb266ce002 service nova] Acquiring lock "refresh_cache-27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:58:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-eff29743-0a20-4ae5-a760-5939eb4f3b4e req-3b6a944c-5c96-4b22-97f1-5feb266ce002 service nova] Acquired lock "refresh_cache-27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:58:34 user nova-compute[72444]: DEBUG nova.network.neutron [req-eff29743-0a20-4ae5-a760-5939eb4f3b4e req-3b6a944c-5c96-4b22-97f1-5feb266ce002 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Refreshing network info cache for port 7a41fc62-2272-4198-99cb-19d77d1dc193 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:58:34 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Instance destroyed successfully.
Aug 03 04:58:34 user nova-compute[72444]: DEBUG nova.network.neutron [req-eff29743-0a20-4ae5-a760-5939eb4f3b4e req-3b6a944c-5c96-4b22-97f1-5feb266ce002 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Updated VIF entry in instance network info cache for port 7a41fc62-2272-4198-99cb-19d77d1dc193. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:58:34 user nova-compute[72444]: DEBUG nova.network.neutron [req-eff29743-0a20-4ae5-a760-5939eb4f3b4e req-3b6a944c-5c96-4b22-97f1-5feb266ce002 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Updating instance_info_cache with network_info: [{"id": "7a41fc62-2272-4198-99cb-19d77d1dc193", "address": "fa:16:3e:68:ec:25", "network": {"id": "d132f1d9-d7bd-4630-bd3d-e911f43d14bb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1090455023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08ed53988ee44a081db4223ad0a9264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a41fc62-22", "ovs_interfaceid": "7a41fc62-2272-4198-99cb-19d77d1dc193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:58:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-eff29743-0a20-4ae5-a760-5939eb4f3b4e req-3b6a944c-5c96-4b22-97f1-5feb266ce002 service nova] Releasing lock "refresh_cache-27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:58:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Acquiring lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:58:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:58:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:35 user nova-compute[72444]: DEBUG nova.compute.manager [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 04:58:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:58:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:58:36 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 04:58:36 user nova-compute[72444]: INFO nova.compute.claims [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Claim successful on node user
Aug 03 04:58:36 user nova-compute[72444]: DEBUG nova.compute.manager [req-92c69449-753f-4035-942b-4e22544bcc71 req-cd651279-e7d1-4470-a928-b6850e3fe970 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Received event network-vif-plugged-7a41fc62-2272-4198-99cb-19d77d1dc193 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:58:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-92c69449-753f-4035-942b-4e22544bcc71 req-cd651279-e7d1-4470-a928-b6850e3fe970 service nova] Acquiring lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:58:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-92c69449-753f-4035-942b-4e22544bcc71 req-cd651279-e7d1-4470-a928-b6850e3fe970 service nova] Lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:58:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-92c69449-753f-4035-942b-4e22544bcc71 req-cd651279-e7d1-4470-a928-b6850e3fe970 service nova] Lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:58:36 user nova-compute[72444]: DEBUG nova.compute.manager [req-92c69449-753f-4035-942b-4e22544bcc71 req-cd651279-e7d1-4470-a928-b6850e3fe970 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] No waiting events found dispatching network-vif-plugged-7a41fc62-2272-4198-99cb-19d77d1dc193 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:58:36 user nova-compute[72444]: WARNING nova.compute.manager [req-92c69449-753f-4035-942b-4e22544bcc71 req-cd651279-e7d1-4470-a928-b6850e3fe970 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Received unexpected event network-vif-plugged-7a41fc62-2272-4198-99cb-19d77d1dc193 for instance with vm_state rescued and task_state unrescuing.
Aug 03 04:58:36 user nova-compute[72444]: DEBUG nova.compute.manager [req-92c69449-753f-4035-942b-4e22544bcc71 req-cd651279-e7d1-4470-a928-b6850e3fe970 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Received event network-vif-plugged-7a41fc62-2272-4198-99cb-19d77d1dc193 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:58:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-92c69449-753f-4035-942b-4e22544bcc71 req-cd651279-e7d1-4470-a928-b6850e3fe970 service nova] Acquiring lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:58:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-92c69449-753f-4035-942b-4e22544bcc71 req-cd651279-e7d1-4470-a928-b6850e3fe970 service nova] Lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:58:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-92c69449-753f-4035-942b-4e22544bcc71 req-cd651279-e7d1-4470-a928-b6850e3fe970 service nova] Lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:58:36 user nova-compute[72444]: DEBUG nova.compute.manager [req-92c69449-753f-4035-942b-4e22544bcc71 req-cd651279-e7d1-4470-a928-b6850e3fe970 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] No waiting events found dispatching network-vif-plugged-7a41fc62-2272-4198-99cb-19d77d1dc193 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:58:36 user nova-compute[72444]: WARNING nova.compute.manager [req-92c69449-753f-4035-942b-4e22544bcc71 req-cd651279-e7d1-4470-a928-b6850e3fe970 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Received unexpected event network-vif-plugged-7a41fc62-2272-4198-99cb-19d77d1dc193 for instance with vm_state rescued and task_state unrescuing.
Aug 03 04:58:36 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:58:36 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:58:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.414s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:58:36 user nova-compute[72444]: DEBUG nova.compute.manager [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 04:58:36 user nova-compute[72444]: DEBUG nova.compute.manager [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 04:58:36 user nova-compute[72444]: DEBUG nova.network.neutron [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 04:58:36 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 04:58:36 user nova-compute[72444]: DEBUG nova.compute.manager [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 04:58:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:36 user nova-compute[72444]: DEBUG nova.policy [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '32aef58e87044e47b99cd37e300393aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac3f775464f48d88f05efdf3aeb4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 04:58:36 user nova-compute[72444]: DEBUG nova.compute.manager [req-a66d16ed-0372-4fd8-b26f-1c1b03226c5b req-1a0ed27a-469e-4e64-a171-b2ba0ab6fae3 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Received event network-changed-7a41fc62-2272-4198-99cb-19d77d1dc193 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:58:36 user nova-compute[72444]: DEBUG nova.compute.manager [req-a66d16ed-0372-4fd8-b26f-1c1b03226c5b req-1a0ed27a-469e-4e64-a171-b2ba0ab6fae3 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Refreshing instance network info cache due to event network-changed-7a41fc62-2272-4198-99cb-19d77d1dc193. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:58:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a66d16ed-0372-4fd8-b26f-1c1b03226c5b req-1a0ed27a-469e-4e64-a171-b2ba0ab6fae3 service nova] Acquiring lock "refresh_cache-27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:58:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a66d16ed-0372-4fd8-b26f-1c1b03226c5b req-1a0ed27a-469e-4e64-a171-b2ba0ab6fae3 service nova] Acquired lock "refresh_cache-27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:58:36 user nova-compute[72444]: DEBUG nova.network.neutron [req-a66d16ed-0372-4fd8-b26f-1c1b03226c5b req-1a0ed27a-469e-4e64-a171-b2ba0ab6fae3 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Refreshing network info cache for port 7a41fc62-2272-4198-99cb-19d77d1dc193 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:58:36 user nova-compute[72444]: DEBUG nova.compute.manager [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 04:58:36 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 04:58:36 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Creating image(s)
Aug 03 04:58:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Acquiring lock "/opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:58:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "/opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:58:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "/opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:58:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.140s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:58:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:58:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.137s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:37 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk 1073741824" returned: 0 in 0.062s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:58:37 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:37 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.150s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:37 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 04:58:37 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:37 user nova-compute[72444]: DEBUG nova.network.neutron [req-a66d16ed-0372-4fd8-b26f-1c1b03226c5b req-1a0ed27a-469e-4e64-a171-b2ba0ab6fae3 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Updated VIF entry in instance network info cache for port 7a41fc62-2272-4198-99cb-19d77d1dc193. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:58:37 user nova-compute[72444]: DEBUG nova.network.neutron [req-a66d16ed-0372-4fd8-b26f-1c1b03226c5b req-1a0ed27a-469e-4e64-a171-b2ba0ab6fae3 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Updating instance_info_cache with network_info: [{"id": "7a41fc62-2272-4198-99cb-19d77d1dc193", "address": "fa:16:3e:68:ec:25", "network": {"id": "d132f1d9-d7bd-4630-bd3d-e911f43d14bb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1090455023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08ed53988ee44a081db4223ad0a9264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a41fc62-22", "ovs_interfaceid": "7a41fc62-2272-4198-99cb-19d77d1dc193", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:58:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a66d16ed-0372-4fd8-b26f-1c1b03226c5b req-1a0ed27a-469e-4e64-a171-b2ba0ab6fae3 service nova] Releasing lock "refresh_cache-27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:58:37 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:37 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Cannot resize image /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 04:58:37 user nova-compute[72444]: DEBUG nova.objects.instance [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lazy-loading 'migration_context' on Instance uuid 4f225dc2-3011-4c15-bb8e-1ebb079a3b50 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:58:37 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 04:58:37 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Ensure instance console log exists: /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 04:58:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:58:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:58:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:58:37 user nova-compute[72444]: DEBUG nova.network.neutron [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Successfully created port: 775b17bb-97a7-4a00-9368-198abafa4f8b {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 04:58:37 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Removed pending event for 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0 due to event {{(pid=72444) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 03 04:58:37 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038717.9723573, 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:58:37 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] VM Resumed (Lifecycle Event)
Aug 03 04:58:37 user nova-compute[72444]: DEBUG nova.compute.manager [None req-c90ecc9f-a71c-495e-8961-fdd16099299a tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:58:38 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038717.9752207, 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:58:38 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] VM Started (Lifecycle Event)
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.compute.manager [req-459ecaed-fced-4e81-8c6a-0d240b1ee446 req-242c3759-1edc-43da-9db3-c01607536aa2 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Received event network-vif-plugged-7a41fc62-2272-4198-99cb-19d77d1dc193 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-459ecaed-fced-4e81-8c6a-0d240b1ee446 req-242c3759-1edc-43da-9db3-c01607536aa2 service nova] Acquiring lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-459ecaed-fced-4e81-8c6a-0d240b1ee446 req-242c3759-1edc-43da-9db3-c01607536aa2 service nova] Lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-459ecaed-fced-4e81-8c6a-0d240b1ee446 req-242c3759-1edc-43da-9db3-c01607536aa2 service nova] Lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.compute.manager [req-459ecaed-fced-4e81-8c6a-0d240b1ee446 req-242c3759-1edc-43da-9db3-c01607536aa2 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] No waiting events found dispatching network-vif-plugged-7a41fc62-2272-4198-99cb-19d77d1dc193 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:58:38 user nova-compute[72444]: WARNING nova.compute.manager [req-459ecaed-fced-4e81-8c6a-0d240b1ee446 req-242c3759-1edc-43da-9db3-c01607536aa2 service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Received unexpected event network-vif-plugged-7a41fc62-2272-4198-99cb-19d77d1dc193 for instance with vm_state active and task_state None.
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.network.neutron [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Successfully updated port: 775b17bb-97a7-4a00-9368-198abafa4f8b {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Acquiring lock "refresh_cache-4f225dc2-3011-4c15-bb8e-1ebb079a3b50" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Acquired lock "refresh_cache-4f225dc2-3011-4c15-bb8e-1ebb079a3b50" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.network.neutron [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.compute.manager [req-b5292136-5400-468f-9a2b-6fa2b38a327c req-86043960-2bf0-4d03-b110-182e8ccb887b service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Received event network-changed-775b17bb-97a7-4a00-9368-198abafa4f8b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.compute.manager [req-b5292136-5400-468f-9a2b-6fa2b38a327c req-86043960-2bf0-4d03-b110-182e8ccb887b service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Refreshing instance network info cache due to event network-changed-775b17bb-97a7-4a00-9368-198abafa4f8b. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b5292136-5400-468f-9a2b-6fa2b38a327c req-86043960-2bf0-4d03-b110-182e8ccb887b service nova] Acquiring lock "refresh_cache-4f225dc2-3011-4c15-bb8e-1ebb079a3b50" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.network.neutron [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.network.neutron [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Updating instance_info_cache with network_info: [{"id": "775b17bb-97a7-4a00-9368-198abafa4f8b", "address": "fa:16:3e:65:c2:ad", "network": {"id": "dd246ddd-6ffb-4516-b262-ef339c3f195c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2067592626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac3f775464f48d88f05efdf3aeb4fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b17bb-97", "ovs_interfaceid": "775b17bb-97a7-4a00-9368-198abafa4f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Releasing lock "refresh_cache-4f225dc2-3011-4c15-bb8e-1ebb079a3b50" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.compute.manager [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Instance network_info: |[{"id": "775b17bb-97a7-4a00-9368-198abafa4f8b", "address": "fa:16:3e:65:c2:ad", "network": {"id": "dd246ddd-6ffb-4516-b262-ef339c3f195c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2067592626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac3f775464f48d88f05efdf3aeb4fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b17bb-97", "ovs_interfaceid": "775b17bb-97a7-4a00-9368-198abafa4f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b5292136-5400-468f-9a2b-6fa2b38a327c req-86043960-2bf0-4d03-b110-182e8ccb887b service nova] Acquired lock "refresh_cache-4f225dc2-3011-4c15-bb8e-1ebb079a3b50" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.network.neutron [req-b5292136-5400-468f-9a2b-6fa2b38a327c req-86043960-2bf0-4d03-b110-182e8ccb887b service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Refreshing network info cache for port 775b17bb-97a7-4a00-9368-198abafa4f8b {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Start _get_guest_xml network_info=[{"id": "775b17bb-97a7-4a00-9368-198abafa4f8b", "address": "fa:16:3e:65:c2:ad", "network": {"id": "dd246ddd-6ffb-4516-b262-ef339c3f195c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2067592626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac3f775464f48d88f05efdf3aeb4fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b17bb-97", "ovs_interfaceid": "775b17bb-97a7-4a00-9368-198abafa4f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:58:38 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:58:38 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:58:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1296432438',display_name='tempest-ServerActionsTestOtherB-server-1296432438',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1296432438',id=35,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJ2xwGpHSyejfRET9nle34ymsQ3JqEh+tuKb2KyDC9LlCqAQDSefnEuOykG9x3OwiAXCAIlmzscOwuKKHQpDe3RMRIrjD9v6y95AwIln0JKokDq03KE9SlxC2ULq7kCag==',key_name='tempest-keypair-1872408921',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ac3f775464f48d88f05efdf3aeb4fb8',ramdisk_id='',reservation_id='r-0ygb2937',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1191335247',owner_user_name='tempest-ServerActionsTestOtherB-1191335247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:58:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32aef58e87044e47b99cd37e300393aa',uuid=4f225dc2-3011-4c15-bb8e-1ebb079a3b50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "775b17bb-97a7-4a00-9368-198abafa4f8b", "address": "fa:16:3e:65:c2:ad", "network": {"id": "dd246ddd-6ffb-4516-b262-ef339c3f195c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2067592626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac3f775464f48d88f05efdf3aeb4fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b17bb-97", "ovs_interfaceid": "775b17bb-97a7-4a00-9368-198abafa4f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Converting VIF {"id": "775b17bb-97a7-4a00-9368-198abafa4f8b", "address": "fa:16:3e:65:c2:ad", "network": {"id": "dd246ddd-6ffb-4516-b262-ef339c3f195c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2067592626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac3f775464f48d88f05efdf3aeb4fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b17bb-97", "ovs_interfaceid": "775b17bb-97a7-4a00-9368-198abafa4f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:c2:ad,bridge_name='br-int',has_traffic_filtering=True,id=775b17bb-97a7-4a00-9368-198abafa4f8b,network=Network(dd246ddd-6ffb-4516-b262-ef339c3f195c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775b17bb-97') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.objects.instance [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f225dc2-3011-4c15-bb8e-1ebb079a3b50 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:58:38 user nova-compute[72444]:   <uuid>4f225dc2-3011-4c15-bb8e-1ebb079a3b50</uuid>
Aug 03 04:58:38 user nova-compute[72444]:   <name>instance-00000023</name>
Aug 03 04:58:38 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:58:38 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:58:38 user nova-compute[72444]:   <metadata>
Aug 03 04:58:38 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:58:38 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:58:38 user nova-compute[72444]:       <nova:name>tempest-ServerActionsTestOtherB-server-1296432438</nova:name>
Aug 03 04:58:38 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:58:38</nova:creationTime>
Aug 03 04:58:38 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:58:38 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:58:38 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:58:38 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:58:38 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:58:38 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:58:38 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:58:38 user nova-compute[72444]:       <nova:owner>
Aug 03 04:58:38 user nova-compute[72444]:         <nova:user uuid="32aef58e87044e47b99cd37e300393aa">tempest-ServerActionsTestOtherB-1191335247-project-member</nova:user>
Aug 03 04:58:38 user nova-compute[72444]:         <nova:project uuid="3ac3f775464f48d88f05efdf3aeb4fb8">tempest-ServerActionsTestOtherB-1191335247</nova:project>
Aug 03 04:58:38 user nova-compute[72444]:       </nova:owner>
Aug 03 04:58:38 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 04:58:38 user nova-compute[72444]:       <nova:ports>
Aug 03 04:58:38 user nova-compute[72444]:         <nova:port uuid="775b17bb-97a7-4a00-9368-198abafa4f8b">
Aug 03 04:58:38 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 03 04:58:38 user nova-compute[72444]:         </nova:port>
Aug 03 04:58:38 user nova-compute[72444]:       </nova:ports>
Aug 03 04:58:38 user nova-compute[72444]:     </nova:instance>
Aug 03 04:58:38 user nova-compute[72444]:   </metadata>
Aug 03 04:58:38 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:58:38 user nova-compute[72444]:     <system>
Aug 03 04:58:38 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:58:38 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:58:38 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:58:38 user nova-compute[72444]:       <entry name="serial">4f225dc2-3011-4c15-bb8e-1ebb079a3b50</entry>
Aug 03 04:58:38 user nova-compute[72444]:       <entry name="uuid">4f225dc2-3011-4c15-bb8e-1ebb079a3b50</entry>
Aug 03 04:58:38 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:58:38 user nova-compute[72444]:     </system>
Aug 03 04:58:38 user nova-compute[72444]:   </sysinfo>
Aug 03 04:58:38 user nova-compute[72444]:   <os>
Aug 03 04:58:38 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:58:38 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:58:38 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:58:38 user nova-compute[72444]:   </os>
Aug 03 04:58:38 user nova-compute[72444]:   <features>
Aug 03 04:58:38 user nova-compute[72444]:     <acpi/>
Aug 03 04:58:38 user nova-compute[72444]:     <apic/>
Aug 03 04:58:38 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:58:38 user nova-compute[72444]:   </features>
Aug 03 04:58:38 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:58:38 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:58:38 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:58:38 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:58:38 user nova-compute[72444]:   </clock>
Aug 03 04:58:38 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:58:38 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:58:38 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:58:38 user nova-compute[72444]:   </cpu>
Aug 03 04:58:38 user nova-compute[72444]:   <devices>
Aug 03 04:58:38 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:58:38 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:58:38 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk"/>
Aug 03 04:58:38 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:58:38 user nova-compute[72444]:     </disk>
Aug 03 04:58:38 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:58:38 user nova-compute[72444]:       <mac address="fa:16:3e:65:c2:ad"/>
Aug 03 04:58:38 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:58:38 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:58:38 user nova-compute[72444]:       <target dev="tap775b17bb-97"/>
Aug 03 04:58:38 user nova-compute[72444]:     </interface>
Aug 03 04:58:38 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:58:38 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/console.log" append="off"/>
Aug 03 04:58:38 user nova-compute[72444]:     </serial>
Aug 03 04:58:38 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:58:38 user nova-compute[72444]:     <video>
Aug 03 04:58:38 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:58:38 user nova-compute[72444]:     </video>
Aug 03 04:58:38 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:58:38 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:58:38 user nova-compute[72444]:     </rng>
Aug 03 04:58:38 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:58:38 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:58:38 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:58:38 user nova-compute[72444]:     </memballoon>
Aug 03 04:58:38 user nova-compute[72444]:   </devices>
Aug 03 04:58:38 user nova-compute[72444]: </domain>
Aug 03 04:58:38 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:58:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1296432438',display_name='tempest-ServerActionsTestOtherB-server-1296432438',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1296432438',id=35,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJ2xwGpHSyejfRET9nle34ymsQ3JqEh+tuKb2KyDC9LlCqAQDSefnEuOykG9x3OwiAXCAIlmzscOwuKKHQpDe3RMRIrjD9v6y95AwIln0JKokDq03KE9SlxC2ULq7kCag==',key_name='tempest-keypair-1872408921',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ac3f775464f48d88f05efdf3aeb4fb8',ramdisk_id='',reservation_id='r-0ygb2937',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1191335247',owner_user_name='tempest-ServerActionsTestOtherB-1191335247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:58:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32aef58e87044e47b99cd37e300393aa',uuid=4f225dc2-3011-4c15-bb8e-1ebb079a3b50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "775b17bb-97a7-4a00-9368-198abafa4f8b", "address": "fa:16:3e:65:c2:ad", "network": {"id": "dd246ddd-6ffb-4516-b262-ef339c3f195c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2067592626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac3f775464f48d88f05efdf3aeb4fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b17bb-97", "ovs_interfaceid": "775b17bb-97a7-4a00-9368-198abafa4f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Converting VIF {"id": "775b17bb-97a7-4a00-9368-198abafa4f8b", "address": "fa:16:3e:65:c2:ad", "network": {"id": "dd246ddd-6ffb-4516-b262-ef339c3f195c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2067592626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac3f775464f48d88f05efdf3aeb4fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b17bb-97", "ovs_interfaceid": "775b17bb-97a7-4a00-9368-198abafa4f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:c2:ad,bridge_name='br-int',has_traffic_filtering=True,id=775b17bb-97a7-4a00-9368-198abafa4f8b,network=Network(dd246ddd-6ffb-4516-b262-ef339c3f195c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775b17bb-97') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG os_vif [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:c2:ad,bridge_name='br-int',has_traffic_filtering=True,id=775b17bb-97a7-4a00-9368-198abafa4f8b,network=Network(dd246ddd-6ffb-4516-b262-ef339c3f195c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775b17bb-97') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap775b17bb-97, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap775b17bb-97, col_values=(('external_ids', {'iface-id': '775b17bb-97a7-4a00-9368-198abafa4f8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:c2:ad', 'vm-uuid': '4f225dc2-3011-4c15-bb8e-1ebb079a3b50'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:38 user nova-compute[72444]: INFO os_vif [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:c2:ad,bridge_name='br-int',has_traffic_filtering=True,id=775b17bb-97a7-4a00-9368-198abafa4f8b,network=Network(dd246ddd-6ffb-4516-b262-ef339c3f195c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775b17bb-97')
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:58:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] No VIF found with MAC fa:16:3e:65:c2:ad, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:58:39 user nova-compute[72444]: DEBUG nova.network.neutron [req-b5292136-5400-468f-9a2b-6fa2b38a327c req-86043960-2bf0-4d03-b110-182e8ccb887b service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Updated VIF entry in instance network info cache for port 775b17bb-97a7-4a00-9368-198abafa4f8b. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:58:39 user nova-compute[72444]: DEBUG nova.network.neutron [req-b5292136-5400-468f-9a2b-6fa2b38a327c req-86043960-2bf0-4d03-b110-182e8ccb887b service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Updating instance_info_cache with network_info: [{"id": "775b17bb-97a7-4a00-9368-198abafa4f8b", "address": "fa:16:3e:65:c2:ad", "network": {"id": "dd246ddd-6ffb-4516-b262-ef339c3f195c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2067592626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac3f775464f48d88f05efdf3aeb4fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b17bb-97", "ovs_interfaceid": "775b17bb-97a7-4a00-9368-198abafa4f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:58:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b5292136-5400-468f-9a2b-6fa2b38a327c req-86043960-2bf0-4d03-b110-182e8ccb887b service nova] Releasing lock "refresh_cache-4f225dc2-3011-4c15-bb8e-1ebb079a3b50" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:58:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:40 user nova-compute[72444]: DEBUG nova.compute.manager [req-a7160ede-57b6-4d79-8655-4765d6124b22 req-b474391a-cdf7-4128-8919-eeead05f69d5 service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Received event network-vif-plugged-775b17bb-97a7-4a00-9368-198abafa4f8b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:58:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a7160ede-57b6-4d79-8655-4765d6124b22 req-b474391a-cdf7-4128-8919-eeead05f69d5 service nova] Acquiring lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:58:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a7160ede-57b6-4d79-8655-4765d6124b22 req-b474391a-cdf7-4128-8919-eeead05f69d5 service nova] Lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:58:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a7160ede-57b6-4d79-8655-4765d6124b22 req-b474391a-cdf7-4128-8919-eeead05f69d5 service nova] Lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:58:40 user nova-compute[72444]: DEBUG nova.compute.manager [req-a7160ede-57b6-4d79-8655-4765d6124b22 req-b474391a-cdf7-4128-8919-eeead05f69d5 service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] No waiting events found dispatching network-vif-plugged-775b17bb-97a7-4a00-9368-198abafa4f8b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:58:40 user nova-compute[72444]: WARNING nova.compute.manager [req-a7160ede-57b6-4d79-8655-4765d6124b22 req-b474391a-cdf7-4128-8919-eeead05f69d5 service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Received unexpected event network-vif-plugged-775b17bb-97a7-4a00-9368-198abafa4f8b for instance with vm_state building and task_state spawning.
Aug 03 04:58:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c61c0fa1-57e4-43bb-a2cc-b1639b6ac313 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "0b219bf3-a3b6-44b5-946e-c10e7498e1d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:58:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c61c0fa1-57e4-43bb-a2cc-b1639b6ac313 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "0b219bf3-a3b6-44b5-946e-c10e7498e1d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:58:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c61c0fa1-57e4-43bb-a2cc-b1639b6ac313 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "0b219bf3-a3b6-44b5-946e-c10e7498e1d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:58:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c61c0fa1-57e4-43bb-a2cc-b1639b6ac313 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "0b219bf3-a3b6-44b5-946e-c10e7498e1d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:58:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c61c0fa1-57e4-43bb-a2cc-b1639b6ac313 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "0b219bf3-a3b6-44b5-946e-c10e7498e1d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:58:40 user nova-compute[72444]: INFO nova.compute.manager [None req-c61c0fa1-57e4-43bb-a2cc-b1639b6ac313 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Terminating instance
Aug 03 04:58:40 user nova-compute[72444]: DEBUG nova.compute.manager [None req-c61c0fa1-57e4-43bb-a2cc-b1639b6ac313 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 04:58:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:41 user nova-compute[72444]: DEBUG nova.compute.manager [req-f2a59879-b4a7-4c3c-92d4-f60048fb51d9 req-70b01e1f-53c8-47c4-8772-0a5b434efb3e service nova] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Received event network-vif-unplugged-5c810fce-bc56-4763-a65d-dbc53bf0c08a {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:58:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f2a59879-b4a7-4c3c-92d4-f60048fb51d9 req-70b01e1f-53c8-47c4-8772-0a5b434efb3e service nova] Acquiring lock "0b219bf3-a3b6-44b5-946e-c10e7498e1d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:58:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f2a59879-b4a7-4c3c-92d4-f60048fb51d9 req-70b01e1f-53c8-47c4-8772-0a5b434efb3e service nova] Lock "0b219bf3-a3b6-44b5-946e-c10e7498e1d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:58:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f2a59879-b4a7-4c3c-92d4-f60048fb51d9 req-70b01e1f-53c8-47c4-8772-0a5b434efb3e service nova] Lock "0b219bf3-a3b6-44b5-946e-c10e7498e1d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:58:41 user nova-compute[72444]: DEBUG nova.compute.manager [req-f2a59879-b4a7-4c3c-92d4-f60048fb51d9 req-70b01e1f-53c8-47c4-8772-0a5b434efb3e service nova] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] No waiting events found dispatching network-vif-unplugged-5c810fce-bc56-4763-a65d-dbc53bf0c08a {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:58:41 user nova-compute[72444]: DEBUG nova.compute.manager [req-f2a59879-b4a7-4c3c-92d4-f60048fb51d9 req-70b01e1f-53c8-47c4-8772-0a5b434efb3e service nova] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Received event network-vif-unplugged-5c810fce-bc56-4763-a65d-dbc53bf0c08a for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:58:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:41 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Instance destroyed successfully.
Aug 03 04:58:41 user nova-compute[72444]: DEBUG nova.objects.instance [None req-c61c0fa1-57e4-43bb-a2cc-b1639b6ac313 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lazy-loading 'resources' on Instance uuid 0b219bf3-a3b6-44b5-946e-c10e7498e1d3 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:58:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-c61c0fa1-57e4-43bb-a2cc-b1639b6ac313 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:49:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1040749505',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1040749505',id=23,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:49:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='929fd4a3127b475282426d4412e58def',ramdisk_id='',reservation_id='r-tovcwt35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1082770125',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:51:14Z,user_data=None,user_id='ceede92aa3a74060a7f57d29d0d97aee',uuid=0b219bf3-a3b6-44b5-946e-c10e7498e1d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c810fce-bc56-4763-a65d-dbc53bf0c08a", "address": "fa:16:3e:d6:a1:18", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c810fce-bc", "ovs_interfaceid": "5c810fce-bc56-4763-a65d-dbc53bf0c08a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:58:41 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-c61c0fa1-57e4-43bb-a2cc-b1639b6ac313 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Converting VIF {"id": "5c810fce-bc56-4763-a65d-dbc53bf0c08a", "address": "fa:16:3e:d6:a1:18", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c810fce-bc", "ovs_interfaceid": "5c810fce-bc56-4763-a65d-dbc53bf0c08a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:58:41 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-c61c0fa1-57e4-43bb-a2cc-b1639b6ac313 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:a1:18,bridge_name='br-int',has_traffic_filtering=True,id=5c810fce-bc56-4763-a65d-dbc53bf0c08a,network=Network(0e8b3ddd-e35a-45eb-a34c-614654c25549),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c810fce-bc') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:58:41 user nova-compute[72444]: DEBUG os_vif [None req-c61c0fa1-57e4-43bb-a2cc-b1639b6ac313 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:a1:18,bridge_name='br-int',has_traffic_filtering=True,id=5c810fce-bc56-4763-a65d-dbc53bf0c08a,network=Network(0e8b3ddd-e35a-45eb-a34c-614654c25549),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c810fce-bc') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:58:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c810fce-bc, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:58:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:58:41 user nova-compute[72444]: INFO os_vif [None req-c61c0fa1-57e4-43bb-a2cc-b1639b6ac313 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:a1:18,bridge_name='br-int',has_traffic_filtering=True,id=5c810fce-bc56-4763-a65d-dbc53bf0c08a,network=Network(0e8b3ddd-e35a-45eb-a34c-614654c25549),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c810fce-bc')
Aug 03 04:58:41 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-c61c0fa1-57e4-43bb-a2cc-b1639b6ac313 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Deleting instance files /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3_del
Aug 03 04:58:41 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-c61c0fa1-57e4-43bb-a2cc-b1639b6ac313 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Deletion of /opt/stack/data/nova/instances/0b219bf3-a3b6-44b5-946e-c10e7498e1d3_del complete
Aug 03 04:58:41 user nova-compute[72444]: INFO nova.compute.manager [None req-c61c0fa1-57e4-43bb-a2cc-b1639b6ac313 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 03 04:58:41 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-c61c0fa1-57e4-43bb-a2cc-b1639b6ac313 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 04:58:41 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 04:58:41 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 04:58:42 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:58:42 user nova-compute[72444]: DEBUG nova.compute.manager [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:58:42 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 04:58:42 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038722.4842887, 4f225dc2-3011-4c15-bb8e-1ebb079a3b50 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:58:42 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] VM Resumed (Lifecycle Event)
Aug 03 04:58:42 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Took 0.86 seconds to deallocate network for instance.
Aug 03 04:58:42 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Instance spawned successfully.
Aug 03 04:58:42 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 04:58:42 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:58:42 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:58:42 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:58:42 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:58:42 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:58:42 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:58:42 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:58:42 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 04:58:42 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:58:42 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038722.485655, 4f225dc2-3011-4c15-bb8e-1ebb079a3b50 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:58:42 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] VM Started (Lifecycle Event)
Aug 03 04:58:42 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:58:42 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:58:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c61c0fa1-57e4-43bb-a2cc-b1639b6ac313 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:58:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c61c0fa1-57e4-43bb-a2cc-b1639b6ac313 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:58:42 user nova-compute[72444]: DEBUG nova.compute.manager [req-e2781e64-7cec-46ff-87d4-63f8bd56a5c6 req-793280c0-d248-45ea-8f19-b77d0552edcb service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Received event network-vif-plugged-775b17bb-97a7-4a00-9368-198abafa4f8b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:58:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e2781e64-7cec-46ff-87d4-63f8bd56a5c6 req-793280c0-d248-45ea-8f19-b77d0552edcb service nova] Acquiring lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:58:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e2781e64-7cec-46ff-87d4-63f8bd56a5c6 req-793280c0-d248-45ea-8f19-b77d0552edcb service nova] Lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:58:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e2781e64-7cec-46ff-87d4-63f8bd56a5c6 req-793280c0-d248-45ea-8f19-b77d0552edcb service nova] Lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:58:42 user nova-compute[72444]: DEBUG nova.compute.manager [req-e2781e64-7cec-46ff-87d4-63f8bd56a5c6 req-793280c0-d248-45ea-8f19-b77d0552edcb service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] No waiting events found dispatching network-vif-plugged-775b17bb-97a7-4a00-9368-198abafa4f8b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:58:42 user nova-compute[72444]: WARNING nova.compute.manager [req-e2781e64-7cec-46ff-87d4-63f8bd56a5c6 req-793280c0-d248-45ea-8f19-b77d0552edcb service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Received unexpected event network-vif-plugged-775b17bb-97a7-4a00-9368-198abafa4f8b for instance with vm_state building and task_state spawning.
Aug 03 04:58:42 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 04:58:42 user nova-compute[72444]: INFO nova.compute.manager [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Took 5.99 seconds to spawn the instance on the hypervisor.
Aug 03 04:58:42 user nova-compute[72444]: DEBUG nova.compute.manager [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:58:42 user nova-compute[72444]: INFO nova.compute.manager [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Took 6.76 seconds to build instance.
Aug 03 04:58:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2a43b7c3-0781-4e29-ad15-601e839b515b tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.883s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:58:42 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-c61c0fa1-57e4-43bb-a2cc-b1639b6ac313 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:58:42 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-c61c0fa1-57e4-43bb-a2cc-b1639b6ac313 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:58:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c61c0fa1-57e4-43bb-a2cc-b1639b6ac313 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.369s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:58:43 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-c61c0fa1-57e4-43bb-a2cc-b1639b6ac313 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Deleted allocations for instance 0b219bf3-a3b6-44b5-946e-c10e7498e1d3
Aug 03 04:58:43 user nova-compute[72444]: DEBUG nova.compute.manager [req-5d311a78-b708-4b35-8961-d07f53fde250 req-6b8b1f81-69a8-432e-b07f-767bd913371e service nova] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Received event network-vif-plugged-5c810fce-bc56-4763-a65d-dbc53bf0c08a {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:58:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5d311a78-b708-4b35-8961-d07f53fde250 req-6b8b1f81-69a8-432e-b07f-767bd913371e service nova] Acquiring lock "0b219bf3-a3b6-44b5-946e-c10e7498e1d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:58:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5d311a78-b708-4b35-8961-d07f53fde250 req-6b8b1f81-69a8-432e-b07f-767bd913371e service nova] Lock "0b219bf3-a3b6-44b5-946e-c10e7498e1d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:58:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5d311a78-b708-4b35-8961-d07f53fde250 req-6b8b1f81-69a8-432e-b07f-767bd913371e service nova] Lock "0b219bf3-a3b6-44b5-946e-c10e7498e1d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:58:43 user nova-compute[72444]: DEBUG nova.compute.manager [req-5d311a78-b708-4b35-8961-d07f53fde250 req-6b8b1f81-69a8-432e-b07f-767bd913371e service nova] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] No waiting events found dispatching network-vif-plugged-5c810fce-bc56-4763-a65d-dbc53bf0c08a {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:58:43 user nova-compute[72444]: WARNING nova.compute.manager [req-5d311a78-b708-4b35-8961-d07f53fde250 req-6b8b1f81-69a8-432e-b07f-767bd913371e service nova] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Received unexpected event network-vif-plugged-5c810fce-bc56-4763-a65d-dbc53bf0c08a for instance with vm_state deleted and task_state None.
Aug 03 04:58:43 user nova-compute[72444]: DEBUG nova.compute.manager [req-5d311a78-b708-4b35-8961-d07f53fde250 req-6b8b1f81-69a8-432e-b07f-767bd913371e service nova] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Received event network-vif-deleted-5c810fce-bc56-4763-a65d-dbc53bf0c08a {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:58:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c61c0fa1-57e4-43bb-a2cc-b1639b6ac313 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "0b219bf3-a3b6-44b5-946e-c10e7498e1d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.395s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:58:44 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquiring lock "a9b960cb-39bd-4f31-9920-5ce31d5db139" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:58:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "a9b960cb-39bd-4f31-9920-5ce31d5db139" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:58:45 user nova-compute[72444]: DEBUG nova.objects.instance [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lazy-loading 'flavor' on Instance uuid a9b960cb-39bd-4f31-9920-5ce31d5db139 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:58:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "a9b960cb-39bd-4f31-9920-5ce31d5db139" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:58:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquiring lock "a9b960cb-39bd-4f31-9920-5ce31d5db139" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:58:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "a9b960cb-39bd-4f31-9920-5ce31d5db139" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:58:45 user nova-compute[72444]: INFO nova.compute.manager [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Attaching volume 90b0eca8-17a6-484f-962f-1882bf94e80f to /dev/vdb
Aug 03 04:58:45 user nova-compute[72444]: DEBUG os_brick.utils [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:58:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:45 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7579c9fb-f9c3-4a41-8cd7-c5b2790a47c5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:45 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf0c109-129a-4e58-8e9b-11bdaff60028]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:45 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0069063-8eb5-4272-95bd-a846f30d2cb1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:45 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e0c67f-cdb3-4821-9b79-feadff631544]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:58:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 04:58:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:58:46 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 04:58:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c12313f-6b8c-42ec-bff0-4c796486208b]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 04:58:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 04:58:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 04:58:46 user nova-compute[72444]: DEBUG os_brick.utils [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:58:46 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Updating existing volume attachment record: 99754e41-9e68-4acf-a435-27173697ddef {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 04:58:46 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:46 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:49 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:58:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:52 user nova-compute[72444]: DEBUG nova.compute.manager [req-4f9a6b18-6387-47c7-8864-1f296cceffb7 req-58b1ce24-e254-4805-8b8c-be2d78069ac5 service nova] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Received event network-changed-97c29a7f-61e6-47c1-8eef-579f3c615e98 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:58:52 user nova-compute[72444]: DEBUG nova.compute.manager [req-4f9a6b18-6387-47c7-8864-1f296cceffb7 req-58b1ce24-e254-4805-8b8c-be2d78069ac5 service nova] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Refreshing instance network info cache due to event network-changed-97c29a7f-61e6-47c1-8eef-579f3c615e98. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:58:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4f9a6b18-6387-47c7-8864-1f296cceffb7 req-58b1ce24-e254-4805-8b8c-be2d78069ac5 service nova] Acquiring lock "refresh_cache-df31afec-a5b7-4b2a-a062-f489429c6fef" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:58:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4f9a6b18-6387-47c7-8864-1f296cceffb7 req-58b1ce24-e254-4805-8b8c-be2d78069ac5 service nova] Acquired lock "refresh_cache-df31afec-a5b7-4b2a-a062-f489429c6fef" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:58:52 user nova-compute[72444]: DEBUG nova.network.neutron [req-4f9a6b18-6387-47c7-8864-1f296cceffb7 req-58b1ce24-e254-4805-8b8c-be2d78069ac5 service nova] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Refreshing network info cache for port 97c29a7f-61e6-47c1-8eef-579f3c615e98 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:58:52 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:58:52 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 04:58:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Acquiring lock "df31afec-a5b7-4b2a-a062-f489429c6fef" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:58:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "df31afec-a5b7-4b2a-a062-f489429c6fef" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:58:52 user nova-compute[72444]: DEBUG nova.objects.instance [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lazy-loading 'flavor' on Instance uuid df31afec-a5b7-4b2a-a062-f489429c6fef {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:58:52 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Ignoring supplied device name: /dev/vdb
Aug 03 04:58:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "df31afec-a5b7-4b2a-a062-f489429c6fef" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:58:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Acquiring lock "df31afec-a5b7-4b2a-a062-f489429c6fef" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:58:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "df31afec-a5b7-4b2a-a062-f489429c6fef" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:58:53 user nova-compute[72444]: INFO nova.compute.manager [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Attaching volume ae102c75-de71-46e8-bb77-bcc04f42c08f to /dev/vdb
Aug 03 04:58:53 user nova-compute[72444]: DEBUG nova.network.neutron [req-4f9a6b18-6387-47c7-8864-1f296cceffb7 req-58b1ce24-e254-4805-8b8c-be2d78069ac5 service nova] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Updated VIF entry in instance network info cache for port 97c29a7f-61e6-47c1-8eef-579f3c615e98. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:58:53 user nova-compute[72444]: DEBUG nova.network.neutron [req-4f9a6b18-6387-47c7-8864-1f296cceffb7 req-58b1ce24-e254-4805-8b8c-be2d78069ac5 service nova] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Updating instance_info_cache with network_info: [{"id": "97c29a7f-61e6-47c1-8eef-579f3c615e98", "address": "fa:16:3e:aa:d9:50", "network": {"id": "81d682a4-018d-4927-866c-2b16d48f16e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-921368252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff54227e82764df6abd50b83068c64de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c29a7f-61", "ovs_interfaceid": "97c29a7f-61e6-47c1-8eef-579f3c615e98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:58:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4f9a6b18-6387-47c7-8864-1f296cceffb7 req-58b1ce24-e254-4805-8b8c-be2d78069ac5 service nova] Releasing lock "refresh_cache-df31afec-a5b7-4b2a-a062-f489429c6fef" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:58:53 user nova-compute[72444]: DEBUG os_brick.utils [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:58:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda045e6-8826-4fef-8289-8f427c22fca8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdc6ddf-210a-4b19-b2e6-ea33aa3d517c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8036a7d-1e09-40fa-b171-a53361f432b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b9fdf7-1f97-410c-982f-e40b646fd5c8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:58:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 04:58:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 04:58:53 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 04:58:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a844987-a74c-4f0e-beff-fd44c66fba60]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 04:58:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 04:58:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 04:58:53 user nova-compute[72444]: DEBUG os_brick.utils [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:58:53 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Updating existing volume attachment record: 011d6718-46b8-4893-a021-30c8f31682b6 {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AaOVwGqF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:58:54 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:58:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:58:54 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:58:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:58:54 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:58:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd64784-864b-420a-b752-ef91e094b597]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 04:58:54 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b58201-a4e1-4d49-a9b2-3a0618c68ae7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f] added
Aug 03 04:58:54 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdd468a-1975-42e8-829b-a63822740bca]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09b55bf-f63d-4e8b-bc1a-a9635eae038f]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AaOVwGqF {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AaOVwGqF" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8786d8ea-4f5c-44b0-8b40-797701e09467]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AaOVwGqF'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f04e929-2d74-4407-98af-c4d95dec0b33]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cae097a-331b-40e4-bec4-d9b83623fc07]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 (non-flash)
Aug 03 04:58:54 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:58:54 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 (non-flash)
Aug 03 04:58:54 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:58:54 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[671f71b8-5ea2-47af-a24b-5c9062650af2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f, portal: 172.16.0.220,3260]
Aug 03 04:58:54 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f, portal: 172.16.0.220,3260] successful.
Aug 03 04:58:54 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[defe0bf8-ca91-4f5c-a9cb-fa6de435d00e]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[03681367-7bc8-4d8f-b59b-c2567695eb9a]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 (non-flash)
Aug 03 04:58:54 user nova-compute[72444]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f (non-flash)
Aug 03 04:58:54 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:58:54 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 (non-flash)
Aug 03 04:58:54 user nova-compute[72444]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f (non-flash)
Aug 03 04:58:54 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:58:54 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d619b30e-e409-4557-93ab-85400de433e9]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AaOVwGqF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:58:54 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:58:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:55 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:58:55 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '26631313034376632', 'path': '/dev/sdc'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:58:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631313034376632', 'path': '/dev/sdc'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:58:55 user nova-compute[72444]: DEBUG nova.objects.instance [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lazy-loading 'flavor' on Instance uuid a9b960cb-39bd-4f31-9920-5ce31d5db139 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:58:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 04:58:55 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:58:55 user nova-compute[72444]:   <source dev="/dev/sdc"/>
Aug 03 04:58:55 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:58:55 user nova-compute[72444]:   <serial>90b0eca8-17a6-484f-962f-1882bf94e80f</serial>
Aug 03 04:58:55 user nova-compute[72444]: </disk>
Aug 03 04:58:55 user nova-compute[72444]:  {{(pid=72444) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 04:58:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:58:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:58:55 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] No VIF found with MAC fa:16:3e:b5:15:1e, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:58:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2bc26692-448e-4f38-b7b8-5e303b6b1a9a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "a9b960cb-39bd-4f31-9920-5ce31d5db139" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.530s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:58:56 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691038721.5078049, 0b219bf3-a3b6-44b5-946e-c10e7498e1d3 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:58:56 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] VM Stopped (Lifecycle Event)
Aug 03 04:58:56 user nova-compute[72444]: DEBUG nova.compute.manager [None req-47d56173-b913-4825-b825-ca895b0f07c9 None None] [instance: 0b219bf3-a3b6-44b5-946e-c10e7498e1d3] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:58:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:57 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:58:57 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:58:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:58:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:58:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:58:57 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 04:58:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df31afec-a5b7-4b2a-a062-f489429c6fef/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df31afec-a5b7-4b2a-a062-f489429c6fef/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df31afec-a5b7-4b2a-a062-f489429c6fef/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df31afec-a5b7-4b2a-a062-f489429c6fef/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:58:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:58:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:58:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87667868-78ed-4d9f-aff0-b6f0eda241bd/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87667868-78ed-4d9f-aff0-b6f0eda241bd/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87667868-78ed-4d9f-aff0-b6f0eda241bd/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87667868-78ed-4d9f-aff0-b6f0eda241bd/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:58:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:58:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:00 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:59:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:00 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:59:00 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:59:00 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=7673MB free_disk=25.122676849365234GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 04:59:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:59:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 81725845-6158-4e34-bedb-6e41219bc227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance ae41789a-ebd1-4265-a903-32d2006e66d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 87667868-78ed-4d9f-aff0-b6f0eda241bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance a9b960cb-39bd-4f31-9920-5ce31d5db139 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance df31afec-a5b7-4b2a-a062-f489429c6fef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 4f225dc2-3011-4c15-bb8e-1ebb079a3b50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.478s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYfvEVwR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:59:01 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:59:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:59:01 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:59:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:59:01 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:59:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b651f3eb-fb5d-4a36-b8e9-a709bc47cf6f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 04:59:01 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0270c540-edae-4e5a-b192-590e1095570c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f] added
Aug 03 04:59:01 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a45f6c4-255c-4b5b-b9c0-b2efd1b8b8ef]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2b46d2-e65f-497d-a5d5-e42175d35b3d]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UYfvEVwR {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UYfvEVwR" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fdf6d69-6ca1-4da6-b8f4-69de17cf5340]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UYfvEVwR'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b64bd49-d8e4-47e4-9acb-f5541f0f76f7]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7833b284-e6b0-46e4-966a-0d81e7a43de6]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 (non-flash)
Aug 03 04:59:01 user nova-compute[72444]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f (non-flash)
Aug 03 04:59:01 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:59:01 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 (non-flash)
Aug 03 04:59:01 user nova-compute[72444]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f (non-flash)
Aug 03 04:59:01 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:59:01 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:59:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:02 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0983183-458e-4af0-b2ad-9318720c452d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:02 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f, portal: 172.16.0.220,3260]
Aug 03 04:59:02 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f, portal: 172.16.0.220,3260] successful.
Aug 03 04:59:02 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:59:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:02 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fc3424-8807-44a4-95a5-f27e5ab9367b]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:02 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:59:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:02 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a592b93e-7214-4c86-a900-d90810dbb858]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:02 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 (non-flash)
Aug 03 04:59:02 user nova-compute[72444]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f (non-flash)
Aug 03 04:59:02 user nova-compute[72444]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f (non-flash)
Aug 03 04:59:02 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:59:02 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:59:02 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 (non-flash)
Aug 03 04:59:02 user nova-compute[72444]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f (non-flash)
Aug 03 04:59:02 user nova-compute[72444]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f (non-flash)
Aug 03 04:59:02 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:59:02 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:59:02 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:59:02 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:59:02 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:59:02 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:59:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:02 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ab9009-1f65-4245-a4db-99efd14b03fb]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:02 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:59:02 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYfvEVwR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:59:02 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:59:02 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:59:02 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:59:02 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 04:59:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:59:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:59:02 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 04:59:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:59:03 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '26338656564353764', 'path': '/dev/sdd'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:59:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338656564353764', 'path': '/dev/sdd'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:59:03 user nova-compute[72444]: DEBUG nova.objects.instance [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lazy-loading 'flavor' on Instance uuid df31afec-a5b7-4b2a-a062-f489429c6fef {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:59:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 04:59:03 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:59:03 user nova-compute[72444]:   <source dev="/dev/sdd"/>
Aug 03 04:59:03 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:59:03 user nova-compute[72444]:   <serial>ae102c75-de71-46e8-bb77-bcc04f42c08f</serial>
Aug 03 04:59:03 user nova-compute[72444]: </disk>
Aug 03 04:59:03 user nova-compute[72444]:  {{(pid=72444) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 04:59:03 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Updating instance_info_cache with network_info: [{"id": "c14e16af-c17e-4152-a400-cbb8fb4f41fa", "address": "fa:16:3e:05:10:6a", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14e16af-c1", "ovs_interfaceid": "c14e16af-c17e-4152-a400-cbb8fb4f41fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:59:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:59:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 04:59:03 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:59:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:59:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 04:59:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] No VIF found with MAC fa:16:3e:aa:d9:50, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 04:59:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-66ec53d9-4927-4377-ae92-0e804bdf1ff4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "df31afec-a5b7-4b2a-a062-f489429c6fef" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.606s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:59:04 user nova-compute[72444]: DEBUG nova.compute.manager [req-3bc75ff3-b73b-43da-86b8-2783194267a9 req-b1cfe16d-2464-4bf1-90a7-2d8c775cf306 service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Received event network-changed-68a682f5-6dbc-4c9b-ab56-b91c8cb93810 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:59:04 user nova-compute[72444]: DEBUG nova.compute.manager [req-3bc75ff3-b73b-43da-86b8-2783194267a9 req-b1cfe16d-2464-4bf1-90a7-2d8c775cf306 service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Refreshing instance network info cache due to event network-changed-68a682f5-6dbc-4c9b-ab56-b91c8cb93810. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:59:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3bc75ff3-b73b-43da-86b8-2783194267a9 req-b1cfe16d-2464-4bf1-90a7-2d8c775cf306 service nova] Acquiring lock "refresh_cache-a9b960cb-39bd-4f31-9920-5ce31d5db139" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:59:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3bc75ff3-b73b-43da-86b8-2783194267a9 req-b1cfe16d-2464-4bf1-90a7-2d8c775cf306 service nova] Acquired lock "refresh_cache-a9b960cb-39bd-4f31-9920-5ce31d5db139" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:59:04 user nova-compute[72444]: DEBUG nova.network.neutron [req-3bc75ff3-b73b-43da-86b8-2783194267a9 req-b1cfe16d-2464-4bf1-90a7-2d8c775cf306 service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Refreshing network info cache for port 68a682f5-6dbc-4c9b-ab56-b91c8cb93810 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:59:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:05 user nova-compute[72444]: DEBUG nova.network.neutron [req-3bc75ff3-b73b-43da-86b8-2783194267a9 req-b1cfe16d-2464-4bf1-90a7-2d8c775cf306 service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Updated VIF entry in instance network info cache for port 68a682f5-6dbc-4c9b-ab56-b91c8cb93810. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:59:05 user nova-compute[72444]: DEBUG nova.network.neutron [req-3bc75ff3-b73b-43da-86b8-2783194267a9 req-b1cfe16d-2464-4bf1-90a7-2d8c775cf306 service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Updating instance_info_cache with network_info: [{"id": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "address": "fa:16:3e:b5:15:1e", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a682f5-6d", "ovs_interfaceid": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:59:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3bc75ff3-b73b-43da-86b8-2783194267a9 req-b1cfe16d-2464-4bf1-90a7-2d8c775cf306 service nova] Releasing lock "refresh_cache-a9b960cb-39bd-4f31-9920-5ce31d5db139" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:59:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-bdc55e9f-8b27-486d-885a-15769a4543dd tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Acquiring lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:59:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-bdc55e9f-8b27-486d-885a-15769a4543dd tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:59:06 user nova-compute[72444]: INFO nova.compute.manager [None req-bdc55e9f-8b27-486d-885a-15769a4543dd tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Detaching volume 5b877794-f7ef-40e2-80a9-f39ea90c2378
Aug 03 04:59:06 user nova-compute[72444]: INFO nova.virt.block_device [None req-bdc55e9f-8b27-486d-885a-15769a4543dd tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Attempting to driver detach volume 5b877794-f7ef-40e2-80a9-f39ea90c2378 from mountpoint /dev/vdb
Aug 03 04:59:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-bdc55e9f-8b27-486d-885a-15769a4543dd tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Attempting to detach device vdb from instance 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0 from the persistent domain config. {{(pid=72444) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 04:59:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-bdc55e9f-8b27-486d-885a-15769a4543dd tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 04:59:06 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:59:06 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 04:59:06 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:59:06 user nova-compute[72444]:   <serial>5b877794-f7ef-40e2-80a9-f39ea90c2378</serial>
Aug 03 04:59:06 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 04:59:06 user nova-compute[72444]: </disk>
Aug 03 04:59:06 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:59:06 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-bdc55e9f-8b27-486d-885a-15769a4543dd tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Successfully detached device vdb from instance 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0 from the persistent domain config.
Aug 03 04:59:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-bdc55e9f-8b27-486d-885a-15769a4543dd tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0 from the live domain config. {{(pid=72444) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 04:59:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-bdc55e9f-8b27-486d-885a-15769a4543dd tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 04:59:06 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:59:06 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 04:59:06 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:59:06 user nova-compute[72444]:   <serial>5b877794-f7ef-40e2-80a9-f39ea90c2378</serial>
Aug 03 04:59:06 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 04:59:06 user nova-compute[72444]: </disk>
Aug 03 04:59:06 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Received event <DeviceRemovedEvent: 1691038747.1945865, 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72444) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-bdc55e9f-8b27-486d-885a-15769a4543dd tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0 {{(pid=72444) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 04:59:07 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-bdc55e9f-8b27-486d-885a-15769a4543dd tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Successfully detached device vdb from instance 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0 from the live domain config.
Aug 03 04:59:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdc55e9f-8b27-486d-885a-15769a4543dd tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdc55e9f-8b27-486d-885a-15769a4543dd tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YWKVPqzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:59:07 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-bdc55e9f-8b27-486d-885a-15769a4543dd tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:59:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-bdc55e9f-8b27-486d-885a-15769a4543dd tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-bdc55e9f-8b27-486d-885a-15769a4543dd tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdc55e9f-8b27-486d-885a-15769a4543dd tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4169210-4254-40fb-b252-cb9d439bd8d0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[deaa655a-564e-4d42-8e56-949361993f4f]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdc55e9f-8b27-486d-885a-15769a4543dd tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 (non-flash)
Aug 03 04:59:07 user nova-compute[72444]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f (non-flash)
Aug 03 04:59:07 user nova-compute[72444]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f (non-flash)
Aug 03 04:59:07 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:59:07 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdc55e9f-8b27-486d-885a-15769a4543dd tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 (non-flash)
Aug 03 04:59:07 user nova-compute[72444]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f (non-flash)
Aug 03 04:59:07 user nova-compute[72444]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f (non-flash)
Aug 03 04:59:07 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:59:07 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdc55e9f-8b27-486d-885a-15769a4543dd tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308c35eef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378'): ({'sdb'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-bdc55e9f-8b27-486d-885a-15769a4543dd tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Removing single pathed devices sdb {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d07af6-f2e3-4fca-a0a4-cc42ab88a898]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4bd02f-e710-4dd6-911e-e015a1cdd324]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-bdc55e9f-8b27-486d-885a-15769a4543dd tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Flushing IO for device /dev/sdb {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[266b663a-952c-4efe-b428-2e421b37cb7d]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-bdc55e9f-8b27-486d-885a-15769a4543dd tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.063s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb49c9a-1e48-45a0-88a5-9d0af97a18fe]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-bdc55e9f-8b27-486d-885a-15769a4543dd tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-bdc55e9f-8b27-486d-885a-15769a4543dd tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdc55e9f-8b27-486d-885a-15769a4543dd tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b5c795-57d2-415c-8600-79db8b64f599]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdc55e9f-8b27-486d-885a-15769a4543dd tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[841e168c-5c71-4293-ba97-6fd2619ebf6b]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdc55e9f-8b27-486d-885a-15769a4543dd tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378, portal: 172.16.0.220,3260]
Aug 03 04:59:07 user nova-compute[72444]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378, portal: 172.16.0.220,3260] successful.
Aug 03 04:59:07 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b877794-f7ef-40e2-80a9-f39ea90c2378 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b73fa5d-ffc3-4ccc-95e1-016e4475536e]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdc55e9f-8b27-486d-885a-15769a4543dd tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-bdc55e9f-8b27-486d-885a-15769a4543dd tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdc55e9f-8b27-486d-885a-15769a4543dd tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] <== disconnect_volume: return (324ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdc55e9f-8b27-486d-885a-15769a4543dd tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG nova.compute.manager [req-218063bb-ab03-4de0-897b-ba259d33179c req-467ca546-5c3d-4144-915b-6642266fa52a service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Received event network-changed-68a682f5-6dbc-4c9b-ab56-b91c8cb93810 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG nova.compute.manager [req-218063bb-ab03-4de0-897b-ba259d33179c req-467ca546-5c3d-4144-915b-6642266fa52a service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Refreshing instance network info cache due to event network-changed-68a682f5-6dbc-4c9b-ab56-b91c8cb93810. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-218063bb-ab03-4de0-897b-ba259d33179c req-467ca546-5c3d-4144-915b-6642266fa52a service nova] Acquiring lock "refresh_cache-a9b960cb-39bd-4f31-9920-5ce31d5db139" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-218063bb-ab03-4de0-897b-ba259d33179c req-467ca546-5c3d-4144-915b-6642266fa52a service nova] Acquired lock "refresh_cache-a9b960cb-39bd-4f31-9920-5ce31d5db139" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:59:07 user nova-compute[72444]: DEBUG nova.network.neutron [req-218063bb-ab03-4de0-897b-ba259d33179c req-467ca546-5c3d-4144-915b-6642266fa52a service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Refreshing network info cache for port 68a682f5-6dbc-4c9b-ab56-b91c8cb93810 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:59:08 user nova-compute[72444]: DEBUG nova.network.neutron [req-218063bb-ab03-4de0-897b-ba259d33179c req-467ca546-5c3d-4144-915b-6642266fa52a service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Updated VIF entry in instance network info cache for port 68a682f5-6dbc-4c9b-ab56-b91c8cb93810. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:59:08 user nova-compute[72444]: DEBUG nova.network.neutron [req-218063bb-ab03-4de0-897b-ba259d33179c req-467ca546-5c3d-4144-915b-6642266fa52a service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Updating instance_info_cache with network_info: [{"id": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "address": "fa:16:3e:b5:15:1e", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a682f5-6d", "ovs_interfaceid": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:59:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-218063bb-ab03-4de0-897b-ba259d33179c req-467ca546-5c3d-4144-915b-6642266fa52a service nova] Releasing lock "refresh_cache-a9b960cb-39bd-4f31-9920-5ce31d5db139" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:59:09 user nova-compute[72444]: DEBUG nova.compute.manager [req-08923f72-6d25-4f73-af19-0661cc03935c req-1f2f4356-ea0e-48f6-b40e-9aec49dc455c service nova] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Received event network-changed-e6e423a5-90cd-466a-9a6f-6b99812426ee {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:59:09 user nova-compute[72444]: DEBUG nova.compute.manager [req-08923f72-6d25-4f73-af19-0661cc03935c req-1f2f4356-ea0e-48f6-b40e-9aec49dc455c service nova] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Refreshing instance network info cache due to event network-changed-e6e423a5-90cd-466a-9a6f-6b99812426ee. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 04:59:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-08923f72-6d25-4f73-af19-0661cc03935c req-1f2f4356-ea0e-48f6-b40e-9aec49dc455c service nova] Acquiring lock "refresh_cache-87667868-78ed-4d9f-aff0-b6f0eda241bd" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:59:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-08923f72-6d25-4f73-af19-0661cc03935c req-1f2f4356-ea0e-48f6-b40e-9aec49dc455c service nova] Acquired lock "refresh_cache-87667868-78ed-4d9f-aff0-b6f0eda241bd" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:59:09 user nova-compute[72444]: DEBUG nova.network.neutron [req-08923f72-6d25-4f73-af19-0661cc03935c req-1f2f4356-ea0e-48f6-b40e-9aec49dc455c service nova] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Refreshing network info cache for port e6e423a5-90cd-466a-9a6f-6b99812426ee {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 04:59:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-89782e37-3396-4873-839c-dc2a15a25192 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Acquiring lock "87667868-78ed-4d9f-aff0-b6f0eda241bd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:59:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-89782e37-3396-4873-839c-dc2a15a25192 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "87667868-78ed-4d9f-aff0-b6f0eda241bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:59:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-89782e37-3396-4873-839c-dc2a15a25192 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Acquiring lock "87667868-78ed-4d9f-aff0-b6f0eda241bd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:59:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-89782e37-3396-4873-839c-dc2a15a25192 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "87667868-78ed-4d9f-aff0-b6f0eda241bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:59:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-89782e37-3396-4873-839c-dc2a15a25192 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "87667868-78ed-4d9f-aff0-b6f0eda241bd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:59:09 user nova-compute[72444]: INFO nova.compute.manager [None req-89782e37-3396-4873-839c-dc2a15a25192 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Terminating instance
Aug 03 04:59:09 user nova-compute[72444]: DEBUG nova.compute.manager [None req-89782e37-3396-4873-839c-dc2a15a25192 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 04:59:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:09 user nova-compute[72444]: DEBUG nova.network.neutron [req-08923f72-6d25-4f73-af19-0661cc03935c req-1f2f4356-ea0e-48f6-b40e-9aec49dc455c service nova] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Updated VIF entry in instance network info cache for port e6e423a5-90cd-466a-9a6f-6b99812426ee. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 04:59:09 user nova-compute[72444]: DEBUG nova.network.neutron [req-08923f72-6d25-4f73-af19-0661cc03935c req-1f2f4356-ea0e-48f6-b40e-9aec49dc455c service nova] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Updating instance_info_cache with network_info: [{"id": "e6e423a5-90cd-466a-9a6f-6b99812426ee", "address": "fa:16:3e:98:7f:e7", "network": {"id": "bb35bc76-087b-4468-ba0c-3637873207f8", "bridge": "br-int", "label": "tempest-TestStampPattern-620416114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d114efe1dfc1424299621df67bf00863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e423a5-90", "ovs_interfaceid": "e6e423a5-90cd-466a-9a6f-6b99812426ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:59:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-08923f72-6d25-4f73-af19-0661cc03935c req-1f2f4356-ea0e-48f6-b40e-9aec49dc455c service nova] Releasing lock "refresh_cache-87667868-78ed-4d9f-aff0-b6f0eda241bd" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:59:10 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Instance destroyed successfully.
Aug 03 04:59:10 user nova-compute[72444]: DEBUG nova.objects.instance [None req-89782e37-3396-4873-839c-dc2a15a25192 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lazy-loading 'resources' on Instance uuid 87667868-78ed-4d9f-aff0-b6f0eda241bd {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:59:10 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-89782e37-3396-4873-839c-dc2a15a25192 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:56:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-481630748',display_name='tempest-TestStampPattern-server-481630748',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-481630748',id=32,image_ref='bf5603b1-3e6f-4a73-a2d8-b0f2e741a9f1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0MFXjSU5PJXVROOnqeclCBxvU1Uyrwrp4WGd6L7LODOpU9OooUOpH73m523qz3COWVGWjrJJsa98O/ExJkhRZGY7wvCQTS/3+V2FidnkreOl/H1zHbvv0lhsewf7GMag==',key_name='tempest-TestStampPattern-164301022',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:56:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d114efe1dfc1424299621df67bf00863',ramdisk_id='',reservation_id='r-zsj6200c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='ae41789a-ebd1-4265-a903-32d2006e66d1',image_min_disk='1',image_min_ram='0',image_owner_id='d114efe1dfc1424299621df67bf00863',image_owner_project_name='tempest-TestStampPattern-786118238',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-786118238-project-member',image_user_id='cfb2412d135d4e45b5b1c2edf63a560c',owner_project_name='tempest-TestStampPattern-786118238',owner_user_name='tempest-TestStampPattern-786118238-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:56:22Z,user_data=None,user_id='cfb2412d135d4e45b5b1c2edf63a560c',uuid=87667868-78ed-4d9f-aff0-b6f0eda241bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6e423a5-90cd-466a-9a6f-6b99812426ee", "address": "fa:16:3e:98:7f:e7", "network": {"id": "bb35bc76-087b-4468-ba0c-3637873207f8", "bridge": "br-int", "label": "tempest-TestStampPattern-620416114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d114efe1dfc1424299621df67bf00863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e423a5-90", "ovs_interfaceid": "e6e423a5-90cd-466a-9a6f-6b99812426ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:59:10 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-89782e37-3396-4873-839c-dc2a15a25192 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Converting VIF {"id": "e6e423a5-90cd-466a-9a6f-6b99812426ee", "address": "fa:16:3e:98:7f:e7", "network": {"id": "bb35bc76-087b-4468-ba0c-3637873207f8", "bridge": "br-int", "label": "tempest-TestStampPattern-620416114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d114efe1dfc1424299621df67bf00863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e423a5-90", "ovs_interfaceid": "e6e423a5-90cd-466a-9a6f-6b99812426ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:59:10 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-89782e37-3396-4873-839c-dc2a15a25192 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:7f:e7,bridge_name='br-int',has_traffic_filtering=True,id=e6e423a5-90cd-466a-9a6f-6b99812426ee,network=Network(bb35bc76-087b-4468-ba0c-3637873207f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6e423a5-90') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:59:10 user nova-compute[72444]: DEBUG os_vif [None req-89782e37-3396-4873-839c-dc2a15a25192 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:7f:e7,bridge_name='br-int',has_traffic_filtering=True,id=e6e423a5-90cd-466a-9a6f-6b99812426ee,network=Network(bb35bc76-087b-4468-ba0c-3637873207f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6e423a5-90') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:59:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6e423a5-90, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:59:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:10 user nova-compute[72444]: INFO os_vif [None req-89782e37-3396-4873-839c-dc2a15a25192 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:7f:e7,bridge_name='br-int',has_traffic_filtering=True,id=e6e423a5-90cd-466a-9a6f-6b99812426ee,network=Network(bb35bc76-087b-4468-ba0c-3637873207f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6e423a5-90')
Aug 03 04:59:10 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-89782e37-3396-4873-839c-dc2a15a25192 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Deleting instance files /opt/stack/data/nova/instances/87667868-78ed-4d9f-aff0-b6f0eda241bd_del
Aug 03 04:59:10 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-89782e37-3396-4873-839c-dc2a15a25192 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Deletion of /opt/stack/data/nova/instances/87667868-78ed-4d9f-aff0-b6f0eda241bd_del complete
Aug 03 04:59:10 user nova-compute[72444]: INFO nova.compute.manager [None req-89782e37-3396-4873-839c-dc2a15a25192 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 03 04:59:10 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-89782e37-3396-4873-839c-dc2a15a25192 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 04:59:10 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 04:59:10 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 04:59:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:10 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:59:10 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Took 0.56 seconds to deallocate network for instance.
Aug 03 04:59:10 user nova-compute[72444]: DEBUG nova.compute.manager [req-681f7fc5-6abd-4747-ab42-c6191cb0c567 req-7b5eb5ed-78d2-412f-a031-b2bd2093493a service nova] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Received event network-vif-deleted-e6e423a5-90cd-466a-9a6f-6b99812426ee {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:59:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-89782e37-3396-4873-839c-dc2a15a25192 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:59:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-89782e37-3396-4873-839c-dc2a15a25192 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:59:11 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-89782e37-3396-4873-839c-dc2a15a25192 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:59:11 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-89782e37-3396-4873-839c-dc2a15a25192 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:59:11 user nova-compute[72444]: DEBUG nova.compute.manager [req-9372a061-a20e-4e8e-b6dc-b44d62d8bed4 req-d22de1ef-e6d9-48b2-aa92-099a6a932d4f service nova] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Received event network-vif-unplugged-e6e423a5-90cd-466a-9a6f-6b99812426ee {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:59:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9372a061-a20e-4e8e-b6dc-b44d62d8bed4 req-d22de1ef-e6d9-48b2-aa92-099a6a932d4f service nova] Acquiring lock "87667868-78ed-4d9f-aff0-b6f0eda241bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:59:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9372a061-a20e-4e8e-b6dc-b44d62d8bed4 req-d22de1ef-e6d9-48b2-aa92-099a6a932d4f service nova] Lock "87667868-78ed-4d9f-aff0-b6f0eda241bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:59:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9372a061-a20e-4e8e-b6dc-b44d62d8bed4 req-d22de1ef-e6d9-48b2-aa92-099a6a932d4f service nova] Lock "87667868-78ed-4d9f-aff0-b6f0eda241bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:59:11 user nova-compute[72444]: DEBUG nova.compute.manager [req-9372a061-a20e-4e8e-b6dc-b44d62d8bed4 req-d22de1ef-e6d9-48b2-aa92-099a6a932d4f service nova] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] No waiting events found dispatching network-vif-unplugged-e6e423a5-90cd-466a-9a6f-6b99812426ee {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:59:11 user nova-compute[72444]: WARNING nova.compute.manager [req-9372a061-a20e-4e8e-b6dc-b44d62d8bed4 req-d22de1ef-e6d9-48b2-aa92-099a6a932d4f service nova] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Received unexpected event network-vif-unplugged-e6e423a5-90cd-466a-9a6f-6b99812426ee for instance with vm_state deleted and task_state None.
Aug 03 04:59:11 user nova-compute[72444]: DEBUG nova.compute.manager [req-9372a061-a20e-4e8e-b6dc-b44d62d8bed4 req-d22de1ef-e6d9-48b2-aa92-099a6a932d4f service nova] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Received event network-vif-plugged-e6e423a5-90cd-466a-9a6f-6b99812426ee {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:59:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9372a061-a20e-4e8e-b6dc-b44d62d8bed4 req-d22de1ef-e6d9-48b2-aa92-099a6a932d4f service nova] Acquiring lock "87667868-78ed-4d9f-aff0-b6f0eda241bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:59:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9372a061-a20e-4e8e-b6dc-b44d62d8bed4 req-d22de1ef-e6d9-48b2-aa92-099a6a932d4f service nova] Lock "87667868-78ed-4d9f-aff0-b6f0eda241bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:59:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9372a061-a20e-4e8e-b6dc-b44d62d8bed4 req-d22de1ef-e6d9-48b2-aa92-099a6a932d4f service nova] Lock "87667868-78ed-4d9f-aff0-b6f0eda241bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:59:11 user nova-compute[72444]: DEBUG nova.compute.manager [req-9372a061-a20e-4e8e-b6dc-b44d62d8bed4 req-d22de1ef-e6d9-48b2-aa92-099a6a932d4f service nova] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] No waiting events found dispatching network-vif-plugged-e6e423a5-90cd-466a-9a6f-6b99812426ee {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:59:11 user nova-compute[72444]: WARNING nova.compute.manager [req-9372a061-a20e-4e8e-b6dc-b44d62d8bed4 req-d22de1ef-e6d9-48b2-aa92-099a6a932d4f service nova] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Received unexpected event network-vif-plugged-e6e423a5-90cd-466a-9a6f-6b99812426ee for instance with vm_state deleted and task_state None.
Aug 03 04:59:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-89782e37-3396-4873-839c-dc2a15a25192 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:59:11 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-89782e37-3396-4873-839c-dc2a15a25192 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Deleted allocations for instance 87667868-78ed-4d9f-aff0-b6f0eda241bd
Aug 03 04:59:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-89782e37-3396-4873-839c-dc2a15a25192 tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "87667868-78ed-4d9f-aff0-b6f0eda241bd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.103s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:59:13 user nova-compute[72444]: DEBUG nova.objects.instance [None req-bdc55e9f-8b27-486d-885a-15769a4543dd tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lazy-loading 'flavor' on Instance uuid 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:59:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-bdc55e9f-8b27-486d-885a-15769a4543dd tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.638s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:59:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquiring lock "a9b960cb-39bd-4f31-9920-5ce31d5db139" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:59:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "a9b960cb-39bd-4f31-9920-5ce31d5db139" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:59:13 user nova-compute[72444]: INFO nova.compute.manager [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Rebooting instance
Aug 03 04:59:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquiring lock "refresh_cache-a9b960cb-39bd-4f31-9920-5ce31d5db139" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 04:59:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquired lock "refresh_cache-a9b960cb-39bd-4f31-9920-5ce31d5db139" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 04:59:13 user nova-compute[72444]: DEBUG nova.network.neutron [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 04:59:14 user nova-compute[72444]: DEBUG nova.network.neutron [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Updating instance_info_cache with network_info: [{"id": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "address": "fa:16:3e:b5:15:1e", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a682f5-6d", "ovs_interfaceid": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:59:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Releasing lock "refresh_cache-a9b960cb-39bd-4f31-9920-5ce31d5db139" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 04:59:14 user nova-compute[72444]: DEBUG nova.compute.manager [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:59:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG nova.compute.manager [req-7b842f9b-cca3-47c1-b654-592fddd61db2 req-32a1de76-14f6-42d2-8fdc-8d1cf4ce1df7 service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Received event network-vif-unplugged-68a682f5-6dbc-4c9b-ab56-b91c8cb93810 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7b842f9b-cca3-47c1-b654-592fddd61db2 req-32a1de76-14f6-42d2-8fdc-8d1cf4ce1df7 service nova] Acquiring lock "a9b960cb-39bd-4f31-9920-5ce31d5db139-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7b842f9b-cca3-47c1-b654-592fddd61db2 req-32a1de76-14f6-42d2-8fdc-8d1cf4ce1df7 service nova] Lock "a9b960cb-39bd-4f31-9920-5ce31d5db139-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7b842f9b-cca3-47c1-b654-592fddd61db2 req-32a1de76-14f6-42d2-8fdc-8d1cf4ce1df7 service nova] Lock "a9b960cb-39bd-4f31-9920-5ce31d5db139-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG nova.compute.manager [req-7b842f9b-cca3-47c1-b654-592fddd61db2 req-32a1de76-14f6-42d2-8fdc-8d1cf4ce1df7 service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] No waiting events found dispatching network-vif-unplugged-68a682f5-6dbc-4c9b-ab56-b91c8cb93810 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:59:15 user nova-compute[72444]: WARNING nova.compute.manager [req-7b842f9b-cca3-47c1-b654-592fddd61db2 req-32a1de76-14f6-42d2-8fdc-8d1cf4ce1df7 service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Received unexpected event network-vif-unplugged-68a682f5-6dbc-4c9b-ab56-b91c8cb93810 for instance with vm_state active and task_state reboot_started_hard.
Aug 03 04:59:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:15 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Instance destroyed successfully.
Aug 03 04:59:15 user nova-compute[72444]: DEBUG nova.objects.instance [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lazy-loading 'resources' on Instance uuid a9b960cb-39bd-4f31-9920-5ce31d5db139 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:56:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1751002867',display_name='tempest-TestMinimumBasicScenario-server-1751002867',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1751002867',id=33,image_ref='8e18af3a-7ab1-40b2-9a01-456e56c71296',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcHfxO2CJZwlfrKEV+BCKKA3mm2Qu1C0XwTCU49QSlfy4GtfOuw1uap5TaNJn3JTTUIHR9cd/KVOmyFHg2ffBTJNBWsd9JhffQaYQWGjqb5ClOLv5HgkGXnryOGHCRpGA==',key_name='tempest-TestMinimumBasicScenario-1010540444',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:56:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d787b7db6a684a008a03c55e292b0d5c',ramdisk_id='',reservation_id='r-rxwa2ccf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8e18af3a-7ab1-40b2-9a01-456e56c71296',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1132477023',owner_user_name='tempest-TestMinimumBasicScenario-1132477023-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:59:15Z,user_data=None,user_id='9458c7bd532e4451904ca404bf35427b',uuid=a9b960cb-39bd-4f31-9920-5ce31d5db139,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "address": "fa:16:3e:b5:15:1e", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a682f5-6d", "ovs_interfaceid": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Converting VIF {"id": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "address": "fa:16:3e:b5:15:1e", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a682f5-6d", "ovs_interfaceid": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:15:1e,bridge_name='br-int',has_traffic_filtering=True,id=68a682f5-6dbc-4c9b-ab56-b91c8cb93810,network=Network(87c23a2e-233d-487e-9789-d4eb24a63856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68a682f5-6d') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG os_vif [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:15:1e,bridge_name='br-int',has_traffic_filtering=True,id=68a682f5-6dbc-4c9b-ab56-b91c8cb93810,network=Network(87c23a2e-233d-487e-9789-d4eb24a63856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68a682f5-6d') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68a682f5-6d, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:59:15 user nova-compute[72444]: INFO os_vif [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:15:1e,bridge_name='br-int',has_traffic_filtering=True,id=68a682f5-6dbc-4c9b-ab56-b91c8cb93810,network=Network(87c23a2e-233d-487e-9789-d4eb24a63856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68a682f5-6d')
Aug 03 04:59:15 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AaOVwGqF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:59:15 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:59:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[425ad914-e1ea-4e7b-8518-af64ba7466f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e493a4f-ed10-4459-8ca6-212aee05357b]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f (non-flash)
Aug 03 04:59:15 user nova-compute[72444]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f (non-flash)
Aug 03 04:59:15 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:59:15 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f (non-flash)
Aug 03 04:59:15 user nova-compute[72444]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f (non-flash)
Aug 03 04:59:15 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:59:15 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308c3c1120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f'): ({'sdc'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Removing single pathed devices sdc {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa2e597-d231-43d0-82eb-e74af1d9bf2a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[139c0d8f-e2eb-4d1e-9c60-ca3ac1f07f19]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Flushing IO for device /dev/sdc {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0551240-2a27-47fd-b6ef-fe1bf93caf9c]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e37176a-a8bd-4b1f-b42d-956756b2ac29]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] SCSI volumes sdc have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[711c2ec8-88e9-413d-a2bb-25abb3700fbb]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[631d40e2-3a69-4c54-a948-15c9cffc4214]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f, portal: 172.16.0.220,3260]
Aug 03 04:59:15 user nova-compute[72444]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f, portal: 172.16.0.220,3260] successful.
Aug 03 04:59:15 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3a2a8c-2d9e-47be-b2af-a193a1ec433d]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] <== disconnect_volume: return (288ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:59:15 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Start _get_guest_xml network_info=[{"id": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "address": "fa:16:3e:b5:15:1e", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a682f5-6d", "ovs_interfaceid": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8e18af3a-7ab1-40b2-9a01-456e56c71296,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '8e18af3a-7ab1-40b2-9a01-456e56c71296'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AaOVwGqF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'a9b960cb-39bd-4f31-9920-5ce31d5db139', 'attached_at': '', 'detached_at': '', 'volume_id': '90b0eca8-17a6-484f-962f-1882bf94e80f', 'serial': '90b0eca8-17a6-484f-962f-1882bf94e80f'}, 'disk_bus': 'virtio', 'attachment_id': '99754e41-9e68-4acf-a435-27173697ddef', 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 04:59:16 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:59:16 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 04:59:16 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8e18af3a-7ab1-40b2-9a01-456e56c71296,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG nova.objects.instance [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lazy-loading 'vcpu_model' on Instance uuid a9b960cb-39bd-4f31-9920-5ce31d5db139 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AaOVwGqF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:59:16 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:59:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:59:16 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:59:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:59:16 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 04:59:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b828543-5a53-4347-83e8-c553e5250e96]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 04:59:16 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45a8a9c-5fa5-4f98-8bfc-4330c07cdb9e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f] added
Aug 03 04:59:16 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36b8f70-6a83-464e-b103-586a0215c091]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a8e056-50cd-4e5f-8a3b-49b594e2cfca]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AaOVwGqF {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AaOVwGqF" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c21a55-1d08-4d8f-b37b-fbb70a71c30f]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AaOVwGqF'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14353d1-9189-4ffa-961d-2929065ae9df]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6634c6f0-172d-4cb9-9d31-d72905c88eb9]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f (non-flash)
Aug 03 04:59:16 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:59:16 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f (non-flash)
Aug 03 04:59:16 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:59:16 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc279f7-877a-4c43-97aa-61bb4efac899]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f, portal: 172.16.0.220,3260]
Aug 03 04:59:16 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f, portal: 172.16.0.220,3260] successful.
Aug 03 04:59:16 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2973bf-b6b4-4362-9c46-39309be1b13e]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed83f29-0add-4bc0-bac1-73e799fe8ceb]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f (non-flash)
Aug 03 04:59:16 user nova-compute[72444]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f (non-flash)
Aug 03 04:59:16 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:59:16 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f (non-flash)
Aug 03 04:59:16 user nova-compute[72444]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f (non-flash)
Aug 03 04:59:16 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:59:16 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcfb89a-934c-43ec-b74e-7a851df880e5]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 04:59:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AaOVwGqF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 04:59:17 user nova-compute[72444]: DEBUG nova.compute.manager [req-03538f64-5056-4b8c-986d-6b735f5c6b27 req-86b2ccde-5743-4cea-90c4-41cfbd927ab4 service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Received event network-vif-plugged-68a682f5-6dbc-4c9b-ab56-b91c8cb93810 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:59:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-03538f64-5056-4b8c-986d-6b735f5c6b27 req-86b2ccde-5743-4cea-90c4-41cfbd927ab4 service nova] Acquiring lock "a9b960cb-39bd-4f31-9920-5ce31d5db139-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:59:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-03538f64-5056-4b8c-986d-6b735f5c6b27 req-86b2ccde-5743-4cea-90c4-41cfbd927ab4 service nova] Lock "a9b960cb-39bd-4f31-9920-5ce31d5db139-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:59:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-03538f64-5056-4b8c-986d-6b735f5c6b27 req-86b2ccde-5743-4cea-90c4-41cfbd927ab4 service nova] Lock "a9b960cb-39bd-4f31-9920-5ce31d5db139-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:59:17 user nova-compute[72444]: DEBUG nova.compute.manager [req-03538f64-5056-4b8c-986d-6b735f5c6b27 req-86b2ccde-5743-4cea-90c4-41cfbd927ab4 service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] No waiting events found dispatching network-vif-plugged-68a682f5-6dbc-4c9b-ab56-b91c8cb93810 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:59:17 user nova-compute[72444]: WARNING nova.compute.manager [req-03538f64-5056-4b8c-986d-6b735f5c6b27 req-86b2ccde-5743-4cea-90c4-41cfbd927ab4 service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Received unexpected event network-vif-plugged-68a682f5-6dbc-4c9b-ab56-b91c8cb93810 for instance with vm_state active and task_state reboot_started_hard.
Aug 03 04:59:17 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:59:17 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26631313034376632', 'path': '/dev/sdb'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:59:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631313034376632', 'path': '/dev/sdb'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 04:59:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:56:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1751002867',display_name='tempest-TestMinimumBasicScenario-server-1751002867',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1751002867',id=33,image_ref='8e18af3a-7ab1-40b2-9a01-456e56c71296',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcHfxO2CJZwlfrKEV+BCKKA3mm2Qu1C0XwTCU49QSlfy4GtfOuw1uap5TaNJn3JTTUIHR9cd/KVOmyFHg2ffBTJNBWsd9JhffQaYQWGjqb5ClOLv5HgkGXnryOGHCRpGA==',key_name='tempest-TestMinimumBasicScenario-1010540444',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:56:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d787b7db6a684a008a03c55e292b0d5c',ramdisk_id='',reservation_id='r-rxwa2ccf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8e18af3a-7ab1-40b2-9a01-456e56c71296',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1132477023',owner_user_name='tempest-TestMinimumBasicScenario-1132477023-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:59:15Z,user_data=None,user_id='9458c7bd532e4451904ca404bf35427b',uuid=a9b960cb-39bd-4f31-9920-5ce31d5db139,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "address": "fa:16:3e:b5:15:1e", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a682f5-6d", "ovs_interfaceid": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 04:59:17 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Converting VIF {"id": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "address": "fa:16:3e:b5:15:1e", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a682f5-6d", "ovs_interfaceid": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:59:17 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:15:1e,bridge_name='br-int',has_traffic_filtering=True,id=68a682f5-6dbc-4c9b-ab56-b91c8cb93810,network=Network(87c23a2e-233d-487e-9789-d4eb24a63856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68a682f5-6d') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:59:17 user nova-compute[72444]: DEBUG nova.objects.instance [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lazy-loading 'pci_devices' on Instance uuid a9b960cb-39bd-4f31-9920-5ce31d5db139 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:59:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] End _get_guest_xml xml=<domain type="kvm">
Aug 03 04:59:17 user nova-compute[72444]:   <uuid>a9b960cb-39bd-4f31-9920-5ce31d5db139</uuid>
Aug 03 04:59:17 user nova-compute[72444]:   <name>instance-00000021</name>
Aug 03 04:59:17 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 04:59:17 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 04:59:17 user nova-compute[72444]:   <metadata>
Aug 03 04:59:17 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 04:59:17 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 04:59:17 user nova-compute[72444]:       <nova:name>tempest-TestMinimumBasicScenario-server-1751002867</nova:name>
Aug 03 04:59:17 user nova-compute[72444]:       <nova:creationTime>2023-08-03 04:59:16</nova:creationTime>
Aug 03 04:59:17 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 04:59:17 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 04:59:17 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 04:59:17 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 04:59:17 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 04:59:17 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 04:59:17 user nova-compute[72444]:       </nova:flavor>
Aug 03 04:59:17 user nova-compute[72444]:       <nova:owner>
Aug 03 04:59:17 user nova-compute[72444]:         <nova:user uuid="9458c7bd532e4451904ca404bf35427b">tempest-TestMinimumBasicScenario-1132477023-project-member</nova:user>
Aug 03 04:59:17 user nova-compute[72444]:         <nova:project uuid="d787b7db6a684a008a03c55e292b0d5c">tempest-TestMinimumBasicScenario-1132477023</nova:project>
Aug 03 04:59:17 user nova-compute[72444]:       </nova:owner>
Aug 03 04:59:17 user nova-compute[72444]:       <nova:root type="image" uuid="8e18af3a-7ab1-40b2-9a01-456e56c71296"/>
Aug 03 04:59:17 user nova-compute[72444]:       <nova:ports>
Aug 03 04:59:17 user nova-compute[72444]:         <nova:port uuid="68a682f5-6dbc-4c9b-ab56-b91c8cb93810">
Aug 03 04:59:17 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 03 04:59:17 user nova-compute[72444]:         </nova:port>
Aug 03 04:59:17 user nova-compute[72444]:       </nova:ports>
Aug 03 04:59:17 user nova-compute[72444]:     </nova:instance>
Aug 03 04:59:17 user nova-compute[72444]:   </metadata>
Aug 03 04:59:17 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 04:59:17 user nova-compute[72444]:     <system>
Aug 03 04:59:17 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 04:59:17 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 04:59:17 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 04:59:17 user nova-compute[72444]:       <entry name="serial">a9b960cb-39bd-4f31-9920-5ce31d5db139</entry>
Aug 03 04:59:17 user nova-compute[72444]:       <entry name="uuid">a9b960cb-39bd-4f31-9920-5ce31d5db139</entry>
Aug 03 04:59:17 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 04:59:17 user nova-compute[72444]:     </system>
Aug 03 04:59:17 user nova-compute[72444]:   </sysinfo>
Aug 03 04:59:17 user nova-compute[72444]:   <os>
Aug 03 04:59:17 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 04:59:17 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 04:59:17 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 04:59:17 user nova-compute[72444]:   </os>
Aug 03 04:59:17 user nova-compute[72444]:   <features>
Aug 03 04:59:17 user nova-compute[72444]:     <acpi/>
Aug 03 04:59:17 user nova-compute[72444]:     <apic/>
Aug 03 04:59:17 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 04:59:17 user nova-compute[72444]:   </features>
Aug 03 04:59:17 user nova-compute[72444]:   <clock offset="utc">
Aug 03 04:59:17 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 04:59:17 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 04:59:17 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 04:59:17 user nova-compute[72444]:   </clock>
Aug 03 04:59:17 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 04:59:17 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 04:59:17 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 04:59:17 user nova-compute[72444]:   </cpu>
Aug 03 04:59:17 user nova-compute[72444]:   <devices>
Aug 03 04:59:17 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 04:59:17 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 04:59:17 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/disk"/>
Aug 03 04:59:17 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 04:59:17 user nova-compute[72444]:     </disk>
Aug 03 04:59:17 user nova-compute[72444]:     <disk type="block" device="disk">
Aug 03 04:59:17 user nova-compute[72444]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:59:17 user nova-compute[72444]:       <source dev="/dev/sdb"/>
Aug 03 04:59:17 user nova-compute[72444]:       <target dev="vdb" bus="virtio"/>
Aug 03 04:59:17 user nova-compute[72444]:       <serial>90b0eca8-17a6-484f-962f-1882bf94e80f</serial>
Aug 03 04:59:17 user nova-compute[72444]:     </disk>
Aug 03 04:59:17 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 04:59:17 user nova-compute[72444]:       <mac address="fa:16:3e:b5:15:1e"/>
Aug 03 04:59:17 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:59:17 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 04:59:17 user nova-compute[72444]:       <target dev="tap68a682f5-6d"/>
Aug 03 04:59:17 user nova-compute[72444]:     </interface>
Aug 03 04:59:17 user nova-compute[72444]:     <serial type="pty">
Aug 03 04:59:17 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/console.log" append="off"/>
Aug 03 04:59:17 user nova-compute[72444]:     </serial>
Aug 03 04:59:17 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 04:59:17 user nova-compute[72444]:     <video>
Aug 03 04:59:17 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 04:59:17 user nova-compute[72444]:     </video>
Aug 03 04:59:17 user nova-compute[72444]:     <rng model="virtio">
Aug 03 04:59:17 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 04:59:17 user nova-compute[72444]:     </rng>
Aug 03 04:59:17 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 04:59:17 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 04:59:17 user nova-compute[72444]:       <stats period="10"/>
Aug 03 04:59:17 user nova-compute[72444]:     </memballoon>
Aug 03 04:59:17 user nova-compute[72444]:   </devices>
Aug 03 04:59:17 user nova-compute[72444]: </domain>
Aug 03 04:59:17 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 04:59:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 04:59:17 user nova-compute[72444]: DEBUG nova.objects.instance [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lazy-loading 'trusted_certs' on Instance uuid a9b960cb-39bd-4f31-9920-5ce31d5db139 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:59:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e268fc11716d4f0234addcf0a05158bc52f1db71 --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e268fc11716d4f0234addcf0a05158bc52f1db71 --force-share --output=json" returned: 0 in 0.134s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:17 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 04:59:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:17 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Cannot resize image /opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 04:59:17 user nova-compute[72444]: DEBUG nova.objects.instance [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lazy-loading 'migration_context' on Instance uuid a9b960cb-39bd-4f31-9920-5ce31d5db139 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:59:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:56:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1751002867',display_name='tempest-TestMinimumBasicScenario-server-1751002867',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1751002867',id=33,image_ref='8e18af3a-7ab1-40b2-9a01-456e56c71296',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcHfxO2CJZwlfrKEV+BCKKA3mm2Qu1C0XwTCU49QSlfy4GtfOuw1uap5TaNJn3JTTUIHR9cd/KVOmyFHg2ffBTJNBWsd9JhffQaYQWGjqb5ClOLv5HgkGXnryOGHCRpGA==',key_name='tempest-TestMinimumBasicScenario-1010540444',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:56:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='d787b7db6a684a008a03c55e292b0d5c',ramdisk_id='',reservation_id='r-rxwa2ccf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8e18af3a-7ab1-40b2-9a01-456e56c71296',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1132477023',owner_user_name='tempest-TestMinimumBasicScenario-1132477023-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T04:59:15Z,user_data=None,user_id='9458c7bd532e4451904ca404bf35427b',uuid=a9b960cb-39bd-4f31-9920-5ce31d5db139,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "address": "fa:16:3e:b5:15:1e", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a682f5-6d", "ovs_interfaceid": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 04:59:18 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Converting VIF {"id": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "address": "fa:16:3e:b5:15:1e", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a682f5-6d", "ovs_interfaceid": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:59:18 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:15:1e,bridge_name='br-int',has_traffic_filtering=True,id=68a682f5-6dbc-4c9b-ab56-b91c8cb93810,network=Network(87c23a2e-233d-487e-9789-d4eb24a63856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68a682f5-6d') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:59:18 user nova-compute[72444]: DEBUG os_vif [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:15:1e,bridge_name='br-int',has_traffic_filtering=True,id=68a682f5-6dbc-4c9b-ab56-b91c8cb93810,network=Network(87c23a2e-233d-487e-9789-d4eb24a63856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68a682f5-6d') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 04:59:18 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:18 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:59:18 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 04:59:18 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:18 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68a682f5-6d, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:59:18 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap68a682f5-6d, col_values=(('external_ids', {'iface-id': '68a682f5-6dbc-4c9b-ab56-b91c8cb93810', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:15:1e', 'vm-uuid': 'a9b960cb-39bd-4f31-9920-5ce31d5db139'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:59:18 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:18 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:59:18 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:18 user nova-compute[72444]: INFO os_vif [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:15:1e,bridge_name='br-int',has_traffic_filtering=True,id=68a682f5-6dbc-4c9b-ab56-b91c8cb93810,network=Network(87c23a2e-233d-487e-9789-d4eb24a63856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68a682f5-6d')
Aug 03 04:59:19 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:19 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:19 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:19 user nova-compute[72444]: DEBUG nova.compute.manager [req-88ac23b2-bf75-47b3-a0cd-2fb08ca12f34 req-af2ad253-a8ae-4ab3-8f32-c7bb71e397b8 service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Received event network-vif-plugged-68a682f5-6dbc-4c9b-ab56-b91c8cb93810 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:59:19 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-88ac23b2-bf75-47b3-a0cd-2fb08ca12f34 req-af2ad253-a8ae-4ab3-8f32-c7bb71e397b8 service nova] Acquiring lock "a9b960cb-39bd-4f31-9920-5ce31d5db139-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:59:19 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-88ac23b2-bf75-47b3-a0cd-2fb08ca12f34 req-af2ad253-a8ae-4ab3-8f32-c7bb71e397b8 service nova] Lock "a9b960cb-39bd-4f31-9920-5ce31d5db139-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:59:19 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-88ac23b2-bf75-47b3-a0cd-2fb08ca12f34 req-af2ad253-a8ae-4ab3-8f32-c7bb71e397b8 service nova] Lock "a9b960cb-39bd-4f31-9920-5ce31d5db139-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:59:19 user nova-compute[72444]: DEBUG nova.compute.manager [req-88ac23b2-bf75-47b3-a0cd-2fb08ca12f34 req-af2ad253-a8ae-4ab3-8f32-c7bb71e397b8 service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] No waiting events found dispatching network-vif-plugged-68a682f5-6dbc-4c9b-ab56-b91c8cb93810 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:59:19 user nova-compute[72444]: WARNING nova.compute.manager [req-88ac23b2-bf75-47b3-a0cd-2fb08ca12f34 req-af2ad253-a8ae-4ab3-8f32-c7bb71e397b8 service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Received unexpected event network-vif-plugged-68a682f5-6dbc-4c9b-ab56-b91c8cb93810 for instance with vm_state active and task_state reboot_started_hard.
Aug 03 04:59:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:21 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Removed pending event for a9b960cb-39bd-4f31-9920-5ce31d5db139 due to event {{(pid=72444) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 03 04:59:21 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038761.553832, a9b960cb-39bd-4f31-9920-5ce31d5db139 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:59:21 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] VM Resumed (Lifecycle Event)
Aug 03 04:59:21 user nova-compute[72444]: DEBUG nova.compute.manager [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 04:59:21 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Instance rebooted successfully.
Aug 03 04:59:21 user nova-compute[72444]: DEBUG nova.compute.manager [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:59:21 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:59:21 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:59:21 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 03 04:59:21 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038761.5579941, a9b960cb-39bd-4f31-9920-5ce31d5db139 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:59:21 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] VM Started (Lifecycle Event)
Aug 03 04:59:21 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:59:21 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 04:59:21 user nova-compute[72444]: DEBUG nova.compute.manager [req-5533999d-7958-4a0b-9aa6-fc67bc31a167 req-063c3847-46af-42df-86ea-bf9d48f3999a service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Received event network-vif-plugged-68a682f5-6dbc-4c9b-ab56-b91c8cb93810 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:59:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5533999d-7958-4a0b-9aa6-fc67bc31a167 req-063c3847-46af-42df-86ea-bf9d48f3999a service nova] Acquiring lock "a9b960cb-39bd-4f31-9920-5ce31d5db139-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:59:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5533999d-7958-4a0b-9aa6-fc67bc31a167 req-063c3847-46af-42df-86ea-bf9d48f3999a service nova] Lock "a9b960cb-39bd-4f31-9920-5ce31d5db139-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:59:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5533999d-7958-4a0b-9aa6-fc67bc31a167 req-063c3847-46af-42df-86ea-bf9d48f3999a service nova] Lock "a9b960cb-39bd-4f31-9920-5ce31d5db139-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:59:21 user nova-compute[72444]: DEBUG nova.compute.manager [req-5533999d-7958-4a0b-9aa6-fc67bc31a167 req-063c3847-46af-42df-86ea-bf9d48f3999a service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] No waiting events found dispatching network-vif-plugged-68a682f5-6dbc-4c9b-ab56-b91c8cb93810 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:59:21 user nova-compute[72444]: WARNING nova.compute.manager [req-5533999d-7958-4a0b-9aa6-fc67bc31a167 req-063c3847-46af-42df-86ea-bf9d48f3999a service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Received unexpected event network-vif-plugged-68a682f5-6dbc-4c9b-ab56-b91c8cb93810 for instance with vm_state active and task_state None.
Aug 03 04:59:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f3fcbfaf-bce7-4852-94df-9c185c8a9432 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "a9b960cb-39bd-4f31-9920-5ce31d5db139" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.030s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:59:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:25 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691038750.0751247, 87667868-78ed-4d9f-aff0-b6f0eda241bd => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:59:25 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] VM Stopped (Lifecycle Event)
Aug 03 04:59:25 user nova-compute[72444]: DEBUG nova.compute.manager [None req-2bf74083-1be1-4d52-aacb-f50e256f1091 None None] [instance: 87667868-78ed-4d9f-aff0-b6f0eda241bd] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:59:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:59:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:59:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:59:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:59:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:59:31 user nova-compute[72444]: INFO nova.compute.manager [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Terminating instance
Aug 03 04:59:31 user nova-compute[72444]: DEBUG nova.compute.manager [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 04:59:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:31 user nova-compute[72444]: DEBUG nova.compute.manager [req-bcd979ff-3ce5-435c-8011-d312572937dc req-4a2c2d8c-e17c-43da-929f-bbd2c2c5452c service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Received event network-vif-unplugged-c14e16af-c17e-4152-a400-cbb8fb4f41fa {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:59:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-bcd979ff-3ce5-435c-8011-d312572937dc req-4a2c2d8c-e17c-43da-929f-bbd2c2c5452c service nova] Acquiring lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:59:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-bcd979ff-3ce5-435c-8011-d312572937dc req-4a2c2d8c-e17c-43da-929f-bbd2c2c5452c service nova] Lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:59:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-bcd979ff-3ce5-435c-8011-d312572937dc req-4a2c2d8c-e17c-43da-929f-bbd2c2c5452c service nova] Lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:59:31 user nova-compute[72444]: DEBUG nova.compute.manager [req-bcd979ff-3ce5-435c-8011-d312572937dc req-4a2c2d8c-e17c-43da-929f-bbd2c2c5452c service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] No waiting events found dispatching network-vif-unplugged-c14e16af-c17e-4152-a400-cbb8fb4f41fa {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:59:31 user nova-compute[72444]: DEBUG nova.compute.manager [req-bcd979ff-3ce5-435c-8011-d312572937dc req-4a2c2d8c-e17c-43da-929f-bbd2c2c5452c service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Received event network-vif-unplugged-c14e16af-c17e-4152-a400-cbb8fb4f41fa for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:59:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:32 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Instance destroyed successfully.
Aug 03 04:59:32 user nova-compute[72444]: DEBUG nova.objects.instance [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lazy-loading 'resources' on Instance uuid 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:43:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1841165233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1841165233',id=15,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:45:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='929fd4a3127b475282426d4412e58def',ramdisk_id='',reservation_id='r-p417nobm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1082770125',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:47:29Z,user_data=None,user_id='ceede92aa3a74060a7f57d29d0d97aee',uuid=2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c14e16af-c17e-4152-a400-cbb8fb4f41fa", "address": "fa:16:3e:05:10:6a", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14e16af-c1", "ovs_interfaceid": "c14e16af-c17e-4152-a400-cbb8fb4f41fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Converting VIF {"id": "c14e16af-c17e-4152-a400-cbb8fb4f41fa", "address": "fa:16:3e:05:10:6a", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14e16af-c1", "ovs_interfaceid": "c14e16af-c17e-4152-a400-cbb8fb4f41fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:10:6a,bridge_name='br-int',has_traffic_filtering=True,id=c14e16af-c17e-4152-a400-cbb8fb4f41fa,network=Network(0e8b3ddd-e35a-45eb-a34c-614654c25549),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc14e16af-c1') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG os_vif [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:10:6a,bridge_name='br-int',has_traffic_filtering=True,id=c14e16af-c17e-4152-a400-cbb8fb4f41fa,network=Network(0e8b3ddd-e35a-45eb-a34c-614654c25549),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc14e16af-c1') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc14e16af-c1, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:59:32 user nova-compute[72444]: INFO os_vif [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:10:6a,bridge_name='br-int',has_traffic_filtering=True,id=c14e16af-c17e-4152-a400-cbb8fb4f41fa,network=Network(0e8b3ddd-e35a-45eb-a34c-614654c25549),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc14e16af-c1')
Aug 03 04:59:32 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RFpBszwX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:59:32 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:59:32 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[81357566-ef08-4cde-a388-2a25eb76323b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b875e0c5-75d6-4aba-98ce-b18b1cda1a05]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f (non-flash)
Aug 03 04:59:32 user nova-compute[72444]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f (non-flash)
Aug 03 04:59:32 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:59:32 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f (non-flash)
Aug 03 04:59:32 user nova-compute[72444]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f (non-flash)
Aug 03 04:59:32 user nova-compute[72444]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 (non-flash)
Aug 03 04:59:32 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308c421ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828'): ({'sdf'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Removing single pathed devices sdf {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[17555046-b40c-4f8c-9013-a3587127b208]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[96972cda-6e4c-40b6-adab-a58e2145f1cf]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Flushing IO for device /dev/sdf {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3d27b4-5365-4335-8415-9acabdf9870d]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.031s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bc0832-edb9-40e4-97e5-aa824f27211e]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] SCSI volumes sdf have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5a0d5a-0eec-4c07-bdbb-8a5def9e7490]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab6f142-c059-4994-bd3a-a3f817353feb]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828, portal: 172.16.0.220,3260]
Aug 03 04:59:32 user nova-compute[72444]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828, portal: 172.16.0.220,3260] successful.
Aug 03 04:59:32 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe332412-b62b-4f63-abe0-b743ff189828 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[baccb839-434c-46e1-9ad2-146ac3cecfdd]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.257s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] <== disconnect_volume: return (258ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:59:32 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Deleting instance files /opt/stack/data/nova/instances/2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15_del
Aug 03 04:59:32 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Deletion of /opt/stack/data/nova/instances/2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15_del complete
Aug 03 04:59:32 user nova-compute[72444]: INFO nova.compute.manager [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 03 04:59:32 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 04:59:32 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 04:59:33 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:59:33 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Took 0.90 seconds to deallocate network for instance.
Aug 03 04:59:33 user nova-compute[72444]: DEBUG nova.compute.manager [req-7e170010-3eeb-4fa7-8377-c669ae3e61f2 req-65543b4e-7538-4040-aaf5-8882e18466e5 service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Received event network-vif-plugged-c14e16af-c17e-4152-a400-cbb8fb4f41fa {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:59:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7e170010-3eeb-4fa7-8377-c669ae3e61f2 req-65543b4e-7538-4040-aaf5-8882e18466e5 service nova] Acquiring lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:59:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7e170010-3eeb-4fa7-8377-c669ae3e61f2 req-65543b4e-7538-4040-aaf5-8882e18466e5 service nova] Lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:59:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7e170010-3eeb-4fa7-8377-c669ae3e61f2 req-65543b4e-7538-4040-aaf5-8882e18466e5 service nova] Lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:59:33 user nova-compute[72444]: DEBUG nova.compute.manager [req-7e170010-3eeb-4fa7-8377-c669ae3e61f2 req-65543b4e-7538-4040-aaf5-8882e18466e5 service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] No waiting events found dispatching network-vif-plugged-c14e16af-c17e-4152-a400-cbb8fb4f41fa {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:59:33 user nova-compute[72444]: WARNING nova.compute.manager [req-7e170010-3eeb-4fa7-8377-c669ae3e61f2 req-65543b4e-7538-4040-aaf5-8882e18466e5 service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Received unexpected event network-vif-plugged-c14e16af-c17e-4152-a400-cbb8fb4f41fa for instance with vm_state active and task_state deleting.
Aug 03 04:59:33 user nova-compute[72444]: DEBUG nova.compute.manager [req-7e170010-3eeb-4fa7-8377-c669ae3e61f2 req-65543b4e-7538-4040-aaf5-8882e18466e5 service nova] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Received event network-vif-deleted-c14e16af-c17e-4152-a400-cbb8fb4f41fa {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:59:34 user nova-compute[72444]: INFO nova.compute.manager [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Took 0.74 seconds to detach 1 volumes for instance.
Aug 03 04:59:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:59:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:59:34 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:59:34 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:59:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.302s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:59:34 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Deleted allocations for instance 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15
Aug 03 04:59:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8efa3fb3-5e0d-49a0-a8a2-d59be64cbdad tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.281s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:59:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f30a2c11-0721-4275-a027-a06323e12615 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Acquiring lock "df31afec-a5b7-4b2a-a062-f489429c6fef" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:59:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f30a2c11-0721-4275-a027-a06323e12615 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "df31afec-a5b7-4b2a-a062-f489429c6fef" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:59:44 user nova-compute[72444]: INFO nova.compute.manager [None req-f30a2c11-0721-4275-a027-a06323e12615 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Detaching volume ae102c75-de71-46e8-bb77-bcc04f42c08f
Aug 03 04:59:44 user nova-compute[72444]: INFO nova.virt.block_device [None req-f30a2c11-0721-4275-a027-a06323e12615 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Attempting to driver detach volume ae102c75-de71-46e8-bb77-bcc04f42c08f from mountpoint /dev/vdb
Aug 03 04:59:44 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f30a2c11-0721-4275-a027-a06323e12615 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Attempting to detach device vdb from instance df31afec-a5b7-4b2a-a062-f489429c6fef from the persistent domain config. {{(pid=72444) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 04:59:44 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-f30a2c11-0721-4275-a027-a06323e12615 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 04:59:44 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:59:44 user nova-compute[72444]:   <source dev="/dev/sdd"/>
Aug 03 04:59:44 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:59:44 user nova-compute[72444]:   <serial>ae102c75-de71-46e8-bb77-bcc04f42c08f</serial>
Aug 03 04:59:44 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 04:59:44 user nova-compute[72444]: </disk>
Aug 03 04:59:44 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:59:44 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-f30a2c11-0721-4275-a027-a06323e12615 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Successfully detached device vdb from instance df31afec-a5b7-4b2a-a062-f489429c6fef from the persistent domain config.
Aug 03 04:59:44 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f30a2c11-0721-4275-a027-a06323e12615 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance df31afec-a5b7-4b2a-a062-f489429c6fef from the live domain config. {{(pid=72444) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 04:59:44 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-f30a2c11-0721-4275-a027-a06323e12615 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 04:59:44 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 04:59:44 user nova-compute[72444]:   <source dev="/dev/sdd"/>
Aug 03 04:59:44 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 04:59:44 user nova-compute[72444]:   <serial>ae102c75-de71-46e8-bb77-bcc04f42c08f</serial>
Aug 03 04:59:44 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 04:59:44 user nova-compute[72444]: </disk>
Aug 03 04:59:44 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 04:59:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-22e4f6ad-b01b-4ef2-ba1f-9e0cb2ca0ae0 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Acquiring lock "df31afec-a5b7-4b2a-a062-f489429c6fef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Received event <DeviceRemovedEvent: 1691038785.1868877, df31afec-a5b7-4b2a-a062-f489429c6fef => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72444) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f30a2c11-0721-4275-a027-a06323e12615 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance df31afec-a5b7-4b2a-a062-f489429c6fef {{(pid=72444) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 04:59:45 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-f30a2c11-0721-4275-a027-a06323e12615 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Successfully detached device vdb from instance df31afec-a5b7-4b2a-a062-f489429c6fef from the live domain config.
Aug 03 04:59:45 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f30a2c11-0721-4275-a027-a06323e12615 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f30a2c11-0721-4275-a027-a06323e12615 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYfvEVwR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:59:45 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-f30a2c11-0721-4275-a027-a06323e12615 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:59:45 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-f30a2c11-0721-4275-a027-a06323e12615 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-f30a2c11-0721-4275-a027-a06323e12615 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f30a2c11-0721-4275-a027-a06323e12615 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f8b2df-cf91-44b3-97c7-8b5a998e4cec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[466b3692-c663-4e33-a733-fa7a16bea44d]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f30a2c11-0721-4275-a027-a06323e12615 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f (non-flash)
Aug 03 04:59:45 user nova-compute[72444]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f (non-flash)
Aug 03 04:59:45 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f30a2c11-0721-4275-a027-a06323e12615 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f (non-flash)
Aug 03 04:59:45 user nova-compute[72444]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f (non-flash)
Aug 03 04:59:45 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f30a2c11-0721-4275-a027-a06323e12615 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f309f7976d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f'): ({'sdd'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-f30a2c11-0721-4275-a027-a06323e12615 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Removing single pathed devices sdd {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4477132-b00d-44e3-b329-5679bb5d2215]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b47d960-5310-466f-846c-07ecaff4811e]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-f30a2c11-0721-4275-a027-a06323e12615 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Flushing IO for device /dev/sdd {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1991fe5-c760-44ce-acc8-2685f67a0828]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-f30a2c11-0721-4275-a027-a06323e12615 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4632aa54-eedf-4e3b-99e4-6560068feb42]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-f30a2c11-0721-4275-a027-a06323e12615 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-f30a2c11-0721-4275-a027-a06323e12615 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] SCSI volumes sdd have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f30a2c11-0721-4275-a027-a06323e12615 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[823924d1-93f1-4719-9586-6f665b72da51]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f30a2c11-0721-4275-a027-a06323e12615 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6be3ca7-5e20-4445-8def-c922546fbe1a]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f30a2c11-0721-4275-a027-a06323e12615 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f, portal: 172.16.0.220,3260]
Aug 03 04:59:45 user nova-compute[72444]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f, portal: 172.16.0.220,3260] successful.
Aug 03 04:59:45 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc4caa7-d1c5-4a7d-b532-d17cd0c5fed2]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f30a2c11-0721-4275-a027-a06323e12615 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-f30a2c11-0721-4275-a027-a06323e12615 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f30a2c11-0721-4275-a027-a06323e12615 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] <== disconnect_volume: return (281ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:59:45 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f30a2c11-0721-4275-a027-a06323e12615 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:59:46 user nova-compute[72444]: DEBUG nova.objects.instance [None req-f30a2c11-0721-4275-a027-a06323e12615 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lazy-loading 'flavor' on Instance uuid df31afec-a5b7-4b2a-a062-f489429c6fef {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:59:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f30a2c11-0721-4275-a027-a06323e12615 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "df31afec-a5b7-4b2a-a062-f489429c6fef" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.636s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:59:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-22e4f6ad-b01b-4ef2-ba1f-9e0cb2ca0ae0 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "df31afec-a5b7-4b2a-a062-f489429c6fef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.506s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:59:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-22e4f6ad-b01b-4ef2-ba1f-9e0cb2ca0ae0 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Acquiring lock "df31afec-a5b7-4b2a-a062-f489429c6fef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:59:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-22e4f6ad-b01b-4ef2-ba1f-9e0cb2ca0ae0 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "df31afec-a5b7-4b2a-a062-f489429c6fef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:59:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-22e4f6ad-b01b-4ef2-ba1f-9e0cb2ca0ae0 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "df31afec-a5b7-4b2a-a062-f489429c6fef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:59:46 user nova-compute[72444]: INFO nova.compute.manager [None req-22e4f6ad-b01b-4ef2-ba1f-9e0cb2ca0ae0 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Terminating instance
Aug 03 04:59:46 user nova-compute[72444]: DEBUG nova.compute.manager [None req-22e4f6ad-b01b-4ef2-ba1f-9e0cb2ca0ae0 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 04:59:46 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:46 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:46 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:46 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:46 user nova-compute[72444]: DEBUG nova.compute.manager [req-4d21cc33-7307-4878-a534-6a5739e49f96 req-ed6056b5-dd58-437d-aabe-3fcd8730cba8 service nova] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Received event network-vif-unplugged-97c29a7f-61e6-47c1-8eef-579f3c615e98 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:59:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4d21cc33-7307-4878-a534-6a5739e49f96 req-ed6056b5-dd58-437d-aabe-3fcd8730cba8 service nova] Acquiring lock "df31afec-a5b7-4b2a-a062-f489429c6fef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:59:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4d21cc33-7307-4878-a534-6a5739e49f96 req-ed6056b5-dd58-437d-aabe-3fcd8730cba8 service nova] Lock "df31afec-a5b7-4b2a-a062-f489429c6fef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:59:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4d21cc33-7307-4878-a534-6a5739e49f96 req-ed6056b5-dd58-437d-aabe-3fcd8730cba8 service nova] Lock "df31afec-a5b7-4b2a-a062-f489429c6fef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:59:46 user nova-compute[72444]: DEBUG nova.compute.manager [req-4d21cc33-7307-4878-a534-6a5739e49f96 req-ed6056b5-dd58-437d-aabe-3fcd8730cba8 service nova] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] No waiting events found dispatching network-vif-unplugged-97c29a7f-61e6-47c1-8eef-579f3c615e98 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:59:46 user nova-compute[72444]: DEBUG nova.compute.manager [req-4d21cc33-7307-4878-a534-6a5739e49f96 req-ed6056b5-dd58-437d-aabe-3fcd8730cba8 service nova] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Received event network-vif-unplugged-97c29a7f-61e6-47c1-8eef-579f3c615e98 for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:59:47 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Instance destroyed successfully.
Aug 03 04:59:47 user nova-compute[72444]: DEBUG nova.objects.instance [None req-22e4f6ad-b01b-4ef2-ba1f-9e0cb2ca0ae0 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lazy-loading 'resources' on Instance uuid df31afec-a5b7-4b2a-a062-f489429c6fef {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:59:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-22e4f6ad-b01b-4ef2-ba1f-9e0cb2ca0ae0 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:57:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-766125429',display_name='tempest-VolumesSnapshotTestJSON-instance-766125429',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-766125429',id=34,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3CUXBKR6/+O9UOzCZr/zSq9JZAmCVTSC0r22rJhaaKrzKiY/zgdlnb/kb2itAB2+nMYEqLeP8T6Wxv6z4a+cE4WZFvwETSdYgC6Rlx9JlYEyTyuuM1sV7pjcoEBEid3w==',key_name='tempest-keypair-1146252995',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:57:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ff54227e82764df6abd50b83068c64de',ramdisk_id='',reservation_id='r-9k7vkir4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1757877731',owner_user_name='tempest-VolumesSnapshotTestJSON-1757877731-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:57:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be669ca3889044c7920db180a9a82ae2',uuid=df31afec-a5b7-4b2a-a062-f489429c6fef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97c29a7f-61e6-47c1-8eef-579f3c615e98", "address": "fa:16:3e:aa:d9:50", "network": {"id": "81d682a4-018d-4927-866c-2b16d48f16e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-921368252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff54227e82764df6abd50b83068c64de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c29a7f-61", "ovs_interfaceid": "97c29a7f-61e6-47c1-8eef-579f3c615e98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:59:47 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-22e4f6ad-b01b-4ef2-ba1f-9e0cb2ca0ae0 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Converting VIF {"id": "97c29a7f-61e6-47c1-8eef-579f3c615e98", "address": "fa:16:3e:aa:d9:50", "network": {"id": "81d682a4-018d-4927-866c-2b16d48f16e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-921368252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff54227e82764df6abd50b83068c64de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c29a7f-61", "ovs_interfaceid": "97c29a7f-61e6-47c1-8eef-579f3c615e98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:59:47 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-22e4f6ad-b01b-4ef2-ba1f-9e0cb2ca0ae0 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:d9:50,bridge_name='br-int',has_traffic_filtering=True,id=97c29a7f-61e6-47c1-8eef-579f3c615e98,network=Network(81d682a4-018d-4927-866c-2b16d48f16e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97c29a7f-61') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:59:47 user nova-compute[72444]: DEBUG os_vif [None req-22e4f6ad-b01b-4ef2-ba1f-9e0cb2ca0ae0 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:d9:50,bridge_name='br-int',has_traffic_filtering=True,id=97c29a7f-61e6-47c1-8eef-579f3c615e98,network=Network(81d682a4-018d-4927-866c-2b16d48f16e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97c29a7f-61') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:59:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap97c29a7f-61, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:59:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:59:47 user nova-compute[72444]: INFO os_vif [None req-22e4f6ad-b01b-4ef2-ba1f-9e0cb2ca0ae0 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:d9:50,bridge_name='br-int',has_traffic_filtering=True,id=97c29a7f-61e6-47c1-8eef-579f3c615e98,network=Network(81d682a4-018d-4927-866c-2b16d48f16e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97c29a7f-61')
Aug 03 04:59:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22e4f6ad-b01b-4ef2-ba1f-9e0cb2ca0ae0 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 04:59:47 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e4f6ad-b01b-4ef2-ba1f-9e0cb2ca0ae0 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYfvEVwR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 04:59:47 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-22e4f6ad-b01b-4ef2-ba1f-9e0cb2ca0ae0 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 04:59:47 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-22e4f6ad-b01b-4ef2-ba1f-9e0cb2ca0ae0 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 04:59:47 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-22e4f6ad-b01b-4ef2-ba1f-9e0cb2ca0ae0 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 04:59:47 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e4f6ad-b01b-4ef2-ba1f-9e0cb2ca0ae0 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae102c75-de71-46e8-bb77-bcc04f42c08f', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 04:59:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:47 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8011c881-3419-4421-873e-c23fbc4aec6a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 04:59:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 04:59:47 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35b5254-9469-4f67-b79d-504adf03ea21]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 04:59:47 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e4f6ad-b01b-4ef2-ba1f-9e0cb2ca0ae0 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f (non-flash)
Aug 03 04:59:47 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 04:59:47 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e4f6ad-b01b-4ef2-ba1f-9e0cb2ca0ae0 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f (non-flash)
Aug 03 04:59:47 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 04:59:47 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e4f6ad-b01b-4ef2-ba1f-9e0cb2ca0ae0 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308c3c2560>, {}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 04:59:47 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e4f6ad-b01b-4ef2-ba1f-9e0cb2ca0ae0 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Disconnecting from: [] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 04:59:47 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-22e4f6ad-b01b-4ef2-ba1f-9e0cb2ca0ae0 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.046s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 04:59:47 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e4f6ad-b01b-4ef2-ba1f-9e0cb2ca0ae0 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] <== disconnect_volume: return (47ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 04:59:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22e4f6ad-b01b-4ef2-ba1f-9e0cb2ca0ae0 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 04:59:47 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-22e4f6ad-b01b-4ef2-ba1f-9e0cb2ca0ae0 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Deleting instance files /opt/stack/data/nova/instances/df31afec-a5b7-4b2a-a062-f489429c6fef_del
Aug 03 04:59:47 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-22e4f6ad-b01b-4ef2-ba1f-9e0cb2ca0ae0 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Deletion of /opt/stack/data/nova/instances/df31afec-a5b7-4b2a-a062-f489429c6fef_del complete
Aug 03 04:59:47 user nova-compute[72444]: INFO nova.compute.manager [None req-22e4f6ad-b01b-4ef2-ba1f-9e0cb2ca0ae0 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 03 04:59:47 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-22e4f6ad-b01b-4ef2-ba1f-9e0cb2ca0ae0 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 04:59:47 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 04:59:47 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 04:59:47 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691038772.3091657, 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 04:59:47 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] VM Stopped (Lifecycle Event)
Aug 03 04:59:47 user nova-compute[72444]: DEBUG nova.compute.manager [None req-8c793358-9d65-4c15-baee-2e0e4114036c None None] [instance: 2bd18bb9-bb4b-4e4d-99fc-78711f7a0e15] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 04:59:48 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:59:48 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Took 0.94 seconds to deallocate network for instance.
Aug 03 04:59:48 user nova-compute[72444]: DEBUG nova.compute.manager [req-e06483ec-40e1-4830-b38f-ef84f09264e0 req-d589106c-d9fc-469d-8d58-968b275ee77e service nova] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Received event network-vif-deleted-97c29a7f-61e6-47c1-8eef-579f3c615e98 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:59:48 user nova-compute[72444]: INFO nova.compute.manager [req-e06483ec-40e1-4830-b38f-ef84f09264e0 req-d589106c-d9fc-469d-8d58-968b275ee77e service nova] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Neutron deleted interface 97c29a7f-61e6-47c1-8eef-579f3c615e98; detaching it from the instance and deleting it from the info cache
Aug 03 04:59:48 user nova-compute[72444]: DEBUG nova.network.neutron [req-e06483ec-40e1-4830-b38f-ef84f09264e0 req-d589106c-d9fc-469d-8d58-968b275ee77e service nova] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:59:48 user nova-compute[72444]: DEBUG nova.compute.manager [req-e06483ec-40e1-4830-b38f-ef84f09264e0 req-d589106c-d9fc-469d-8d58-968b275ee77e service nova] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Detach interface failed, port_id=97c29a7f-61e6-47c1-8eef-579f3c615e98, reason: Instance df31afec-a5b7-4b2a-a062-f489429c6fef could not be found. {{(pid=72444) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 03 04:59:48 user nova-compute[72444]: WARNING nova.volume.cinder [None req-22e4f6ad-b01b-4ef2-ba1f-9e0cb2ca0ae0 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Attachment 011d6718-46b8-4893-a021-30c8f31682b6 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 011d6718-46b8-4893-a021-30c8f31682b6. (HTTP 404) (Request-ID: req-a6add34d-4227-4bcb-9d43-d3c184009a9a)
Aug 03 04:59:48 user nova-compute[72444]: INFO nova.compute.manager [None req-22e4f6ad-b01b-4ef2-ba1f-9e0cb2ca0ae0 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Took 0.03 seconds to detach 1 volumes for instance.
Aug 03 04:59:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-22e4f6ad-b01b-4ef2-ba1f-9e0cb2ca0ae0 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:59:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-22e4f6ad-b01b-4ef2-ba1f-9e0cb2ca0ae0 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:59:48 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-22e4f6ad-b01b-4ef2-ba1f-9e0cb2ca0ae0 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:59:48 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-22e4f6ad-b01b-4ef2-ba1f-9e0cb2ca0ae0 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:59:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-22e4f6ad-b01b-4ef2-ba1f-9e0cb2ca0ae0 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.205s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:59:48 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-22e4f6ad-b01b-4ef2-ba1f-9e0cb2ca0ae0 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Deleted allocations for instance df31afec-a5b7-4b2a-a062-f489429c6fef
Aug 03 04:59:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-22e4f6ad-b01b-4ef2-ba1f-9e0cb2ca0ae0 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "df31afec-a5b7-4b2a-a062-f489429c6fef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.257s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:59:48 user nova-compute[72444]: DEBUG nova.compute.manager [req-8a0cda2e-b762-4975-8bc2-03d4cad117ca req-ea454b61-fe9a-4c7f-b492-b97e92f03b5e service nova] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Received event network-vif-plugged-97c29a7f-61e6-47c1-8eef-579f3c615e98 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:59:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8a0cda2e-b762-4975-8bc2-03d4cad117ca req-ea454b61-fe9a-4c7f-b492-b97e92f03b5e service nova] Acquiring lock "df31afec-a5b7-4b2a-a062-f489429c6fef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:59:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8a0cda2e-b762-4975-8bc2-03d4cad117ca req-ea454b61-fe9a-4c7f-b492-b97e92f03b5e service nova] Lock "df31afec-a5b7-4b2a-a062-f489429c6fef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:59:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8a0cda2e-b762-4975-8bc2-03d4cad117ca req-ea454b61-fe9a-4c7f-b492-b97e92f03b5e service nova] Lock "df31afec-a5b7-4b2a-a062-f489429c6fef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:59:48 user nova-compute[72444]: DEBUG nova.compute.manager [req-8a0cda2e-b762-4975-8bc2-03d4cad117ca req-ea454b61-fe9a-4c7f-b492-b97e92f03b5e service nova] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] No waiting events found dispatching network-vif-plugged-97c29a7f-61e6-47c1-8eef-579f3c615e98 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:59:48 user nova-compute[72444]: WARNING nova.compute.manager [req-8a0cda2e-b762-4975-8bc2-03d4cad117ca req-ea454b61-fe9a-4c7f-b492-b97e92f03b5e service nova] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Received unexpected event network-vif-plugged-97c29a7f-61e6-47c1-8eef-579f3c615e98 for instance with vm_state deleted and task_state None.
Aug 03 04:59:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:51 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:59:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:54 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:59:54 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:59:54 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 04:59:55 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:59:57 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:59:57 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:57 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 04:59:57 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 04:59:57 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 04:59:57 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ff8089e0-8c7a-4384-a4e6-38c43d77e02a tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Acquiring lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:59:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ff8089e0-8c7a-4384-a4e6-38c43d77e02a tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:59:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ff8089e0-8c7a-4384-a4e6-38c43d77e02a tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Acquiring lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:59:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ff8089e0-8c7a-4384-a4e6-38c43d77e02a tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:59:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ff8089e0-8c7a-4384-a4e6-38c43d77e02a tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:59:57 user nova-compute[72444]: INFO nova.compute.manager [None req-ff8089e0-8c7a-4384-a4e6-38c43d77e02a tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Terminating instance
Aug 03 04:59:57 user nova-compute[72444]: DEBUG nova.compute.manager [None req-ff8089e0-8c7a-4384-a4e6-38c43d77e02a tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 04:59:57 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:57 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:57 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:57 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:57 user nova-compute[72444]: DEBUG nova.compute.manager [req-97c87afc-550e-4801-bd42-9dacdbcbfdda req-3533ebab-89bb-4bfd-b4e5-9df9dc6a4acd service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Received event network-vif-unplugged-7a41fc62-2272-4198-99cb-19d77d1dc193 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:59:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-97c87afc-550e-4801-bd42-9dacdbcbfdda req-3533ebab-89bb-4bfd-b4e5-9df9dc6a4acd service nova] Acquiring lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:59:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-97c87afc-550e-4801-bd42-9dacdbcbfdda req-3533ebab-89bb-4bfd-b4e5-9df9dc6a4acd service nova] Lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:59:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-97c87afc-550e-4801-bd42-9dacdbcbfdda req-3533ebab-89bb-4bfd-b4e5-9df9dc6a4acd service nova] Lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:59:57 user nova-compute[72444]: DEBUG nova.compute.manager [req-97c87afc-550e-4801-bd42-9dacdbcbfdda req-3533ebab-89bb-4bfd-b4e5-9df9dc6a4acd service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] No waiting events found dispatching network-vif-unplugged-7a41fc62-2272-4198-99cb-19d77d1dc193 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:59:57 user nova-compute[72444]: DEBUG nova.compute.manager [req-97c87afc-550e-4801-bd42-9dacdbcbfdda req-3533ebab-89bb-4bfd-b4e5-9df9dc6a4acd service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Received event network-vif-unplugged-7a41fc62-2272-4198-99cb-19d77d1dc193 for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 04:59:58 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Instance destroyed successfully.
Aug 03 04:59:58 user nova-compute[72444]: DEBUG nova.objects.instance [None req-ff8089e0-8c7a-4384-a4e6-38c43d77e02a tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lazy-loading 'resources' on Instance uuid 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 04:59:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-ff8089e0-8c7a-4384-a4e6-38c43d77e02a tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:52:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1025958151',display_name='tempest-ServerStableDeviceRescueTest-server-1025958151',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1025958151',id=30,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4jDFxvmvEZS4Z7JXz0hT1lDcLp6u3gZwEbKEc2hoK4M3fMHWAWzjuuHOscgaraFZ39VjXIwo94mfkQIR25KIRAWCbmQSZmJCp9YRgX8UCvMh39yqLkLrbMM3cXGBxglg==',key_name='tempest-keypair-1152104865',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:56:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c08ed53988ee44a081db4223ad0a9264',ramdisk_id='',reservation_id='r-tum413w7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-849887263',owner_user_name='tempest-ServerStableDeviceRescueTest-849887263-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:58:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0747a6dda85f48ddbcc4564bc5980b99',uuid=27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a41fc62-2272-4198-99cb-19d77d1dc193", "address": "fa:16:3e:68:ec:25", "network": {"id": "d132f1d9-d7bd-4630-bd3d-e911f43d14bb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1090455023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08ed53988ee44a081db4223ad0a9264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a41fc62-22", "ovs_interfaceid": "7a41fc62-2272-4198-99cb-19d77d1dc193", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 04:59:58 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-ff8089e0-8c7a-4384-a4e6-38c43d77e02a tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Converting VIF {"id": "7a41fc62-2272-4198-99cb-19d77d1dc193", "address": "fa:16:3e:68:ec:25", "network": {"id": "d132f1d9-d7bd-4630-bd3d-e911f43d14bb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1090455023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08ed53988ee44a081db4223ad0a9264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a41fc62-22", "ovs_interfaceid": "7a41fc62-2272-4198-99cb-19d77d1dc193", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 04:59:58 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-ff8089e0-8c7a-4384-a4e6-38c43d77e02a tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:ec:25,bridge_name='br-int',has_traffic_filtering=True,id=7a41fc62-2272-4198-99cb-19d77d1dc193,network=Network(d132f1d9-d7bd-4630-bd3d-e911f43d14bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a41fc62-22') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 04:59:58 user nova-compute[72444]: DEBUG os_vif [None req-ff8089e0-8c7a-4384-a4e6-38c43d77e02a tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:ec:25,bridge_name='br-int',has_traffic_filtering=True,id=7a41fc62-2272-4198-99cb-19d77d1dc193,network=Network(d132f1d9-d7bd-4630-bd3d-e911f43d14bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a41fc62-22') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 04:59:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a41fc62-22, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 04:59:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 04:59:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 04:59:58 user nova-compute[72444]: INFO os_vif [None req-ff8089e0-8c7a-4384-a4e6-38c43d77e02a tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:ec:25,bridge_name='br-int',has_traffic_filtering=True,id=7a41fc62-2272-4198-99cb-19d77d1dc193,network=Network(d132f1d9-d7bd-4630-bd3d-e911f43d14bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a41fc62-22')
Aug 03 04:59:58 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-ff8089e0-8c7a-4384-a4e6-38c43d77e02a tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Deleting instance files /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0_del
Aug 03 04:59:58 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-ff8089e0-8c7a-4384-a4e6-38c43d77e02a tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Deletion of /opt/stack/data/nova/instances/27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0_del complete
Aug 03 04:59:58 user nova-compute[72444]: INFO nova.compute.manager [None req-ff8089e0-8c7a-4384-a4e6-38c43d77e02a tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 03 04:59:58 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-ff8089e0-8c7a-4384-a4e6-38c43d77e02a tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 04:59:58 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 04:59:58 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 04:59:58 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 04:59:58 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Took 0.80 seconds to deallocate network for instance.
Aug 03 04:59:58 user nova-compute[72444]: DEBUG nova.compute.manager [req-51d1ffb6-b891-4fab-804b-e1d61397cfd9 req-b41af9f5-2ede-4818-9503-b95f262fc3ab service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Received event network-vif-deleted-7a41fc62-2272-4198-99cb-19d77d1dc193 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:59:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ff8089e0-8c7a-4384-a4e6-38c43d77e02a tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:59:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ff8089e0-8c7a-4384-a4e6-38c43d77e02a tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:59:59 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-ff8089e0-8c7a-4384-a4e6-38c43d77e02a tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 04:59:59 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-ff8089e0-8c7a-4384-a4e6-38c43d77e02a tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 04:59:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ff8089e0-8c7a-4384-a4e6-38c43d77e02a tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.240s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:59:59 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-ff8089e0-8c7a-4384-a4e6-38c43d77e02a tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Deleted allocations for instance 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0
Aug 03 04:59:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ff8089e0-8c7a-4384-a4e6-38c43d77e02a tempest-ServerStableDeviceRescueTest-849887263 tempest-ServerStableDeviceRescueTest-849887263-project-member] Lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.062s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:59:59 user nova-compute[72444]: DEBUG nova.compute.manager [req-ec884bf7-6c0b-483f-ab14-21a7bacb6f4f req-cfed1b6a-0237-47b0-9be4-9acd8e3dde9a service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Received event network-vif-plugged-7a41fc62-2272-4198-99cb-19d77d1dc193 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 04:59:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ec884bf7-6c0b-483f-ab14-21a7bacb6f4f req-cfed1b6a-0237-47b0-9be4-9acd8e3dde9a service nova] Acquiring lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 04:59:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ec884bf7-6c0b-483f-ab14-21a7bacb6f4f req-cfed1b6a-0237-47b0-9be4-9acd8e3dde9a service nova] Lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 04:59:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ec884bf7-6c0b-483f-ab14-21a7bacb6f4f req-cfed1b6a-0237-47b0-9be4-9acd8e3dde9a service nova] Lock "27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 04:59:59 user nova-compute[72444]: DEBUG nova.compute.manager [req-ec884bf7-6c0b-483f-ab14-21a7bacb6f4f req-cfed1b6a-0237-47b0-9be4-9acd8e3dde9a service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] No waiting events found dispatching network-vif-plugged-7a41fc62-2272-4198-99cb-19d77d1dc193 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 04:59:59 user nova-compute[72444]: WARNING nova.compute.manager [req-ec884bf7-6c0b-483f-ab14-21a7bacb6f4f req-cfed1b6a-0237-47b0-9be4-9acd8e3dde9a service nova] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Received unexpected event network-vif-plugged-7a41fc62-2272-4198-99cb-19d77d1dc193 for instance with vm_state deleted and task_state None.
Aug 03 04:59:59 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 04:59:59 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:00:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-ae41789a-ebd1-4265-a903-32d2006e66d1" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:00:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-ae41789a-ebd1-4265-a903-32d2006e66d1" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:00:00 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 05:00:00 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Updating instance_info_cache with network_info: [{"id": "37b60bd1-1877-4cd1-833b-4db852dbe1f8", "address": "fa:16:3e:a9:bc:76", "network": {"id": "bb35bc76-087b-4468-ba0c-3637873207f8", "bridge": "br-int", "label": "tempest-TestStampPattern-620416114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d114efe1dfc1424299621df67bf00863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b60bd1-18", "ovs_interfaceid": "37b60bd1-1877-4cd1-833b-4db852dbe1f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:00:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-ae41789a-ebd1-4265-a903-32d2006e66d1" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:00:00 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 05:00:00 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:00:00 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:00:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:00:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:00:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:00:00 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:00:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:00:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:00:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:00:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:00:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:00:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:00:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:00:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:00:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:00:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:00:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:00:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:00:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:00:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:00:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:00:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:00:01 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 05:00:02 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691038787.05146, df31afec-a5b7-4b2a-a062-f489429c6fef => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:00:02 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] VM Stopped (Lifecycle Event)
Aug 03 05:00:02 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:00:02 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:00:02 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=8061MB free_disk=25.262115478515625GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:00:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:00:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:00:02 user nova-compute[72444]: DEBUG nova.compute.manager [None req-396d00b9-dd01-44ef-ab8c-b86d4a040646 None None] [instance: df31afec-a5b7-4b2a-a062-f489429c6fef] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:00:02 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 81725845-6158-4e34-bedb-6e41219bc227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:00:02 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance ae41789a-ebd1-4265-a903-32d2006e66d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:00:02 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance a9b960cb-39bd-4f31-9920-5ce31d5db139 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:00:02 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 4f225dc2-3011-4c15-bb8e-1ebb079a3b50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:00:02 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:00:02 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:00:02 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:00:02 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:00:02 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:00:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.299s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:00:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:04 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:00:04 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:00:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:13 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691038798.076805, 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:00:13 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] VM Stopped (Lifecycle Event)
Aug 03 05:00:13 user nova-compute[72444]: DEBUG nova.compute.manager [None req-eb61290b-c8b8-4697-a7b5-c1cb9a15e3b2 None None] [instance: 27a472f1-bfc9-4b5a-847d-4f21e0bbe9d0] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:00:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:00:15 user nova-compute[72444]: DEBUG nova.compute.manager [req-3569f7da-0832-439d-8ccf-aa23d3598cb5 req-ed33fd92-1598-4f8e-ab7b-d1984b7b0e53 service nova] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Received event network-changed-37b60bd1-1877-4cd1-833b-4db852dbe1f8 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:00:15 user nova-compute[72444]: DEBUG nova.compute.manager [req-3569f7da-0832-439d-8ccf-aa23d3598cb5 req-ed33fd92-1598-4f8e-ab7b-d1984b7b0e53 service nova] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Refreshing instance network info cache due to event network-changed-37b60bd1-1877-4cd1-833b-4db852dbe1f8. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:00:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3569f7da-0832-439d-8ccf-aa23d3598cb5 req-ed33fd92-1598-4f8e-ab7b-d1984b7b0e53 service nova] Acquiring lock "refresh_cache-ae41789a-ebd1-4265-a903-32d2006e66d1" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:00:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3569f7da-0832-439d-8ccf-aa23d3598cb5 req-ed33fd92-1598-4f8e-ab7b-d1984b7b0e53 service nova] Acquired lock "refresh_cache-ae41789a-ebd1-4265-a903-32d2006e66d1" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:00:15 user nova-compute[72444]: DEBUG nova.network.neutron [req-3569f7da-0832-439d-8ccf-aa23d3598cb5 req-ed33fd92-1598-4f8e-ab7b-d1984b7b0e53 service nova] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Refreshing network info cache for port 37b60bd1-1877-4cd1-833b-4db852dbe1f8 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:00:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-6450b7d4-ccc9-4394-afcd-a12469c0c2aa tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Acquiring lock "ae41789a-ebd1-4265-a903-32d2006e66d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:00:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-6450b7d4-ccc9-4394-afcd-a12469c0c2aa tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "ae41789a-ebd1-4265-a903-32d2006e66d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:00:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-6450b7d4-ccc9-4394-afcd-a12469c0c2aa tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Acquiring lock "ae41789a-ebd1-4265-a903-32d2006e66d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:00:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-6450b7d4-ccc9-4394-afcd-a12469c0c2aa tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "ae41789a-ebd1-4265-a903-32d2006e66d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:00:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-6450b7d4-ccc9-4394-afcd-a12469c0c2aa tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "ae41789a-ebd1-4265-a903-32d2006e66d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:00:15 user nova-compute[72444]: INFO nova.compute.manager [None req-6450b7d4-ccc9-4394-afcd-a12469c0c2aa tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Terminating instance
Aug 03 05:00:15 user nova-compute[72444]: DEBUG nova.compute.manager [None req-6450b7d4-ccc9-4394-afcd-a12469c0c2aa tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 05:00:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:16 user nova-compute[72444]: DEBUG nova.compute.manager [req-578771f0-a3cd-4281-9476-ac75e6a8c75f req-1d961ba1-2f4e-493d-91fc-8d5a1e560526 service nova] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Received event network-vif-unplugged-37b60bd1-1877-4cd1-833b-4db852dbe1f8 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:00:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-578771f0-a3cd-4281-9476-ac75e6a8c75f req-1d961ba1-2f4e-493d-91fc-8d5a1e560526 service nova] Acquiring lock "ae41789a-ebd1-4265-a903-32d2006e66d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:00:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-578771f0-a3cd-4281-9476-ac75e6a8c75f req-1d961ba1-2f4e-493d-91fc-8d5a1e560526 service nova] Lock "ae41789a-ebd1-4265-a903-32d2006e66d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:00:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-578771f0-a3cd-4281-9476-ac75e6a8c75f req-1d961ba1-2f4e-493d-91fc-8d5a1e560526 service nova] Lock "ae41789a-ebd1-4265-a903-32d2006e66d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:00:16 user nova-compute[72444]: DEBUG nova.compute.manager [req-578771f0-a3cd-4281-9476-ac75e6a8c75f req-1d961ba1-2f4e-493d-91fc-8d5a1e560526 service nova] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] No waiting events found dispatching network-vif-unplugged-37b60bd1-1877-4cd1-833b-4db852dbe1f8 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:00:16 user nova-compute[72444]: DEBUG nova.compute.manager [req-578771f0-a3cd-4281-9476-ac75e6a8c75f req-1d961ba1-2f4e-493d-91fc-8d5a1e560526 service nova] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Received event network-vif-unplugged-37b60bd1-1877-4cd1-833b-4db852dbe1f8 for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 05:00:16 user nova-compute[72444]: DEBUG nova.network.neutron [req-3569f7da-0832-439d-8ccf-aa23d3598cb5 req-ed33fd92-1598-4f8e-ab7b-d1984b7b0e53 service nova] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Updated VIF entry in instance network info cache for port 37b60bd1-1877-4cd1-833b-4db852dbe1f8. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:00:16 user nova-compute[72444]: DEBUG nova.network.neutron [req-3569f7da-0832-439d-8ccf-aa23d3598cb5 req-ed33fd92-1598-4f8e-ab7b-d1984b7b0e53 service nova] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Updating instance_info_cache with network_info: [{"id": "37b60bd1-1877-4cd1-833b-4db852dbe1f8", "address": "fa:16:3e:a9:bc:76", "network": {"id": "bb35bc76-087b-4468-ba0c-3637873207f8", "bridge": "br-int", "label": "tempest-TestStampPattern-620416114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d114efe1dfc1424299621df67bf00863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b60bd1-18", "ovs_interfaceid": "37b60bd1-1877-4cd1-833b-4db852dbe1f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:00:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3569f7da-0832-439d-8ccf-aa23d3598cb5 req-ed33fd92-1598-4f8e-ab7b-d1984b7b0e53 service nova] Releasing lock "refresh_cache-ae41789a-ebd1-4265-a903-32d2006e66d1" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:00:16 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Instance destroyed successfully.
Aug 03 05:00:16 user nova-compute[72444]: DEBUG nova.objects.instance [None req-6450b7d4-ccc9-4394-afcd-a12469c0c2aa tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lazy-loading 'resources' on Instance uuid ae41789a-ebd1-4265-a903-32d2006e66d1 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:00:16 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-6450b7d4-ccc9-4394-afcd-a12469c0c2aa tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:52:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1428763732',display_name='tempest-TestStampPattern-server-1428763732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1428763732',id=31,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0MFXjSU5PJXVROOnqeclCBxvU1Uyrwrp4WGd6L7LODOpU9OooUOpH73m523qz3COWVGWjrJJsa98O/ExJkhRZGY7wvCQTS/3+V2FidnkreOl/H1zHbvv0lhsewf7GMag==',key_name='tempest-TestStampPattern-164301022',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:53:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d114efe1dfc1424299621df67bf00863',ramdisk_id='',reservation_id='r-bbk5plvj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-786118238',owner_user_name='tempest-TestStampPattern-786118238-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:56:12Z,user_data=None,user_id='cfb2412d135d4e45b5b1c2edf63a560c',uuid=ae41789a-ebd1-4265-a903-32d2006e66d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37b60bd1-1877-4cd1-833b-4db852dbe1f8", "address": "fa:16:3e:a9:bc:76", "network": {"id": "bb35bc76-087b-4468-ba0c-3637873207f8", "bridge": "br-int", "label": "tempest-TestStampPattern-620416114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d114efe1dfc1424299621df67bf00863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b60bd1-18", "ovs_interfaceid": "37b60bd1-1877-4cd1-833b-4db852dbe1f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 05:00:16 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-6450b7d4-ccc9-4394-afcd-a12469c0c2aa tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Converting VIF {"id": "37b60bd1-1877-4cd1-833b-4db852dbe1f8", "address": "fa:16:3e:a9:bc:76", "network": {"id": "bb35bc76-087b-4468-ba0c-3637873207f8", "bridge": "br-int", "label": "tempest-TestStampPattern-620416114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d114efe1dfc1424299621df67bf00863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b60bd1-18", "ovs_interfaceid": "37b60bd1-1877-4cd1-833b-4db852dbe1f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:00:16 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-6450b7d4-ccc9-4394-afcd-a12469c0c2aa tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:bc:76,bridge_name='br-int',has_traffic_filtering=True,id=37b60bd1-1877-4cd1-833b-4db852dbe1f8,network=Network(bb35bc76-087b-4468-ba0c-3637873207f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37b60bd1-18') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:00:16 user nova-compute[72444]: DEBUG os_vif [None req-6450b7d4-ccc9-4394-afcd-a12469c0c2aa tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:bc:76,bridge_name='br-int',has_traffic_filtering=True,id=37b60bd1-1877-4cd1-833b-4db852dbe1f8,network=Network(bb35bc76-087b-4468-ba0c-3637873207f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37b60bd1-18') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 05:00:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37b60bd1-18, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:00:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:00:16 user nova-compute[72444]: INFO os_vif [None req-6450b7d4-ccc9-4394-afcd-a12469c0c2aa tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:bc:76,bridge_name='br-int',has_traffic_filtering=True,id=37b60bd1-1877-4cd1-833b-4db852dbe1f8,network=Network(bb35bc76-087b-4468-ba0c-3637873207f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37b60bd1-18')
Aug 03 05:00:16 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-6450b7d4-ccc9-4394-afcd-a12469c0c2aa tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Deleting instance files /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1_del
Aug 03 05:00:16 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-6450b7d4-ccc9-4394-afcd-a12469c0c2aa tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Deletion of /opt/stack/data/nova/instances/ae41789a-ebd1-4265-a903-32d2006e66d1_del complete
Aug 03 05:00:16 user nova-compute[72444]: INFO nova.compute.manager [None req-6450b7d4-ccc9-4394-afcd-a12469c0c2aa tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 03 05:00:16 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-6450b7d4-ccc9-4394-afcd-a12469c0c2aa tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 05:00:16 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 05:00:16 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 05:00:17 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:00:17 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Took 0.48 seconds to deallocate network for instance.
Aug 03 05:00:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-6450b7d4-ccc9-4394-afcd-a12469c0c2aa tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:00:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-6450b7d4-ccc9-4394-afcd-a12469c0c2aa tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:00:17 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-6450b7d4-ccc9-4394-afcd-a12469c0c2aa tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:00:17 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-6450b7d4-ccc9-4394-afcd-a12469c0c2aa tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:00:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-6450b7d4-ccc9-4394-afcd-a12469c0c2aa tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.238s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:00:17 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-6450b7d4-ccc9-4394-afcd-a12469c0c2aa tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Deleted allocations for instance ae41789a-ebd1-4265-a903-32d2006e66d1
Aug 03 05:00:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-6450b7d4-ccc9-4394-afcd-a12469c0c2aa tempest-TestStampPattern-786118238 tempest-TestStampPattern-786118238-project-member] Lock "ae41789a-ebd1-4265-a903-32d2006e66d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.802s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:00:17 user nova-compute[72444]: DEBUG nova.compute.manager [req-c6190c32-154f-4c8a-aac2-a61e5522af89 req-d55aa2f7-6e1f-47ad-84e3-7cb0d92eed37 service nova] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Received event network-vif-deleted-37b60bd1-1877-4cd1-833b-4db852dbe1f8 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:00:18 user nova-compute[72444]: DEBUG nova.compute.manager [req-b777175f-f03e-4f11-a068-2bd31d26f2a3 req-7102a793-3a7f-4a87-9af7-eaf635a427f1 service nova] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Received event network-vif-plugged-37b60bd1-1877-4cd1-833b-4db852dbe1f8 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:00:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b777175f-f03e-4f11-a068-2bd31d26f2a3 req-7102a793-3a7f-4a87-9af7-eaf635a427f1 service nova] Acquiring lock "ae41789a-ebd1-4265-a903-32d2006e66d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:00:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b777175f-f03e-4f11-a068-2bd31d26f2a3 req-7102a793-3a7f-4a87-9af7-eaf635a427f1 service nova] Lock "ae41789a-ebd1-4265-a903-32d2006e66d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:00:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b777175f-f03e-4f11-a068-2bd31d26f2a3 req-7102a793-3a7f-4a87-9af7-eaf635a427f1 service nova] Lock "ae41789a-ebd1-4265-a903-32d2006e66d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:00:18 user nova-compute[72444]: DEBUG nova.compute.manager [req-b777175f-f03e-4f11-a068-2bd31d26f2a3 req-7102a793-3a7f-4a87-9af7-eaf635a427f1 service nova] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] No waiting events found dispatching network-vif-plugged-37b60bd1-1877-4cd1-833b-4db852dbe1f8 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:00:18 user nova-compute[72444]: WARNING nova.compute.manager [req-b777175f-f03e-4f11-a068-2bd31d26f2a3 req-7102a793-3a7f-4a87-9af7-eaf635a427f1 service nova] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Received unexpected event network-vif-plugged-37b60bd1-1877-4cd1-833b-4db852dbe1f8 for instance with vm_state deleted and task_state None.
Aug 03 05:00:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5118edae-5364-4b43-b3fa-4d3b3d3f2e00 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "81725845-6158-4e34-bedb-6e41219bc227" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:00:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5118edae-5364-4b43-b3fa-4d3b3d3f2e00 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "81725845-6158-4e34-bedb-6e41219bc227" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:00:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5118edae-5364-4b43-b3fa-4d3b3d3f2e00 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "81725845-6158-4e34-bedb-6e41219bc227-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:00:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5118edae-5364-4b43-b3fa-4d3b3d3f2e00 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "81725845-6158-4e34-bedb-6e41219bc227-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:00:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5118edae-5364-4b43-b3fa-4d3b3d3f2e00 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "81725845-6158-4e34-bedb-6e41219bc227-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:00:22 user nova-compute[72444]: INFO nova.compute.manager [None req-5118edae-5364-4b43-b3fa-4d3b3d3f2e00 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Terminating instance
Aug 03 05:00:22 user nova-compute[72444]: DEBUG nova.compute.manager [None req-5118edae-5364-4b43-b3fa-4d3b3d3f2e00 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 05:00:22 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:22 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:22 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:22 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:22 user nova-compute[72444]: DEBUG nova.compute.manager [req-404650eb-197f-4a1c-8b64-d15759ae2436 req-84b86fd3-cd63-431b-bbfa-6ec0ff9cffeb service nova] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Received event network-vif-unplugged-9b1b9675-c2df-4b16-ba94-807765bab119 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:00:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-404650eb-197f-4a1c-8b64-d15759ae2436 req-84b86fd3-cd63-431b-bbfa-6ec0ff9cffeb service nova] Acquiring lock "81725845-6158-4e34-bedb-6e41219bc227-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:00:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-404650eb-197f-4a1c-8b64-d15759ae2436 req-84b86fd3-cd63-431b-bbfa-6ec0ff9cffeb service nova] Lock "81725845-6158-4e34-bedb-6e41219bc227-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:00:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-404650eb-197f-4a1c-8b64-d15759ae2436 req-84b86fd3-cd63-431b-bbfa-6ec0ff9cffeb service nova] Lock "81725845-6158-4e34-bedb-6e41219bc227-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:00:22 user nova-compute[72444]: DEBUG nova.compute.manager [req-404650eb-197f-4a1c-8b64-d15759ae2436 req-84b86fd3-cd63-431b-bbfa-6ec0ff9cffeb service nova] [instance: 81725845-6158-4e34-bedb-6e41219bc227] No waiting events found dispatching network-vif-unplugged-9b1b9675-c2df-4b16-ba94-807765bab119 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:00:22 user nova-compute[72444]: DEBUG nova.compute.manager [req-404650eb-197f-4a1c-8b64-d15759ae2436 req-84b86fd3-cd63-431b-bbfa-6ec0ff9cffeb service nova] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Received event network-vif-unplugged-9b1b9675-c2df-4b16-ba94-807765bab119 for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 05:00:22 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:22 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:23 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Instance destroyed successfully.
Aug 03 05:00:23 user nova-compute[72444]: DEBUG nova.objects.instance [None req-5118edae-5364-4b43-b3fa-4d3b3d3f2e00 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lazy-loading 'resources' on Instance uuid 81725845-6158-4e34-bedb-6e41219bc227 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:00:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:23 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-5118edae-5364-4b43-b3fa-4d3b3d3f2e00 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:40:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-703918171',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-703918171',id=2,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:41:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='929fd4a3127b475282426d4412e58def',ramdisk_id='',reservation_id='r-zxan9wua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1082770125',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:42:39Z,user_data=None,user_id='ceede92aa3a74060a7f57d29d0d97aee',uuid=81725845-6158-4e34-bedb-6e41219bc227,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b1b9675-c2df-4b16-ba94-807765bab119", "address": "fa:16:3e:e6:7a:2e", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b1b9675-c2", "ovs_interfaceid": "9b1b9675-c2df-4b16-ba94-807765bab119", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 05:00:23 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-5118edae-5364-4b43-b3fa-4d3b3d3f2e00 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Converting VIF {"id": "9b1b9675-c2df-4b16-ba94-807765bab119", "address": "fa:16:3e:e6:7a:2e", "network": {"id": "0e8b3ddd-e35a-45eb-a34c-614654c25549", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1270931937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "929fd4a3127b475282426d4412e58def", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b1b9675-c2", "ovs_interfaceid": "9b1b9675-c2df-4b16-ba94-807765bab119", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:00:23 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-5118edae-5364-4b43-b3fa-4d3b3d3f2e00 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:7a:2e,bridge_name='br-int',has_traffic_filtering=True,id=9b1b9675-c2df-4b16-ba94-807765bab119,network=Network(0e8b3ddd-e35a-45eb-a34c-614654c25549),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b1b9675-c2') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:00:23 user nova-compute[72444]: DEBUG os_vif [None req-5118edae-5364-4b43-b3fa-4d3b3d3f2e00 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:7a:2e,bridge_name='br-int',has_traffic_filtering=True,id=9b1b9675-c2df-4b16-ba94-807765bab119,network=Network(0e8b3ddd-e35a-45eb-a34c-614654c25549),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b1b9675-c2') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 05:00:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b1b9675-c2, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:00:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:00:23 user nova-compute[72444]: INFO os_vif [None req-5118edae-5364-4b43-b3fa-4d3b3d3f2e00 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:7a:2e,bridge_name='br-int',has_traffic_filtering=True,id=9b1b9675-c2df-4b16-ba94-807765bab119,network=Network(0e8b3ddd-e35a-45eb-a34c-614654c25549),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b1b9675-c2')
Aug 03 05:00:23 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-5118edae-5364-4b43-b3fa-4d3b3d3f2e00 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Deleting instance files /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227_del
Aug 03 05:00:23 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-5118edae-5364-4b43-b3fa-4d3b3d3f2e00 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Deletion of /opt/stack/data/nova/instances/81725845-6158-4e34-bedb-6e41219bc227_del complete
Aug 03 05:00:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:23 user nova-compute[72444]: INFO nova.compute.manager [None req-5118edae-5364-4b43-b3fa-4d3b3d3f2e00 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 03 05:00:23 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-5118edae-5364-4b43-b3fa-4d3b3d3f2e00 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 05:00:23 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 05:00:23 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 81725845-6158-4e34-bedb-6e41219bc227] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 05:00:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:24 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:00:24 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Took 1.14 seconds to deallocate network for instance.
Aug 03 05:00:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5118edae-5364-4b43-b3fa-4d3b3d3f2e00 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:00:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5118edae-5364-4b43-b3fa-4d3b3d3f2e00 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:00:24 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-5118edae-5364-4b43-b3fa-4d3b3d3f2e00 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:00:24 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-5118edae-5364-4b43-b3fa-4d3b3d3f2e00 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:00:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5118edae-5364-4b43-b3fa-4d3b3d3f2e00 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.161s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:00:24 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-5118edae-5364-4b43-b3fa-4d3b3d3f2e00 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Deleted allocations for instance 81725845-6158-4e34-bedb-6e41219bc227
Aug 03 05:00:24 user nova-compute[72444]: DEBUG nova.compute.manager [req-71270489-d1e0-4cc6-9eb0-bcfe31219b07 req-0bdcfd29-2072-420a-aa3c-a5f35e231b78 service nova] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Received event network-vif-plugged-9b1b9675-c2df-4b16-ba94-807765bab119 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:00:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-71270489-d1e0-4cc6-9eb0-bcfe31219b07 req-0bdcfd29-2072-420a-aa3c-a5f35e231b78 service nova] Acquiring lock "81725845-6158-4e34-bedb-6e41219bc227-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:00:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-71270489-d1e0-4cc6-9eb0-bcfe31219b07 req-0bdcfd29-2072-420a-aa3c-a5f35e231b78 service nova] Lock "81725845-6158-4e34-bedb-6e41219bc227-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:00:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-71270489-d1e0-4cc6-9eb0-bcfe31219b07 req-0bdcfd29-2072-420a-aa3c-a5f35e231b78 service nova] Lock "81725845-6158-4e34-bedb-6e41219bc227-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:00:24 user nova-compute[72444]: DEBUG nova.compute.manager [req-71270489-d1e0-4cc6-9eb0-bcfe31219b07 req-0bdcfd29-2072-420a-aa3c-a5f35e231b78 service nova] [instance: 81725845-6158-4e34-bedb-6e41219bc227] No waiting events found dispatching network-vif-plugged-9b1b9675-c2df-4b16-ba94-807765bab119 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:00:24 user nova-compute[72444]: WARNING nova.compute.manager [req-71270489-d1e0-4cc6-9eb0-bcfe31219b07 req-0bdcfd29-2072-420a-aa3c-a5f35e231b78 service nova] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Received unexpected event network-vif-plugged-9b1b9675-c2df-4b16-ba94-807765bab119 for instance with vm_state deleted and task_state None.
Aug 03 05:00:24 user nova-compute[72444]: DEBUG nova.compute.manager [req-71270489-d1e0-4cc6-9eb0-bcfe31219b07 req-0bdcfd29-2072-420a-aa3c-a5f35e231b78 service nova] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Received event network-vif-plugged-9b1b9675-c2df-4b16-ba94-807765bab119 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:00:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-71270489-d1e0-4cc6-9eb0-bcfe31219b07 req-0bdcfd29-2072-420a-aa3c-a5f35e231b78 service nova] Acquiring lock "81725845-6158-4e34-bedb-6e41219bc227-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:00:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-71270489-d1e0-4cc6-9eb0-bcfe31219b07 req-0bdcfd29-2072-420a-aa3c-a5f35e231b78 service nova] Lock "81725845-6158-4e34-bedb-6e41219bc227-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:00:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-71270489-d1e0-4cc6-9eb0-bcfe31219b07 req-0bdcfd29-2072-420a-aa3c-a5f35e231b78 service nova] Lock "81725845-6158-4e34-bedb-6e41219bc227-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:00:24 user nova-compute[72444]: DEBUG nova.compute.manager [req-71270489-d1e0-4cc6-9eb0-bcfe31219b07 req-0bdcfd29-2072-420a-aa3c-a5f35e231b78 service nova] [instance: 81725845-6158-4e34-bedb-6e41219bc227] No waiting events found dispatching network-vif-plugged-9b1b9675-c2df-4b16-ba94-807765bab119 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:00:24 user nova-compute[72444]: WARNING nova.compute.manager [req-71270489-d1e0-4cc6-9eb0-bcfe31219b07 req-0bdcfd29-2072-420a-aa3c-a5f35e231b78 service nova] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Received unexpected event network-vif-plugged-9b1b9675-c2df-4b16-ba94-807765bab119 for instance with vm_state deleted and task_state None.
Aug 03 05:00:24 user nova-compute[72444]: DEBUG nova.compute.manager [req-71270489-d1e0-4cc6-9eb0-bcfe31219b07 req-0bdcfd29-2072-420a-aa3c-a5f35e231b78 service nova] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Received event network-vif-plugged-9b1b9675-c2df-4b16-ba94-807765bab119 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:00:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-71270489-d1e0-4cc6-9eb0-bcfe31219b07 req-0bdcfd29-2072-420a-aa3c-a5f35e231b78 service nova] Acquiring lock "81725845-6158-4e34-bedb-6e41219bc227-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:00:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-71270489-d1e0-4cc6-9eb0-bcfe31219b07 req-0bdcfd29-2072-420a-aa3c-a5f35e231b78 service nova] Lock "81725845-6158-4e34-bedb-6e41219bc227-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:00:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-71270489-d1e0-4cc6-9eb0-bcfe31219b07 req-0bdcfd29-2072-420a-aa3c-a5f35e231b78 service nova] Lock "81725845-6158-4e34-bedb-6e41219bc227-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:00:24 user nova-compute[72444]: DEBUG nova.compute.manager [req-71270489-d1e0-4cc6-9eb0-bcfe31219b07 req-0bdcfd29-2072-420a-aa3c-a5f35e231b78 service nova] [instance: 81725845-6158-4e34-bedb-6e41219bc227] No waiting events found dispatching network-vif-plugged-9b1b9675-c2df-4b16-ba94-807765bab119 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:00:24 user nova-compute[72444]: WARNING nova.compute.manager [req-71270489-d1e0-4cc6-9eb0-bcfe31219b07 req-0bdcfd29-2072-420a-aa3c-a5f35e231b78 service nova] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Received unexpected event network-vif-plugged-9b1b9675-c2df-4b16-ba94-807765bab119 for instance with vm_state deleted and task_state None.
Aug 03 05:00:24 user nova-compute[72444]: DEBUG nova.compute.manager [req-71270489-d1e0-4cc6-9eb0-bcfe31219b07 req-0bdcfd29-2072-420a-aa3c-a5f35e231b78 service nova] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Received event network-vif-plugged-9b1b9675-c2df-4b16-ba94-807765bab119 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:00:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-71270489-d1e0-4cc6-9eb0-bcfe31219b07 req-0bdcfd29-2072-420a-aa3c-a5f35e231b78 service nova] Acquiring lock "81725845-6158-4e34-bedb-6e41219bc227-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:00:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-71270489-d1e0-4cc6-9eb0-bcfe31219b07 req-0bdcfd29-2072-420a-aa3c-a5f35e231b78 service nova] Lock "81725845-6158-4e34-bedb-6e41219bc227-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:00:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-71270489-d1e0-4cc6-9eb0-bcfe31219b07 req-0bdcfd29-2072-420a-aa3c-a5f35e231b78 service nova] Lock "81725845-6158-4e34-bedb-6e41219bc227-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:00:24 user nova-compute[72444]: DEBUG nova.compute.manager [req-71270489-d1e0-4cc6-9eb0-bcfe31219b07 req-0bdcfd29-2072-420a-aa3c-a5f35e231b78 service nova] [instance: 81725845-6158-4e34-bedb-6e41219bc227] No waiting events found dispatching network-vif-plugged-9b1b9675-c2df-4b16-ba94-807765bab119 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:00:24 user nova-compute[72444]: WARNING nova.compute.manager [req-71270489-d1e0-4cc6-9eb0-bcfe31219b07 req-0bdcfd29-2072-420a-aa3c-a5f35e231b78 service nova] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Received unexpected event network-vif-plugged-9b1b9675-c2df-4b16-ba94-807765bab119 for instance with vm_state deleted and task_state None.
Aug 03 05:00:24 user nova-compute[72444]: DEBUG nova.compute.manager [req-71270489-d1e0-4cc6-9eb0-bcfe31219b07 req-0bdcfd29-2072-420a-aa3c-a5f35e231b78 service nova] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Received event network-vif-deleted-9b1b9675-c2df-4b16-ba94-807765bab119 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:00:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5118edae-5364-4b43-b3fa-4d3b3d3f2e00 tempest-ServerBootFromVolumeStableRescueTest-1082770125 tempest-ServerBootFromVolumeStableRescueTest-1082770125-project-member] Lock "81725845-6158-4e34-bedb-6e41219bc227" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.423s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:00:26 user nova-compute[72444]: DEBUG nova.compute.manager [req-c572dceb-ae72-4941-83d5-0d76bed6cfe9 req-137e873a-63a3-42eb-967c-3016d7323a78 service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Received event network-changed-775b17bb-97a7-4a00-9368-198abafa4f8b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:00:26 user nova-compute[72444]: DEBUG nova.compute.manager [req-c572dceb-ae72-4941-83d5-0d76bed6cfe9 req-137e873a-63a3-42eb-967c-3016d7323a78 service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Refreshing instance network info cache due to event network-changed-775b17bb-97a7-4a00-9368-198abafa4f8b. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:00:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-c572dceb-ae72-4941-83d5-0d76bed6cfe9 req-137e873a-63a3-42eb-967c-3016d7323a78 service nova] Acquiring lock "refresh_cache-4f225dc2-3011-4c15-bb8e-1ebb079a3b50" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:00:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-c572dceb-ae72-4941-83d5-0d76bed6cfe9 req-137e873a-63a3-42eb-967c-3016d7323a78 service nova] Acquired lock "refresh_cache-4f225dc2-3011-4c15-bb8e-1ebb079a3b50" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:00:26 user nova-compute[72444]: DEBUG nova.network.neutron [req-c572dceb-ae72-4941-83d5-0d76bed6cfe9 req-137e873a-63a3-42eb-967c-3016d7323a78 service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Refreshing network info cache for port 775b17bb-97a7-4a00-9368-198abafa4f8b {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:00:27 user nova-compute[72444]: DEBUG nova.network.neutron [req-c572dceb-ae72-4941-83d5-0d76bed6cfe9 req-137e873a-63a3-42eb-967c-3016d7323a78 service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Updated VIF entry in instance network info cache for port 775b17bb-97a7-4a00-9368-198abafa4f8b. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:00:27 user nova-compute[72444]: DEBUG nova.network.neutron [req-c572dceb-ae72-4941-83d5-0d76bed6cfe9 req-137e873a-63a3-42eb-967c-3016d7323a78 service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Updating instance_info_cache with network_info: [{"id": "775b17bb-97a7-4a00-9368-198abafa4f8b", "address": "fa:16:3e:65:c2:ad", "network": {"id": "dd246ddd-6ffb-4516-b262-ef339c3f195c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2067592626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac3f775464f48d88f05efdf3aeb4fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b17bb-97", "ovs_interfaceid": "775b17bb-97a7-4a00-9368-198abafa4f8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:00:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-c572dceb-ae72-4941-83d5-0d76bed6cfe9 req-137e873a-63a3-42eb-967c-3016d7323a78 service nova] Releasing lock "refresh_cache-4f225dc2-3011-4c15-bb8e-1ebb079a3b50" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:00:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:31 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691038816.7249424, ae41789a-ebd1-4265-a903-32d2006e66d1 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:00:31 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] VM Stopped (Lifecycle Event)
Aug 03 05:00:31 user nova-compute[72444]: DEBUG nova.compute.manager [None req-974bc5e5-0d87-43bf-86ce-9ca7a24f8502 None None] [instance: ae41789a-ebd1-4265-a903-32d2006e66d1] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:00:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:38 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691038823.018803, 81725845-6158-4e34-bedb-6e41219bc227 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:00:38 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 81725845-6158-4e34-bedb-6e41219bc227] VM Stopped (Lifecycle Event)
Aug 03 05:00:38 user nova-compute[72444]: DEBUG nova.compute.manager [None req-da599999-264c-4653-bbeb-d45781155252 None None] [instance: 81725845-6158-4e34-bedb-6e41219bc227] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:00:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:43 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:48 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:53 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:00:54 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:00:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:56 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:00:56 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 05:00:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Acquiring lock "d5b2e7fa-a2cc-42c9-89da-8f8850e748be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:00:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "d5b2e7fa-a2cc-42c9-89da-8f8850e748be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:00:57 user nova-compute[72444]: DEBUG nova.compute.manager [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 05:00:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:00:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:00:57 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 05:00:57 user nova-compute[72444]: INFO nova.compute.claims [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Claim successful on node user
Aug 03 05:00:57 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:00:57 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:00:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.262s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:00:57 user nova-compute[72444]: DEBUG nova.compute.manager [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 05:00:57 user nova-compute[72444]: DEBUG nova.compute.manager [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 05:00:57 user nova-compute[72444]: DEBUG nova.network.neutron [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 05:00:57 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 05:00:57 user nova-compute[72444]: DEBUG nova.compute.manager [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 05:00:57 user nova-compute[72444]: DEBUG nova.compute.manager [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 05:00:57 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 05:00:57 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Creating image(s)
Aug 03 05:00:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5b2e7fa-a2cc-42c9-89da-8f8850e748be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:00:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "/opt/stack/data/nova/instances/d5b2e7fa-a2cc-42c9-89da-8f8850e748be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:00:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "/opt/stack/data/nova/instances/d5b2e7fa-a2cc-42c9-89da-8f8850e748be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:00:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:00:57 user nova-compute[72444]: DEBUG nova.policy [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be669ca3889044c7920db180a9a82ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff54227e82764df6abd50b83068c64de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 05:00:57 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:00:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.136s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:00:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:00:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:00:57 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:00:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.157s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:00:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/d5b2e7fa-a2cc-42c9-89da-8f8850e748be/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:00:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/d5b2e7fa-a2cc-42c9-89da-8f8850e748be/disk 1073741824" returned: 0 in 0.052s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:00:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:00:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:00:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.138s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:00:58 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d5b2e7fa-a2cc-42c9-89da-8f8850e748be/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 05:00:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b2e7fa-a2cc-42c9-89da-8f8850e748be/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:00:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b2e7fa-a2cc-42c9-89da-8f8850e748be/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:00:58 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Cannot resize image /opt/stack/data/nova/instances/d5b2e7fa-a2cc-42c9-89da-8f8850e748be/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 05:00:58 user nova-compute[72444]: DEBUG nova.objects.instance [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lazy-loading 'migration_context' on Instance uuid d5b2e7fa-a2cc-42c9-89da-8f8850e748be {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:00:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 05:00:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Ensure instance console log exists: /opt/stack/data/nova/instances/d5b2e7fa-a2cc-42c9-89da-8f8850e748be/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 05:00:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:00:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:00:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:00:58 user nova-compute[72444]: DEBUG nova.network.neutron [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Successfully created port: 3409d644-fe83-4cee-aa78-9b0f8e360f50 {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG nova.network.neutron [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Successfully updated port: 3409d644-fe83-4cee-aa78-9b0f8e360f50 {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Acquiring lock "refresh_cache-d5b2e7fa-a2cc-42c9-89da-8f8850e748be" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Acquired lock "refresh_cache-d5b2e7fa-a2cc-42c9-89da-8f8850e748be" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG nova.network.neutron [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG nova.compute.manager [req-9e3e4e7f-c861-494d-a2ec-bf6f2c7be69f req-387ac27b-9c9a-47eb-af7e-12c579312e30 service nova] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Received event network-changed-3409d644-fe83-4cee-aa78-9b0f8e360f50 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG nova.compute.manager [req-9e3e4e7f-c861-494d-a2ec-bf6f2c7be69f req-387ac27b-9c9a-47eb-af7e-12c579312e30 service nova] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Refreshing instance network info cache due to event network-changed-3409d644-fe83-4cee-aa78-9b0f8e360f50. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9e3e4e7f-c861-494d-a2ec-bf6f2c7be69f req-387ac27b-9c9a-47eb-af7e-12c579312e30 service nova] Acquiring lock "refresh_cache-d5b2e7fa-a2cc-42c9-89da-8f8850e748be" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG nova.network.neutron [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG nova.network.neutron [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Updating instance_info_cache with network_info: [{"id": "3409d644-fe83-4cee-aa78-9b0f8e360f50", "address": "fa:16:3e:35:3c:5f", "network": {"id": "81d682a4-018d-4927-866c-2b16d48f16e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-921368252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff54227e82764df6abd50b83068c64de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3409d644-fe", "ovs_interfaceid": "3409d644-fe83-4cee-aa78-9b0f8e360f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Releasing lock "refresh_cache-d5b2e7fa-a2cc-42c9-89da-8f8850e748be" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG nova.compute.manager [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Instance network_info: |[{"id": "3409d644-fe83-4cee-aa78-9b0f8e360f50", "address": "fa:16:3e:35:3c:5f", "network": {"id": "81d682a4-018d-4927-866c-2b16d48f16e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-921368252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff54227e82764df6abd50b83068c64de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3409d644-fe", "ovs_interfaceid": "3409d644-fe83-4cee-aa78-9b0f8e360f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9e3e4e7f-c861-494d-a2ec-bf6f2c7be69f req-387ac27b-9c9a-47eb-af7e-12c579312e30 service nova] Acquired lock "refresh_cache-d5b2e7fa-a2cc-42c9-89da-8f8850e748be" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG nova.network.neutron [req-9e3e4e7f-c861-494d-a2ec-bf6f2c7be69f req-387ac27b-9c9a-47eb-af7e-12c579312e30 service nova] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Refreshing network info cache for port 3409d644-fe83-4cee-aa78-9b0f8e360f50 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Start _get_guest_xml network_info=[{"id": "3409d644-fe83-4cee-aa78-9b0f8e360f50", "address": "fa:16:3e:35:3c:5f", "network": {"id": "81d682a4-018d-4927-866c-2b16d48f16e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-921368252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff54227e82764df6abd50b83068c64de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3409d644-fe", "ovs_interfaceid": "3409d644-fe83-4cee-aa78-9b0f8e360f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 05:00:59 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:00:59 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:00:59 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:00:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1568052423',display_name='tempest-VolumesSnapshotTestJSON-instance-1568052423',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1568052423',id=36,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMVSN4d7HcTHBX9+mlhHZwr5RsMG0JEfi6Z8LVzw0wUC6ClxVDVSJnzwhbvnu8TKOpqHEnitbHDDR5cHtoCmML76rqwQLIjNhI3indYu+lzLxtCT6GmhlNtuBvBwYgQBQ==',key_name='tempest-keypair-2112991317',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff54227e82764df6abd50b83068c64de',ramdisk_id='',reservation_id='r-by6rii9v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1757877731',owner_user_name='tempest-VolumesSnapshotTestJSON-1757877731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:00:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be669ca3889044c7920db180a9a82ae2',uuid=d5b2e7fa-a2cc-42c9-89da-8f8850e748be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3409d644-fe83-4cee-aa78-9b0f8e360f50", "address": "fa:16:3e:35:3c:5f", "network": {"id": "81d682a4-018d-4927-866c-2b16d48f16e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-921368252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff54227e82764df6abd50b83068c64de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3409d644-fe", "ovs_interfaceid": "3409d644-fe83-4cee-aa78-9b0f8e360f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Converting VIF {"id": "3409d644-fe83-4cee-aa78-9b0f8e360f50", "address": "fa:16:3e:35:3c:5f", "network": {"id": "81d682a4-018d-4927-866c-2b16d48f16e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-921368252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff54227e82764df6abd50b83068c64de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3409d644-fe", "ovs_interfaceid": "3409d644-fe83-4cee-aa78-9b0f8e360f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:3c:5f,bridge_name='br-int',has_traffic_filtering=True,id=3409d644-fe83-4cee-aa78-9b0f8e360f50,network=Network(81d682a4-018d-4927-866c-2b16d48f16e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3409d644-fe') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG nova.objects.instance [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lazy-loading 'pci_devices' on Instance uuid d5b2e7fa-a2cc-42c9-89da-8f8850e748be {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] End _get_guest_xml xml=<domain type="kvm">
Aug 03 05:00:59 user nova-compute[72444]:   <uuid>d5b2e7fa-a2cc-42c9-89da-8f8850e748be</uuid>
Aug 03 05:00:59 user nova-compute[72444]:   <name>instance-00000024</name>
Aug 03 05:00:59 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 05:00:59 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 05:00:59 user nova-compute[72444]:   <metadata>
Aug 03 05:00:59 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 05:00:59 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 05:00:59 user nova-compute[72444]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1568052423</nova:name>
Aug 03 05:00:59 user nova-compute[72444]:       <nova:creationTime>2023-08-03 05:00:59</nova:creationTime>
Aug 03 05:00:59 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 05:00:59 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 05:00:59 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 05:00:59 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 05:00:59 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 05:00:59 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 05:00:59 user nova-compute[72444]:       </nova:flavor>
Aug 03 05:00:59 user nova-compute[72444]:       <nova:owner>
Aug 03 05:00:59 user nova-compute[72444]:         <nova:user uuid="be669ca3889044c7920db180a9a82ae2">tempest-VolumesSnapshotTestJSON-1757877731-project-member</nova:user>
Aug 03 05:00:59 user nova-compute[72444]:         <nova:project uuid="ff54227e82764df6abd50b83068c64de">tempest-VolumesSnapshotTestJSON-1757877731</nova:project>
Aug 03 05:00:59 user nova-compute[72444]:       </nova:owner>
Aug 03 05:00:59 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 05:00:59 user nova-compute[72444]:       <nova:ports>
Aug 03 05:00:59 user nova-compute[72444]:         <nova:port uuid="3409d644-fe83-4cee-aa78-9b0f8e360f50">
Aug 03 05:00:59 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 03 05:00:59 user nova-compute[72444]:         </nova:port>
Aug 03 05:00:59 user nova-compute[72444]:       </nova:ports>
Aug 03 05:00:59 user nova-compute[72444]:     </nova:instance>
Aug 03 05:00:59 user nova-compute[72444]:   </metadata>
Aug 03 05:00:59 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 05:00:59 user nova-compute[72444]:     <system>
Aug 03 05:00:59 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 05:00:59 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 05:00:59 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 05:00:59 user nova-compute[72444]:       <entry name="serial">d5b2e7fa-a2cc-42c9-89da-8f8850e748be</entry>
Aug 03 05:00:59 user nova-compute[72444]:       <entry name="uuid">d5b2e7fa-a2cc-42c9-89da-8f8850e748be</entry>
Aug 03 05:00:59 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 05:00:59 user nova-compute[72444]:     </system>
Aug 03 05:00:59 user nova-compute[72444]:   </sysinfo>
Aug 03 05:00:59 user nova-compute[72444]:   <os>
Aug 03 05:00:59 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 05:00:59 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 05:00:59 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 05:00:59 user nova-compute[72444]:   </os>
Aug 03 05:00:59 user nova-compute[72444]:   <features>
Aug 03 05:00:59 user nova-compute[72444]:     <acpi/>
Aug 03 05:00:59 user nova-compute[72444]:     <apic/>
Aug 03 05:00:59 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 05:00:59 user nova-compute[72444]:   </features>
Aug 03 05:00:59 user nova-compute[72444]:   <clock offset="utc">
Aug 03 05:00:59 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 05:00:59 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 05:00:59 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 05:00:59 user nova-compute[72444]:   </clock>
Aug 03 05:00:59 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 05:00:59 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 05:00:59 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 05:00:59 user nova-compute[72444]:   </cpu>
Aug 03 05:00:59 user nova-compute[72444]:   <devices>
Aug 03 05:00:59 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 05:00:59 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 05:00:59 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/d5b2e7fa-a2cc-42c9-89da-8f8850e748be/disk"/>
Aug 03 05:00:59 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 05:00:59 user nova-compute[72444]:     </disk>
Aug 03 05:00:59 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 05:00:59 user nova-compute[72444]:       <mac address="fa:16:3e:35:3c:5f"/>
Aug 03 05:00:59 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:00:59 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 05:00:59 user nova-compute[72444]:       <target dev="tap3409d644-fe"/>
Aug 03 05:00:59 user nova-compute[72444]:     </interface>
Aug 03 05:00:59 user nova-compute[72444]:     <serial type="pty">
Aug 03 05:00:59 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/d5b2e7fa-a2cc-42c9-89da-8f8850e748be/console.log" append="off"/>
Aug 03 05:00:59 user nova-compute[72444]:     </serial>
Aug 03 05:00:59 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 05:00:59 user nova-compute[72444]:     <video>
Aug 03 05:00:59 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:00:59 user nova-compute[72444]:     </video>
Aug 03 05:00:59 user nova-compute[72444]:     <rng model="virtio">
Aug 03 05:00:59 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 05:00:59 user nova-compute[72444]:     </rng>
Aug 03 05:00:59 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 05:00:59 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 05:00:59 user nova-compute[72444]:       <stats period="10"/>
Aug 03 05:00:59 user nova-compute[72444]:     </memballoon>
Aug 03 05:00:59 user nova-compute[72444]:   </devices>
Aug 03 05:00:59 user nova-compute[72444]: </domain>
Aug 03 05:00:59 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:00:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1568052423',display_name='tempest-VolumesSnapshotTestJSON-instance-1568052423',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1568052423',id=36,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMVSN4d7HcTHBX9+mlhHZwr5RsMG0JEfi6Z8LVzw0wUC6ClxVDVSJnzwhbvnu8TKOpqHEnitbHDDR5cHtoCmML76rqwQLIjNhI3indYu+lzLxtCT6GmhlNtuBvBwYgQBQ==',key_name='tempest-keypair-2112991317',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff54227e82764df6abd50b83068c64de',ramdisk_id='',reservation_id='r-by6rii9v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1757877731',owner_user_name='tempest-VolumesSnapshotTestJSON-1757877731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:00:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be669ca3889044c7920db180a9a82ae2',uuid=d5b2e7fa-a2cc-42c9-89da-8f8850e748be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3409d644-fe83-4cee-aa78-9b0f8e360f50", "address": "fa:16:3e:35:3c:5f", "network": {"id": "81d682a4-018d-4927-866c-2b16d48f16e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-921368252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff54227e82764df6abd50b83068c64de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3409d644-fe", "ovs_interfaceid": "3409d644-fe83-4cee-aa78-9b0f8e360f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Converting VIF {"id": "3409d644-fe83-4cee-aa78-9b0f8e360f50", "address": "fa:16:3e:35:3c:5f", "network": {"id": "81d682a4-018d-4927-866c-2b16d48f16e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-921368252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff54227e82764df6abd50b83068c64de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3409d644-fe", "ovs_interfaceid": "3409d644-fe83-4cee-aa78-9b0f8e360f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:3c:5f,bridge_name='br-int',has_traffic_filtering=True,id=3409d644-fe83-4cee-aa78-9b0f8e360f50,network=Network(81d682a4-018d-4927-866c-2b16d48f16e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3409d644-fe') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG os_vif [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:3c:5f,bridge_name='br-int',has_traffic_filtering=True,id=3409d644-fe83-4cee-aa78-9b0f8e360f50,network=Network(81d682a4-018d-4927-866c-2b16d48f16e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3409d644-fe') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3409d644-fe, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3409d644-fe, col_values=(('external_ids', {'iface-id': '3409d644-fe83-4cee-aa78-9b0f8e360f50', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:3c:5f', 'vm-uuid': 'd5b2e7fa-a2cc-42c9-89da-8f8850e748be'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:00:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:01:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:00 user nova-compute[72444]: INFO os_vif [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:3c:5f,bridge_name='br-int',has_traffic_filtering=True,id=3409d644-fe83-4cee-aa78-9b0f8e360f50,network=Network(81d682a4-018d-4927-866c-2b16d48f16e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3409d644-fe')
Aug 03 05:01:00 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:01:00 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] No VIF found with MAC fa:16:3e:35:3c:5f, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 05:01:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-a9b960cb-39bd-4f31-9920-5ce31d5db139" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:01:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-a9b960cb-39bd-4f31-9920-5ce31d5db139" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:01:00 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 05:01:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:00 user nova-compute[72444]: DEBUG nova.network.neutron [req-9e3e4e7f-c861-494d-a2ec-bf6f2c7be69f req-387ac27b-9c9a-47eb-af7e-12c579312e30 service nova] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Updated VIF entry in instance network info cache for port 3409d644-fe83-4cee-aa78-9b0f8e360f50. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:01:00 user nova-compute[72444]: DEBUG nova.network.neutron [req-9e3e4e7f-c861-494d-a2ec-bf6f2c7be69f req-387ac27b-9c9a-47eb-af7e-12c579312e30 service nova] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Updating instance_info_cache with network_info: [{"id": "3409d644-fe83-4cee-aa78-9b0f8e360f50", "address": "fa:16:3e:35:3c:5f", "network": {"id": "81d682a4-018d-4927-866c-2b16d48f16e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-921368252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff54227e82764df6abd50b83068c64de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3409d644-fe", "ovs_interfaceid": "3409d644-fe83-4cee-aa78-9b0f8e360f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:01:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9e3e4e7f-c861-494d-a2ec-bf6f2c7be69f req-387ac27b-9c9a-47eb-af7e-12c579312e30 service nova] Releasing lock "refresh_cache-d5b2e7fa-a2cc-42c9-89da-8f8850e748be" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:01:00 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Updating instance_info_cache with network_info: [{"id": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "address": "fa:16:3e:b5:15:1e", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a682f5-6d", "ovs_interfaceid": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:01:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-a9b960cb-39bd-4f31-9920-5ce31d5db139" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:01:00 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 05:01:00 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:01:00 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:01:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:01:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:01:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:01:00 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:01:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:01 user nova-compute[72444]: DEBUG nova.compute.manager [req-720b09ab-5962-4bc1-95b6-1c75511d1388 req-1ad2f20e-9de7-404c-a9d5-5639990b251c service nova] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Received event network-vif-plugged-3409d644-fe83-4cee-aa78-9b0f8e360f50 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:01:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-720b09ab-5962-4bc1-95b6-1c75511d1388 req-1ad2f20e-9de7-404c-a9d5-5639990b251c service nova] Acquiring lock "d5b2e7fa-a2cc-42c9-89da-8f8850e748be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:01:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-720b09ab-5962-4bc1-95b6-1c75511d1388 req-1ad2f20e-9de7-404c-a9d5-5639990b251c service nova] Lock "d5b2e7fa-a2cc-42c9-89da-8f8850e748be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:01:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-720b09ab-5962-4bc1-95b6-1c75511d1388 req-1ad2f20e-9de7-404c-a9d5-5639990b251c service nova] Lock "d5b2e7fa-a2cc-42c9-89da-8f8850e748be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:01:01 user nova-compute[72444]: DEBUG nova.compute.manager [req-720b09ab-5962-4bc1-95b6-1c75511d1388 req-1ad2f20e-9de7-404c-a9d5-5639990b251c service nova] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] No waiting events found dispatching network-vif-plugged-3409d644-fe83-4cee-aa78-9b0f8e360f50 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:01:01 user nova-compute[72444]: WARNING nova.compute.manager [req-720b09ab-5962-4bc1-95b6-1c75511d1388 req-1ad2f20e-9de7-404c-a9d5-5639990b251c service nova] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Received unexpected event network-vif-plugged-3409d644-fe83-4cee-aa78-9b0f8e360f50 for instance with vm_state building and task_state spawning.
Aug 03 05:01:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b2e7fa-a2cc-42c9-89da-8f8850e748be/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:01:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b2e7fa-a2cc-42c9-89da-8f8850e748be/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:01:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b2e7fa-a2cc-42c9-89da-8f8850e748be/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:01:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b2e7fa-a2cc-42c9-89da-8f8850e748be/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:01:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:01:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:01:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:01:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:01:02 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 05:01:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:01:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:01:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:01:02 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:01:03 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038863.480156, d5b2e7fa-a2cc-42c9-89da-8f8850e748be => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:01:03 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] VM Resumed (Lifecycle Event)
Aug 03 05:01:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 05:01:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 05:01:03 user nova-compute[72444]: DEBUG nova.compute.manager [req-83a59b9b-47c8-41f6-8aae-34e94bd3582a req-008adf4e-dce7-4dee-af98-fd4d19b7a56f service nova] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Received event network-vif-plugged-3409d644-fe83-4cee-aa78-9b0f8e360f50 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:01:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-83a59b9b-47c8-41f6-8aae-34e94bd3582a req-008adf4e-dce7-4dee-af98-fd4d19b7a56f service nova] Acquiring lock "d5b2e7fa-a2cc-42c9-89da-8f8850e748be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:01:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-83a59b9b-47c8-41f6-8aae-34e94bd3582a req-008adf4e-dce7-4dee-af98-fd4d19b7a56f service nova] Lock "d5b2e7fa-a2cc-42c9-89da-8f8850e748be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:01:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-83a59b9b-47c8-41f6-8aae-34e94bd3582a req-008adf4e-dce7-4dee-af98-fd4d19b7a56f service nova] Lock "d5b2e7fa-a2cc-42c9-89da-8f8850e748be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:01:03 user nova-compute[72444]: DEBUG nova.compute.manager [req-83a59b9b-47c8-41f6-8aae-34e94bd3582a req-008adf4e-dce7-4dee-af98-fd4d19b7a56f service nova] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] No waiting events found dispatching network-vif-plugged-3409d644-fe83-4cee-aa78-9b0f8e360f50 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:01:03 user nova-compute[72444]: WARNING nova.compute.manager [req-83a59b9b-47c8-41f6-8aae-34e94bd3582a req-008adf4e-dce7-4dee-af98-fd4d19b7a56f service nova] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Received unexpected event network-vif-plugged-3409d644-fe83-4cee-aa78-9b0f8e360f50 for instance with vm_state building and task_state spawning.
Aug 03 05:01:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:01:03 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:01:03 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:01:03 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=8440MB free_disk=25.50965118408203GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:01:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:01:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:01:03 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Instance spawned successfully.
Aug 03 05:01:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 05:01:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:01:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:01:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:01:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:01:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:01:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:01:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:01:03 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 05:01:03 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038863.4808617, d5b2e7fa-a2cc-42c9-89da-8f8850e748be => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:01:03 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] VM Started (Lifecycle Event)
Aug 03 05:01:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:01:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:01:03 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance a9b960cb-39bd-4f31-9920-5ce31d5db139 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:01:03 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 4f225dc2-3011-4c15-bb8e-1ebb079a3b50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:01:03 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance d5b2e7fa-a2cc-42c9-89da-8f8850e748be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:01:03 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:01:03 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:01:03 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 05:01:03 user nova-compute[72444]: INFO nova.compute.manager [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Took 6.20 seconds to spawn the instance on the hypervisor.
Aug 03 05:01:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:01:04 user nova-compute[72444]: INFO nova.compute.manager [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Took 6.84 seconds to build instance.
Aug 03 05:01:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-39f5dbd1-ec4c-4f9a-9826-3008e420bcc4 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "d5b2e7fa-a2cc-42c9-89da-8f8850e748be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.963s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:01:04 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:01:04 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:01:04 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:01:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.330s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:01:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:06 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:01:06 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:01:06 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:01:06 user nova-compute[72444]: DEBUG nova.compute.manager [req-e14213d6-fb9e-41ea-8303-e2a429945c3f req-7564e00e-95e1-4d46-8159-c70f7a3e01ca service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Received event network-changed-68a682f5-6dbc-4c9b-ab56-b91c8cb93810 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:01:06 user nova-compute[72444]: DEBUG nova.compute.manager [req-e14213d6-fb9e-41ea-8303-e2a429945c3f req-7564e00e-95e1-4d46-8159-c70f7a3e01ca service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Refreshing instance network info cache due to event network-changed-68a682f5-6dbc-4c9b-ab56-b91c8cb93810. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:01:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e14213d6-fb9e-41ea-8303-e2a429945c3f req-7564e00e-95e1-4d46-8159-c70f7a3e01ca service nova] Acquiring lock "refresh_cache-a9b960cb-39bd-4f31-9920-5ce31d5db139" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:01:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e14213d6-fb9e-41ea-8303-e2a429945c3f req-7564e00e-95e1-4d46-8159-c70f7a3e01ca service nova] Acquired lock "refresh_cache-a9b960cb-39bd-4f31-9920-5ce31d5db139" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:01:06 user nova-compute[72444]: DEBUG nova.network.neutron [req-e14213d6-fb9e-41ea-8303-e2a429945c3f req-7564e00e-95e1-4d46-8159-c70f7a3e01ca service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Refreshing network info cache for port 68a682f5-6dbc-4c9b-ab56-b91c8cb93810 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:01:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:01:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:01:07 user nova-compute[72444]: DEBUG nova.compute.manager [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 05:01:07 user nova-compute[72444]: DEBUG nova.network.neutron [req-e14213d6-fb9e-41ea-8303-e2a429945c3f req-7564e00e-95e1-4d46-8159-c70f7a3e01ca service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Updated VIF entry in instance network info cache for port 68a682f5-6dbc-4c9b-ab56-b91c8cb93810. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:01:07 user nova-compute[72444]: DEBUG nova.network.neutron [req-e14213d6-fb9e-41ea-8303-e2a429945c3f req-7564e00e-95e1-4d46-8159-c70f7a3e01ca service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Updating instance_info_cache with network_info: [{"id": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "address": "fa:16:3e:b5:15:1e", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a682f5-6d", "ovs_interfaceid": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:01:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e14213d6-fb9e-41ea-8303-e2a429945c3f req-7564e00e-95e1-4d46-8159-c70f7a3e01ca service nova] Releasing lock "refresh_cache-a9b960cb-39bd-4f31-9920-5ce31d5db139" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:01:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:01:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:01:07 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 05:01:07 user nova-compute[72444]: INFO nova.compute.claims [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Claim successful on node user
Aug 03 05:01:07 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:01:07 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:01:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:01:07 user nova-compute[72444]: DEBUG nova.compute.manager [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 05:01:07 user nova-compute[72444]: DEBUG nova.compute.manager [req-ddca003a-8954-4a9c-8f07-d9599cf95251 req-0b2869df-50a0-42c5-9eff-fcae4c08f87a service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Received event network-changed-68a682f5-6dbc-4c9b-ab56-b91c8cb93810 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:01:07 user nova-compute[72444]: DEBUG nova.compute.manager [req-ddca003a-8954-4a9c-8f07-d9599cf95251 req-0b2869df-50a0-42c5-9eff-fcae4c08f87a service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Refreshing instance network info cache due to event network-changed-68a682f5-6dbc-4c9b-ab56-b91c8cb93810. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:01:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ddca003a-8954-4a9c-8f07-d9599cf95251 req-0b2869df-50a0-42c5-9eff-fcae4c08f87a service nova] Acquiring lock "refresh_cache-a9b960cb-39bd-4f31-9920-5ce31d5db139" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:01:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ddca003a-8954-4a9c-8f07-d9599cf95251 req-0b2869df-50a0-42c5-9eff-fcae4c08f87a service nova] Acquired lock "refresh_cache-a9b960cb-39bd-4f31-9920-5ce31d5db139" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:01:07 user nova-compute[72444]: DEBUG nova.network.neutron [req-ddca003a-8954-4a9c-8f07-d9599cf95251 req-0b2869df-50a0-42c5-9eff-fcae4c08f87a service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Refreshing network info cache for port 68a682f5-6dbc-4c9b-ab56-b91c8cb93810 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:01:07 user nova-compute[72444]: DEBUG nova.compute.manager [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 05:01:07 user nova-compute[72444]: DEBUG nova.network.neutron [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 05:01:07 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 05:01:07 user nova-compute[72444]: DEBUG nova.compute.manager [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 05:01:07 user nova-compute[72444]: DEBUG nova.policy [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bff27e3d2ae04049b35afe1bfcc7352b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf62b9ebb5f487184e3b84bbe7e73ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 05:01:07 user nova-compute[72444]: DEBUG nova.compute.manager [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 05:01:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 05:01:07 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Creating image(s)
Aug 03 05:01:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "/opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:01:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "/opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:01:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "/opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:01:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:01:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-98583ec6-42c0-4c97-9af8-edda66aa806a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquiring lock "a9b960cb-39bd-4f31-9920-5ce31d5db139" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:01:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-98583ec6-42c0-4c97-9af8-edda66aa806a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "a9b960cb-39bd-4f31-9920-5ce31d5db139" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:01:08 user nova-compute[72444]: INFO nova.compute.manager [None req-98583ec6-42c0-4c97-9af8-edda66aa806a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Detaching volume 90b0eca8-17a6-484f-962f-1882bf94e80f
Aug 03 05:01:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.174s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:01:08 user nova-compute[72444]: INFO nova.virt.block_device [None req-98583ec6-42c0-4c97-9af8-edda66aa806a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Attempting to driver detach volume 90b0eca8-17a6-484f-962f-1882bf94e80f from mountpoint /dev/vdb
Aug 03 05:01:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-98583ec6-42c0-4c97-9af8-edda66aa806a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Attempting to detach device vdb from instance a9b960cb-39bd-4f31-9920-5ce31d5db139 from the persistent domain config. {{(pid=72444) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-98583ec6-42c0-4c97-9af8-edda66aa806a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 05:01:08 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:01:08 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 05:01:08 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 05:01:08 user nova-compute[72444]:   <serial>90b0eca8-17a6-484f-962f-1882bf94e80f</serial>
Aug 03 05:01:08 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 03 05:01:08 user nova-compute[72444]: </disk>
Aug 03 05:01:08 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 05:01:08 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-98583ec6-42c0-4c97-9af8-edda66aa806a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Successfully detached device vdb from instance a9b960cb-39bd-4f31-9920-5ce31d5db139 from the persistent domain config.
Aug 03 05:01:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-98583ec6-42c0-4c97-9af8-edda66aa806a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a9b960cb-39bd-4f31-9920-5ce31d5db139 from the live domain config. {{(pid=72444) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-98583ec6-42c0-4c97-9af8-edda66aa806a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 05:01:08 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:01:08 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 05:01:08 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 05:01:08 user nova-compute[72444]:   <serial>90b0eca8-17a6-484f-962f-1882bf94e80f</serial>
Aug 03 05:01:08 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 03 05:01:08 user nova-compute[72444]: </disk>
Aug 03 05:01:08 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG nova.network.neutron [req-ddca003a-8954-4a9c-8f07-d9599cf95251 req-0b2869df-50a0-42c5-9eff-fcae4c08f87a service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Updated VIF entry in instance network info cache for port 68a682f5-6dbc-4c9b-ab56-b91c8cb93810. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG nova.network.neutron [req-ddca003a-8954-4a9c-8f07-d9599cf95251 req-0b2869df-50a0-42c5-9eff-fcae4c08f87a service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Updating instance_info_cache with network_info: [{"id": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "address": "fa:16:3e:b5:15:1e", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a682f5-6d", "ovs_interfaceid": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ddca003a-8954-4a9c-8f07-d9599cf95251 req-0b2869df-50a0-42c5-9eff-fcae4c08f87a service nova] Releasing lock "refresh_cache-a9b960cb-39bd-4f31-9920-5ce31d5db139" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.190s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/disk 1073741824" returned: 0 in 0.058s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.176s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Cannot resize image /opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG nova.objects.instance [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lazy-loading 'migration_context' on Instance uuid dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Ensure instance console log exists: /opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG nova.network.neutron [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Successfully created port: 06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Received event <DeviceRemovedEvent: 1691038868.8090312, a9b960cb-39bd-4f31-9920-5ce31d5db139 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72444) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-98583ec6-42c0-4c97-9af8-edda66aa806a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a9b960cb-39bd-4f31-9920-5ce31d5db139 {{(pid=72444) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 05:01:08 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-98583ec6-42c0-4c97-9af8-edda66aa806a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Successfully detached device vdb from instance a9b960cb-39bd-4f31-9920-5ce31d5db139 from the live domain config.
Aug 03 05:01:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98583ec6-42c0-4c97-9af8-edda66aa806a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-98583ec6-42c0-4c97-9af8-edda66aa806a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AaOVwGqF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:01:08 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-98583ec6-42c0-4c97-9af8-edda66aa806a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:01:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-98583ec6-42c0-4c97-9af8-edda66aa806a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-98583ec6-42c0-4c97-9af8-edda66aa806a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-98583ec6-42c0-4c97-9af8-edda66aa806a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c712617f-dad2-4d99-a047-5c93b5359711]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efbf550-5ba9-481a-b7c9-e644c5e236dd]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-98583ec6-42c0-4c97-9af8-edda66aa806a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f (non-flash)
Aug 03 05:01:08 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-98583ec6-42c0-4c97-9af8-edda66aa806a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f (non-flash)
Aug 03 05:01:08 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-98583ec6-42c0-4c97-9af8-edda66aa806a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30940a40d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f'): ({'sdb'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-98583ec6-42c0-4c97-9af8-edda66aa806a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Removing single pathed devices sdb {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfcb8c9-09af-4216-992d-3e9cd653f76b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[906a10c8-b2a1-42ed-ac24-b71689f888e1]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-98583ec6-42c0-4c97-9af8-edda66aa806a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Flushing IO for device /dev/sdb {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3726f41-d3d2-4085-a6a0-b8f5b5757202]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-98583ec6-42c0-4c97-9af8-edda66aa806a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 05:01:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:01:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:01:09 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb0a2ee-bbdc-4734-a467-958c6809f08a]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:01:09 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-98583ec6-42c0-4c97-9af8-edda66aa806a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 05:01:09 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-98583ec6-42c0-4c97-9af8-edda66aa806a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 05:01:09 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-98583ec6-42c0-4c97-9af8-edda66aa806a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 05:01:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:01:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:01:09 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[212075b1-682f-42c6-bef4-bf2ea32ae873]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:01:09 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-98583ec6-42c0-4c97-9af8-edda66aa806a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:01:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:01:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:01:09 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d6e6db-26f4-444b-b9d7-99ecf44297a5]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:01:09 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-98583ec6-42c0-4c97-9af8-edda66aa806a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f, portal: 172.16.0.220,3260]
Aug 03 05:01:09 user nova-compute[72444]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f, portal: 172.16.0.220,3260] successful.
Aug 03 05:01:09 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:01:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:01:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b0eca8-17a6-484f-962f-1882bf94e80f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:01:09 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d559778b-cbd9-4a65-99cf-650886fe27b2]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:01:09 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-98583ec6-42c0-4c97-9af8-edda66aa806a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:01:09 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-98583ec6-42c0-4c97-9af8-edda66aa806a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:01:09 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-98583ec6-42c0-4c97-9af8-edda66aa806a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] <== disconnect_volume: return (320ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:01:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98583ec6-42c0-4c97-9af8-edda66aa806a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 05:01:09 user nova-compute[72444]: DEBUG nova.network.neutron [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Successfully updated port: 06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 05:01:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "refresh_cache-dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:01:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquired lock "refresh_cache-dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:01:09 user nova-compute[72444]: DEBUG nova.network.neutron [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 05:01:09 user nova-compute[72444]: DEBUG nova.compute.manager [req-6145d080-6bee-4c2e-8b95-7a9a6b2dd992 req-c798705e-932b-4d4a-997e-c262a5abca22 service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Received event network-changed-06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:01:09 user nova-compute[72444]: DEBUG nova.compute.manager [req-6145d080-6bee-4c2e-8b95-7a9a6b2dd992 req-c798705e-932b-4d4a-997e-c262a5abca22 service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Refreshing instance network info cache due to event network-changed-06e85273-4218-48ad-b2d8-fa4a3875a57c. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:01:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6145d080-6bee-4c2e-8b95-7a9a6b2dd992 req-c798705e-932b-4d4a-997e-c262a5abca22 service nova] Acquiring lock "refresh_cache-dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:01:09 user nova-compute[72444]: DEBUG nova.network.neutron [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 05:01:09 user nova-compute[72444]: DEBUG nova.objects.instance [None req-98583ec6-42c0-4c97-9af8-edda66aa806a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lazy-loading 'flavor' on Instance uuid a9b960cb-39bd-4f31-9920-5ce31d5db139 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:01:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-98583ec6-42c0-4c97-9af8-edda66aa806a tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "a9b960cb-39bd-4f31-9920-5ce31d5db139" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.132s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG nova.network.neutron [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Updating instance_info_cache with network_info: [{"id": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "address": "fa:16:3e:a4:56:cc", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e85273-42", "ovs_interfaceid": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Releasing lock "refresh_cache-dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG nova.compute.manager [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Instance network_info: |[{"id": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "address": "fa:16:3e:a4:56:cc", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e85273-42", "ovs_interfaceid": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6145d080-6bee-4c2e-8b95-7a9a6b2dd992 req-c798705e-932b-4d4a-997e-c262a5abca22 service nova] Acquired lock "refresh_cache-dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG nova.network.neutron [req-6145d080-6bee-4c2e-8b95-7a9a6b2dd992 req-c798705e-932b-4d4a-997e-c262a5abca22 service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Refreshing network info cache for port 06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Start _get_guest_xml network_info=[{"id": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "address": "fa:16:3e:a4:56:cc", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e85273-42", "ovs_interfaceid": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 05:01:10 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:01:10 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:01:10 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:01:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1501682490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1501682490',id=37,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrIKQNieskQ5HIAC8bQPEDKoCrerktuCSqbnOrkAEuAh6cCBuPVrlD3Z1OOSXPqY/Ndp7grTBVvg9CJlEgBhUnbbt61T0LtdVmOEXUXEZ86SUTqwjbbnzXye2pofWqM9w==',key_name='tempest-keypair-2139993245',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ccf62b9ebb5f487184e3b84bbe7e73ad',ramdisk_id='',reservation_id='r-0f6l9ob9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-941210092',owner_user_name='tempest-AttachVolumeShelveTestJSON-941210092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bff27e3d2ae04049b35afe1bfcc7352b',uuid=dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "address": "fa:16:3e:a4:56:cc", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e85273-42", "ovs_interfaceid": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Converting VIF {"id": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "address": "fa:16:3e:a4:56:cc", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e85273-42", "ovs_interfaceid": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:56:cc,bridge_name='br-int',has_traffic_filtering=True,id=06e85273-4218-48ad-b2d8-fa4a3875a57c,network=Network(3e3f34b4-1878-4a24-b0b2-ab0472fb62d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06e85273-42') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG nova.objects.instance [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lazy-loading 'pci_devices' on Instance uuid dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] End _get_guest_xml xml=<domain type="kvm">
Aug 03 05:01:10 user nova-compute[72444]:   <uuid>dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8</uuid>
Aug 03 05:01:10 user nova-compute[72444]:   <name>instance-00000025</name>
Aug 03 05:01:10 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 05:01:10 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 05:01:10 user nova-compute[72444]:   <metadata>
Aug 03 05:01:10 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 05:01:10 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 05:01:10 user nova-compute[72444]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1501682490</nova:name>
Aug 03 05:01:10 user nova-compute[72444]:       <nova:creationTime>2023-08-03 05:01:10</nova:creationTime>
Aug 03 05:01:10 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 05:01:10 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 05:01:10 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 05:01:10 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 05:01:10 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 05:01:10 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 05:01:10 user nova-compute[72444]:       </nova:flavor>
Aug 03 05:01:10 user nova-compute[72444]:       <nova:owner>
Aug 03 05:01:10 user nova-compute[72444]:         <nova:user uuid="bff27e3d2ae04049b35afe1bfcc7352b">tempest-AttachVolumeShelveTestJSON-941210092-project-member</nova:user>
Aug 03 05:01:10 user nova-compute[72444]:         <nova:project uuid="ccf62b9ebb5f487184e3b84bbe7e73ad">tempest-AttachVolumeShelveTestJSON-941210092</nova:project>
Aug 03 05:01:10 user nova-compute[72444]:       </nova:owner>
Aug 03 05:01:10 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 05:01:10 user nova-compute[72444]:       <nova:ports>
Aug 03 05:01:10 user nova-compute[72444]:         <nova:port uuid="06e85273-4218-48ad-b2d8-fa4a3875a57c">
Aug 03 05:01:10 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 03 05:01:10 user nova-compute[72444]:         </nova:port>
Aug 03 05:01:10 user nova-compute[72444]:       </nova:ports>
Aug 03 05:01:10 user nova-compute[72444]:     </nova:instance>
Aug 03 05:01:10 user nova-compute[72444]:   </metadata>
Aug 03 05:01:10 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 05:01:10 user nova-compute[72444]:     <system>
Aug 03 05:01:10 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 05:01:10 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 05:01:10 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 05:01:10 user nova-compute[72444]:       <entry name="serial">dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8</entry>
Aug 03 05:01:10 user nova-compute[72444]:       <entry name="uuid">dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8</entry>
Aug 03 05:01:10 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 05:01:10 user nova-compute[72444]:     </system>
Aug 03 05:01:10 user nova-compute[72444]:   </sysinfo>
Aug 03 05:01:10 user nova-compute[72444]:   <os>
Aug 03 05:01:10 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 05:01:10 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 05:01:10 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 05:01:10 user nova-compute[72444]:   </os>
Aug 03 05:01:10 user nova-compute[72444]:   <features>
Aug 03 05:01:10 user nova-compute[72444]:     <acpi/>
Aug 03 05:01:10 user nova-compute[72444]:     <apic/>
Aug 03 05:01:10 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 05:01:10 user nova-compute[72444]:   </features>
Aug 03 05:01:10 user nova-compute[72444]:   <clock offset="utc">
Aug 03 05:01:10 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 05:01:10 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 05:01:10 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 05:01:10 user nova-compute[72444]:   </clock>
Aug 03 05:01:10 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 05:01:10 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 05:01:10 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 05:01:10 user nova-compute[72444]:   </cpu>
Aug 03 05:01:10 user nova-compute[72444]:   <devices>
Aug 03 05:01:10 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 05:01:10 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 05:01:10 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/disk"/>
Aug 03 05:01:10 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 05:01:10 user nova-compute[72444]:     </disk>
Aug 03 05:01:10 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 05:01:10 user nova-compute[72444]:       <mac address="fa:16:3e:a4:56:cc"/>
Aug 03 05:01:10 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:01:10 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 05:01:10 user nova-compute[72444]:       <target dev="tap06e85273-42"/>
Aug 03 05:01:10 user nova-compute[72444]:     </interface>
Aug 03 05:01:10 user nova-compute[72444]:     <serial type="pty">
Aug 03 05:01:10 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/console.log" append="off"/>
Aug 03 05:01:10 user nova-compute[72444]:     </serial>
Aug 03 05:01:10 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 05:01:10 user nova-compute[72444]:     <video>
Aug 03 05:01:10 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:01:10 user nova-compute[72444]:     </video>
Aug 03 05:01:10 user nova-compute[72444]:     <rng model="virtio">
Aug 03 05:01:10 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 05:01:10 user nova-compute[72444]:     </rng>
Aug 03 05:01:10 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 05:01:10 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 05:01:10 user nova-compute[72444]:       <stats period="10"/>
Aug 03 05:01:10 user nova-compute[72444]:     </memballoon>
Aug 03 05:01:10 user nova-compute[72444]:   </devices>
Aug 03 05:01:10 user nova-compute[72444]: </domain>
Aug 03 05:01:10 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:01:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1501682490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1501682490',id=37,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrIKQNieskQ5HIAC8bQPEDKoCrerktuCSqbnOrkAEuAh6cCBuPVrlD3Z1OOSXPqY/Ndp7grTBVvg9CJlEgBhUnbbt61T0LtdVmOEXUXEZ86SUTqwjbbnzXye2pofWqM9w==',key_name='tempest-keypair-2139993245',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ccf62b9ebb5f487184e3b84bbe7e73ad',ramdisk_id='',reservation_id='r-0f6l9ob9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-941210092',owner_user_name='tempest-AttachVolumeShelveTestJSON-941210092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bff27e3d2ae04049b35afe1bfcc7352b',uuid=dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "address": "fa:16:3e:a4:56:cc", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e85273-42", "ovs_interfaceid": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Converting VIF {"id": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "address": "fa:16:3e:a4:56:cc", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e85273-42", "ovs_interfaceid": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:56:cc,bridge_name='br-int',has_traffic_filtering=True,id=06e85273-4218-48ad-b2d8-fa4a3875a57c,network=Network(3e3f34b4-1878-4a24-b0b2-ab0472fb62d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06e85273-42') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG os_vif [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:56:cc,bridge_name='br-int',has_traffic_filtering=True,id=06e85273-4218-48ad-b2d8-fa4a3875a57c,network=Network(3e3f34b4-1878-4a24-b0b2-ab0472fb62d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06e85273-42') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06e85273-42, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap06e85273-42, col_values=(('external_ids', {'iface-id': '06e85273-4218-48ad-b2d8-fa4a3875a57c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:56:cc', 'vm-uuid': 'dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:10 user nova-compute[72444]: INFO os_vif [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:56:cc,bridge_name='br-int',has_traffic_filtering=True,id=06e85273-4218-48ad-b2d8-fa4a3875a57c,network=Network(3e3f34b4-1878-4a24-b0b2-ab0472fb62d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06e85273-42')
Aug 03 05:01:10 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] No VIF found with MAC fa:16:3e:a4:56:cc, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG nova.network.neutron [req-6145d080-6bee-4c2e-8b95-7a9a6b2dd992 req-c798705e-932b-4d4a-997e-c262a5abca22 service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Updated VIF entry in instance network info cache for port 06e85273-4218-48ad-b2d8-fa4a3875a57c. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG nova.network.neutron [req-6145d080-6bee-4c2e-8b95-7a9a6b2dd992 req-c798705e-932b-4d4a-997e-c262a5abca22 service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Updating instance_info_cache with network_info: [{"id": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "address": "fa:16:3e:a4:56:cc", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e85273-42", "ovs_interfaceid": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:01:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6145d080-6bee-4c2e-8b95-7a9a6b2dd992 req-c798705e-932b-4d4a-997e-c262a5abca22 service nova] Releasing lock "refresh_cache-dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:01:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:11 user nova-compute[72444]: DEBUG nova.compute.manager [req-d1cc4bee-fd4a-4655-bda3-ba7c40164937 req-cbbe58a7-d971-4cc3-81a5-8107218250a6 service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Received event network-vif-plugged-06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:01:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d1cc4bee-fd4a-4655-bda3-ba7c40164937 req-cbbe58a7-d971-4cc3-81a5-8107218250a6 service nova] Acquiring lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:01:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d1cc4bee-fd4a-4655-bda3-ba7c40164937 req-cbbe58a7-d971-4cc3-81a5-8107218250a6 service nova] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:01:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d1cc4bee-fd4a-4655-bda3-ba7c40164937 req-cbbe58a7-d971-4cc3-81a5-8107218250a6 service nova] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:01:11 user nova-compute[72444]: DEBUG nova.compute.manager [req-d1cc4bee-fd4a-4655-bda3-ba7c40164937 req-cbbe58a7-d971-4cc3-81a5-8107218250a6 service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] No waiting events found dispatching network-vif-plugged-06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:01:11 user nova-compute[72444]: WARNING nova.compute.manager [req-d1cc4bee-fd4a-4655-bda3-ba7c40164937 req-cbbe58a7-d971-4cc3-81a5-8107218250a6 service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Received unexpected event network-vif-plugged-06e85273-4218-48ad-b2d8-fa4a3875a57c for instance with vm_state building and task_state spawning.
Aug 03 05:01:12 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:12 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:13 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038873.9571846, dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:01:13 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] VM Resumed (Lifecycle Event)
Aug 03 05:01:13 user nova-compute[72444]: DEBUG nova.compute.manager [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 05:01:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 05:01:13 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Instance spawned successfully.
Aug 03 05:01:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 05:01:13 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:01:13 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:01:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:01:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:01:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:01:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:01:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:01:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:01:14 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 05:01:14 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038873.960829, dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:01:14 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] VM Started (Lifecycle Event)
Aug 03 05:01:14 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:01:14 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:01:14 user nova-compute[72444]: DEBUG nova.compute.manager [req-ccd2629e-6aa6-4b22-a098-3054f2d62353 req-11696386-82c7-405a-8fdb-1a4fea85c500 service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Received event network-vif-plugged-06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:01:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ccd2629e-6aa6-4b22-a098-3054f2d62353 req-11696386-82c7-405a-8fdb-1a4fea85c500 service nova] Acquiring lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:01:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ccd2629e-6aa6-4b22-a098-3054f2d62353 req-11696386-82c7-405a-8fdb-1a4fea85c500 service nova] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:01:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ccd2629e-6aa6-4b22-a098-3054f2d62353 req-11696386-82c7-405a-8fdb-1a4fea85c500 service nova] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:01:14 user nova-compute[72444]: DEBUG nova.compute.manager [req-ccd2629e-6aa6-4b22-a098-3054f2d62353 req-11696386-82c7-405a-8fdb-1a4fea85c500 service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] No waiting events found dispatching network-vif-plugged-06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:01:14 user nova-compute[72444]: WARNING nova.compute.manager [req-ccd2629e-6aa6-4b22-a098-3054f2d62353 req-11696386-82c7-405a-8fdb-1a4fea85c500 service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Received unexpected event network-vif-plugged-06e85273-4218-48ad-b2d8-fa4a3875a57c for instance with vm_state building and task_state spawning.
Aug 03 05:01:14 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 05:01:14 user nova-compute[72444]: INFO nova.compute.manager [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Took 6.21 seconds to spawn the instance on the hypervisor.
Aug 03 05:01:14 user nova-compute[72444]: DEBUG nova.compute.manager [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:01:14 user nova-compute[72444]: INFO nova.compute.manager [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Took 6.96 seconds to build instance.
Aug 03 05:01:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-788b82ed-8c87-40e0-93ab-1ac68eae9a38 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.068s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:01:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:19 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:01:53 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:01:53 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:01:53 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Cleaning up deleted instances {{(pid=72444) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 03 05:01:53 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] There are 0 instances to clean {{(pid=72444) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 03 05:01:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:01:56 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:01:58 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:01:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 05:01:59 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:01:59 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:01:59 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Rebuilding the list of instances to heal {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 05:01:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-a9b960cb-39bd-4f31-9920-5ce31d5db139" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:01:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-a9b960cb-39bd-4f31-9920-5ce31d5db139" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:01:59 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 05:01:59 user nova-compute[72444]: DEBUG nova.objects.instance [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lazy-loading 'info_cache' on Instance uuid a9b960cb-39bd-4f31-9920-5ce31d5db139 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:02:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:02:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:02:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:02:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:02:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:02:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:02:00 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Updating instance_info_cache with network_info: [{"id": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "address": "fa:16:3e:b5:15:1e", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a682f5-6d", "ovs_interfaceid": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:02:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-a9b960cb-39bd-4f31-9920-5ce31d5db139" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:02:00 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 05:02:00 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:02:00 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:02:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-52912b2a-6bbc-4bc0-b0f4-4682365a26a2 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquiring lock "a9b960cb-39bd-4f31-9920-5ce31d5db139" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:02:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-52912b2a-6bbc-4bc0-b0f4-4682365a26a2 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "a9b960cb-39bd-4f31-9920-5ce31d5db139" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:02:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-52912b2a-6bbc-4bc0-b0f4-4682365a26a2 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquiring lock "a9b960cb-39bd-4f31-9920-5ce31d5db139-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:02:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-52912b2a-6bbc-4bc0-b0f4-4682365a26a2 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "a9b960cb-39bd-4f31-9920-5ce31d5db139-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:02:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-52912b2a-6bbc-4bc0-b0f4-4682365a26a2 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "a9b960cb-39bd-4f31-9920-5ce31d5db139-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:02:02 user nova-compute[72444]: INFO nova.compute.manager [None req-52912b2a-6bbc-4bc0-b0f4-4682365a26a2 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Terminating instance
Aug 03 05:02:02 user nova-compute[72444]: DEBUG nova.compute.manager [None req-52912b2a-6bbc-4bc0-b0f4-4682365a26a2 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 05:02:02 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:02:02 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:02 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:02:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:02:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:02:02 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:02:02 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:02 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:03 user nova-compute[72444]: DEBUG nova.compute.manager [req-07998dba-acb2-4f07-9ee5-b2623a522fc8 req-3694d469-a906-4983-be78-ce94befcafb2 service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Received event network-vif-unplugged-68a682f5-6dbc-4c9b-ab56-b91c8cb93810 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:02:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-07998dba-acb2-4f07-9ee5-b2623a522fc8 req-3694d469-a906-4983-be78-ce94befcafb2 service nova] Acquiring lock "a9b960cb-39bd-4f31-9920-5ce31d5db139-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:02:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-07998dba-acb2-4f07-9ee5-b2623a522fc8 req-3694d469-a906-4983-be78-ce94befcafb2 service nova] Lock "a9b960cb-39bd-4f31-9920-5ce31d5db139-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:02:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-07998dba-acb2-4f07-9ee5-b2623a522fc8 req-3694d469-a906-4983-be78-ce94befcafb2 service nova] Lock "a9b960cb-39bd-4f31-9920-5ce31d5db139-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:02:03 user nova-compute[72444]: DEBUG nova.compute.manager [req-07998dba-acb2-4f07-9ee5-b2623a522fc8 req-3694d469-a906-4983-be78-ce94befcafb2 service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] No waiting events found dispatching network-vif-unplugged-68a682f5-6dbc-4c9b-ab56-b91c8cb93810 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:02:03 user nova-compute[72444]: DEBUG nova.compute.manager [req-07998dba-acb2-4f07-9ee5-b2623a522fc8 req-3694d469-a906-4983-be78-ce94befcafb2 service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Received event network-vif-unplugged-68a682f5-6dbc-4c9b-ab56-b91c8cb93810 for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 05:02:03 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Instance destroyed successfully.
Aug 03 05:02:03 user nova-compute[72444]: DEBUG nova.objects.instance [None req-52912b2a-6bbc-4bc0-b0f4-4682365a26a2 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lazy-loading 'resources' on Instance uuid a9b960cb-39bd-4f31-9920-5ce31d5db139 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:02:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-52912b2a-6bbc-4bc0-b0f4-4682365a26a2 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:56:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1751002867',display_name='tempest-TestMinimumBasicScenario-server-1751002867',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1751002867',id=33,image_ref='8e18af3a-7ab1-40b2-9a01-456e56c71296',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcHfxO2CJZwlfrKEV+BCKKA3mm2Qu1C0XwTCU49QSlfy4GtfOuw1uap5TaNJn3JTTUIHR9cd/KVOmyFHg2ffBTJNBWsd9JhffQaYQWGjqb5ClOLv5HgkGXnryOGHCRpGA==',key_name='tempest-TestMinimumBasicScenario-1010540444',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:56:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d787b7db6a684a008a03c55e292b0d5c',ramdisk_id='',reservation_id='r-rxwa2ccf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8e18af3a-7ab1-40b2-9a01-456e56c71296',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1132477023',owner_user_name='tempest-TestMinimumBasicScenario-1132477023-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T04:59:22Z,user_data=None,user_id='9458c7bd532e4451904ca404bf35427b',uuid=a9b960cb-39bd-4f31-9920-5ce31d5db139,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "address": "fa:16:3e:b5:15:1e", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a682f5-6d", "ovs_interfaceid": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 05:02:03 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-52912b2a-6bbc-4bc0-b0f4-4682365a26a2 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Converting VIF {"id": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "address": "fa:16:3e:b5:15:1e", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a682f5-6d", "ovs_interfaceid": "68a682f5-6dbc-4c9b-ab56-b91c8cb93810", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:02:03 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-52912b2a-6bbc-4bc0-b0f4-4682365a26a2 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:15:1e,bridge_name='br-int',has_traffic_filtering=True,id=68a682f5-6dbc-4c9b-ab56-b91c8cb93810,network=Network(87c23a2e-233d-487e-9789-d4eb24a63856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68a682f5-6d') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:02:03 user nova-compute[72444]: DEBUG os_vif [None req-52912b2a-6bbc-4bc0-b0f4-4682365a26a2 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:15:1e,bridge_name='br-int',has_traffic_filtering=True,id=68a682f5-6dbc-4c9b-ab56-b91c8cb93810,network=Network(87c23a2e-233d-487e-9789-d4eb24a63856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68a682f5-6d') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 05:02:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68a682f5-6d, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:02:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:02:03 user nova-compute[72444]: INFO os_vif [None req-52912b2a-6bbc-4bc0-b0f4-4682365a26a2 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:15:1e,bridge_name='br-int',has_traffic_filtering=True,id=68a682f5-6dbc-4c9b-ab56-b91c8cb93810,network=Network(87c23a2e-233d-487e-9789-d4eb24a63856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68a682f5-6d')
Aug 03 05:02:03 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-52912b2a-6bbc-4bc0-b0f4-4682365a26a2 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Deleting instance files /opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139_del
Aug 03 05:02:03 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-52912b2a-6bbc-4bc0-b0f4-4682365a26a2 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Deletion of /opt/stack/data/nova/instances/a9b960cb-39bd-4f31-9920-5ce31d5db139_del complete
Aug 03 05:02:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b2e7fa-a2cc-42c9-89da-8f8850e748be/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:03 user nova-compute[72444]: INFO nova.compute.manager [None req-52912b2a-6bbc-4bc0-b0f4-4682365a26a2 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 03 05:02:03 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-52912b2a-6bbc-4bc0-b0f4-4682365a26a2 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 05:02:03 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 05:02:03 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 05:02:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b2e7fa-a2cc-42c9-89da-8f8850e748be/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b2e7fa-a2cc-42c9-89da-8f8850e748be/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b2e7fa-a2cc-42c9-89da-8f8850e748be/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:04 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:02:04 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Error from libvirt while getting description of instance-00000021: [Error Code 42] Domain not found: no domain with matching uuid 'a9b960cb-39bd-4f31-9920-5ce31d5db139' (instance-00000021): libvirt.libvirtError: Domain not found: no domain with matching uuid 'a9b960cb-39bd-4f31-9920-5ce31d5db139' (instance-00000021)
Aug 03 05:02:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:04 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Took 0.62 seconds to deallocate network for instance.
Aug 03 05:02:04 user nova-compute[72444]: DEBUG nova.compute.manager [req-4a743592-3a30-4870-898a-9d53c3fd36ef req-b2f22c3b-1f72-4191-92dc-11ac7f8ea85b service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Received event network-vif-deleted-68a682f5-6dbc-4c9b-ab56-b91c8cb93810 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:02:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-52912b2a-6bbc-4bc0-b0f4-4682365a26a2 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:02:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-52912b2a-6bbc-4bc0-b0f4-4682365a26a2 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:02:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:04 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-52912b2a-6bbc-4bc0-b0f4-4682365a26a2 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Refreshing inventories for resource provider b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 03 05:02:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:04 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-52912b2a-6bbc-4bc0-b0f4-4682365a26a2 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Updating ProviderTree inventory for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 03 05:02:04 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-52912b2a-6bbc-4bc0-b0f4-4682365a26a2 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Updating inventory in ProviderTree for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 03 05:02:05 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-52912b2a-6bbc-4bc0-b0f4-4682365a26a2 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Refreshing aggregate associations for resource provider b624a913-bb6b-4a17-8cd7-7b0950cff161, aggregates: None {{(pid=72444) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 03 05:02:05 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:02:05 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:02:05 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=8324MB free_disk=25.440914154052734GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:02:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:02:05 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-52912b2a-6bbc-4bc0-b0f4-4682365a26a2 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Refreshing trait associations for resource provider b624a913-bb6b-4a17-8cd7-7b0950cff161, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=72444) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 03 05:02:05 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-52912b2a-6bbc-4bc0-b0f4-4682365a26a2 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:02:05 user nova-compute[72444]: DEBUG nova.compute.manager [req-61ccf49b-cf27-40d7-ba6d-45b56e2f717f req-501c93b7-5a4b-4f34-b011-327064462583 service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Received event network-vif-plugged-68a682f5-6dbc-4c9b-ab56-b91c8cb93810 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:02:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-61ccf49b-cf27-40d7-ba6d-45b56e2f717f req-501c93b7-5a4b-4f34-b011-327064462583 service nova] Acquiring lock "a9b960cb-39bd-4f31-9920-5ce31d5db139-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:02:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-61ccf49b-cf27-40d7-ba6d-45b56e2f717f req-501c93b7-5a4b-4f34-b011-327064462583 service nova] Lock "a9b960cb-39bd-4f31-9920-5ce31d5db139-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:02:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-61ccf49b-cf27-40d7-ba6d-45b56e2f717f req-501c93b7-5a4b-4f34-b011-327064462583 service nova] Lock "a9b960cb-39bd-4f31-9920-5ce31d5db139-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:02:05 user nova-compute[72444]: DEBUG nova.compute.manager [req-61ccf49b-cf27-40d7-ba6d-45b56e2f717f req-501c93b7-5a4b-4f34-b011-327064462583 service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] No waiting events found dispatching network-vif-plugged-68a682f5-6dbc-4c9b-ab56-b91c8cb93810 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:02:05 user nova-compute[72444]: WARNING nova.compute.manager [req-61ccf49b-cf27-40d7-ba6d-45b56e2f717f req-501c93b7-5a4b-4f34-b011-327064462583 service nova] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Received unexpected event network-vif-plugged-68a682f5-6dbc-4c9b-ab56-b91c8cb93810 for instance with vm_state deleted and task_state None.
Aug 03 05:02:05 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-52912b2a-6bbc-4bc0-b0f4-4682365a26a2 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:02:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-52912b2a-6bbc-4bc0-b0f4-4682365a26a2 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.830s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:02:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.225s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:02:05 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-52912b2a-6bbc-4bc0-b0f4-4682365a26a2 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Deleted allocations for instance a9b960cb-39bd-4f31-9920-5ce31d5db139
Aug 03 05:02:05 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 4f225dc2-3011-4c15-bb8e-1ebb079a3b50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:02:05 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance d5b2e7fa-a2cc-42c9-89da-8f8850e748be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:02:05 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:02:05 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:02:05 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:02:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-52912b2a-6bbc-4bc0-b0f4-4682365a26a2 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "a9b960cb-39bd-4f31-9920-5ce31d5db139" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.603s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:02:05 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:02:05 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:02:05 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:02:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.282s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:02:05 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:02:05 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72444) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 03 05:02:05 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:02:05 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:02:05 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:02:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:02:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:02:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:02:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:02:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:18 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691038923.5945876, a9b960cb-39bd-4f31-9920-5ce31d5db139 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:02:18 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] VM Stopped (Lifecycle Event)
Aug 03 05:02:18 user nova-compute[72444]: DEBUG nova.compute.manager [None req-d32f47ab-d46d-4d24-ab16-71358d1cac11 None None] [instance: a9b960cb-39bd-4f31-9920-5ce31d5db139] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:02:18 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Acquiring lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:02:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:02:22 user nova-compute[72444]: DEBUG nova.objects.instance [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lazy-loading 'flavor' on Instance uuid 4f225dc2-3011-4c15-bb8e-1ebb079a3b50 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:02:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:02:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Acquiring lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:02:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:02:22 user nova-compute[72444]: INFO nova.compute.manager [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Attaching volume 2b52b731-02ae-4042-b0c7-41734eabc3b1 to /dev/vdb
Aug 03 05:02:22 user nova-compute[72444]: DEBUG os_brick.utils [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:02:22 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:22 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:22 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc0b9a1-85da-461c-93c6-84b3dae8dd17]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:22 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:22 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:22 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3491d6-d665-4038-a1d9-01d3a95875a8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:22 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:22 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:22 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab4293a-2287-4715-870e-622cea05550e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:22 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[047227cd-86c3-4bdd-be57-11df898af0cd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:22 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:22 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:02:22 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 05:02:22 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:22 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:02:22 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 05:02:22 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b33902e-5cf3-4ce6-b85c-a3928ba4c943]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:22 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 05:02:22 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 05:02:22 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 05:02:22 user nova-compute[72444]: DEBUG os_brick.utils [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:02:22 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Updating existing volume attachment record: d4a72f16-3701-4239-8394-cebbc4343ca5 {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 05:02:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:29 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VvBMfthQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:02:30 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:02:30 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:02:30 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:02:30 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:02:30 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 05:02:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a9e0e9-ce3f-40bf-a1de-f6dff168f170]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 05:02:30 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[97954443-2bf8-453b-a5f6-3ce0420d0ff2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1] added
Aug 03 05:02:30 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[71797776-bb6a-4f80-9e72-822576fb2644]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[899de627-0a78-49c7-b248-64df91685513]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VvBMfthQ {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VvBMfthQ" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce0e902-b103-4fa5-b0c8-629a3f51bf0a]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VvBMfthQ'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8483740f-940c-40e1-80ca-cf20ab2e37b9]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ffe514-1bdb-4cdb-9662-1bca55dbc48d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 03 05:02:30 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 03 05:02:30 user nova-compute[72444]:  {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:02:30 user nova-compute[72444]: WARNING os_brick.initiator.connectors.iscsi [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 03 05:02:30 user nova-compute[72444]: 
Aug 03 05:02:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[97232a8d-19a6-4582-b4f6-ace3526275c3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1, portal: 172.16.0.220,3260]
Aug 03 05:02:30 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1, portal: 172.16.0.220,3260] successful.
Aug 03 05:02:30 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adcf847-b270-433a-82af-a9fc9eef8511]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ea3d75-3804-4e10-b5ed-b67925e96814]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)
Aug 03 05:02:30 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)
Aug 03 05:02:30 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacdd3fd-46f9-4136-a629-d9984da3ff0c]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VvBMfthQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 05:02:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:31 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:02:31 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23936643465326264', 'path': '/dev/sdb'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:02:31 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936643465326264', 'path': '/dev/sdb'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 05:02:31 user nova-compute[72444]: DEBUG nova.objects.instance [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lazy-loading 'flavor' on Instance uuid 4f225dc2-3011-4c15-bb8e-1ebb079a3b50 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:02:31 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 05:02:31 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:02:31 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 05:02:31 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 05:02:31 user nova-compute[72444]:   <serial>2b52b731-02ae-4042-b0c7-41734eabc3b1</serial>
Aug 03 05:02:31 user nova-compute[72444]: </disk>
Aug 03 05:02:31 user nova-compute[72444]:  {{(pid=72444) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 05:02:31 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:02:31 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:02:31 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] No VIF found with MAC fa:16:3e:65:c2:ad, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 05:02:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b9f8691f-8475-4f8a-a3c9-79d427cf613a tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.370s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:02:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Acquiring lock "c10deaa3-d425-40b6-9b3f-d953164eadb8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:02:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Lock "c10deaa3-d425-40b6-9b3f-d953164eadb8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:02:32 user nova-compute[72444]: DEBUG nova.compute.manager [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 05:02:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:02:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:02:33 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 05:02:33 user nova-compute[72444]: INFO nova.compute.claims [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Claim successful on node user
Aug 03 05:02:33 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:02:33 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:02:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.242s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:02:33 user nova-compute[72444]: DEBUG nova.compute.manager [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 05:02:33 user nova-compute[72444]: DEBUG nova.compute.manager [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 05:02:33 user nova-compute[72444]: DEBUG nova.network.neutron [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 05:02:33 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 05:02:33 user nova-compute[72444]: DEBUG nova.compute.manager [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 05:02:33 user nova-compute[72444]: DEBUG nova.policy [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '47e6135e606e4f59b712680b76dc4c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9faa4713af40faab9d6f37da3e9562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 05:02:33 user nova-compute[72444]: DEBUG nova.compute.manager [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 05:02:33 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 05:02:33 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Creating image(s)
Aug 03 05:02:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Acquiring lock "/opt/stack/data/nova/instances/c10deaa3-d425-40b6-9b3f-d953164eadb8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:02:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Lock "/opt/stack/data/nova/instances/c10deaa3-d425-40b6-9b3f-d953164eadb8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:02:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Lock "/opt/stack/data/nova/instances/c10deaa3-d425-40b6-9b3f-d953164eadb8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:02:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:33 user nova-compute[72444]: DEBUG nova.compute.manager [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Stashing vm_state: active {{(pid=72444) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 03 05:02:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.142s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:02:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:02:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:02:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:02:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.141s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/c10deaa3-d425-40b6-9b3f-d953164eadb8/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:33 user nova-compute[72444]: DEBUG nova.objects.instance [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lazy-loading 'pci_requests' on Instance uuid 4f225dc2-3011-4c15-bb8e-1ebb079a3b50 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:02:33 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 05:02:33 user nova-compute[72444]: INFO nova.compute.claims [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Claim successful on node user
Aug 03 05:02:33 user nova-compute[72444]: DEBUG nova.objects.instance [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lazy-loading 'resources' on Instance uuid 4f225dc2-3011-4c15-bb8e-1ebb079a3b50 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:02:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/c10deaa3-d425-40b6-9b3f-d953164eadb8/disk 1073741824" returned: 0 in 0.069s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:02:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:33 user nova-compute[72444]: DEBUG nova.objects.instance [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f225dc2-3011-4c15-bb8e-1ebb079a3b50 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:02:33 user nova-compute[72444]: INFO nova.compute.resource_tracker [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Updating resource usage from migration 33ed3e3d-68a7-48f5-93c6-ff84fb352b8d
Aug 03 05:02:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.139s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:33 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c10deaa3-d425-40b6-9b3f-d953164eadb8/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 05:02:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10deaa3-d425-40b6-9b3f-d953164eadb8/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:34 user nova-compute[72444]: DEBUG nova.network.neutron [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Successfully created port: ef8f695a-323f-430d-88ac-7e83cdfa8b51 {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 05:02:34 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10deaa3-d425-40b6-9b3f-d953164eadb8/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:34 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Cannot resize image /opt/stack/data/nova/instances/c10deaa3-d425-40b6-9b3f-d953164eadb8/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 05:02:34 user nova-compute[72444]: DEBUG nova.objects.instance [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Lazy-loading 'migration_context' on Instance uuid c10deaa3-d425-40b6-9b3f-d953164eadb8 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:02:34 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:02:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 05:02:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Ensure instance console log exists: /opt/stack/data/nova/instances/c10deaa3-d425-40b6-9b3f-d953164eadb8/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 05:02:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:02:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:02:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:02:34 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:02:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.424s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:02:34 user nova-compute[72444]: INFO nova.compute.manager [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Migrating
Aug 03 05:02:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Acquiring lock "refresh_cache-4f225dc2-3011-4c15-bb8e-1ebb079a3b50" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:02:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Acquired lock "refresh_cache-4f225dc2-3011-4c15-bb8e-1ebb079a3b50" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:02:34 user nova-compute[72444]: DEBUG nova.network.neutron [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 05:02:34 user nova-compute[72444]: DEBUG nova.network.neutron [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Updating instance_info_cache with network_info: [{"id": "775b17bb-97a7-4a00-9368-198abafa4f8b", "address": "fa:16:3e:65:c2:ad", "network": {"id": "dd246ddd-6ffb-4516-b262-ef339c3f195c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2067592626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac3f775464f48d88f05efdf3aeb4fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b17bb-97", "ovs_interfaceid": "775b17bb-97a7-4a00-9368-198abafa4f8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:02:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Releasing lock "refresh_cache-4f225dc2-3011-4c15-bb8e-1ebb079a3b50" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:02:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Starting migrate_disk_and_power_off {{(pid=72444) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 03 05:02:34 user nova-compute[72444]: DEBUG nova.network.neutron [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Successfully updated port: ef8f695a-323f-430d-88ac-7e83cdfa8b51 {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 05:02:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Acquiring lock "refresh_cache-c10deaa3-d425-40b6-9b3f-d953164eadb8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:02:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Acquired lock "refresh_cache-c10deaa3-d425-40b6-9b3f-d953164eadb8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:02:34 user nova-compute[72444]: DEBUG nova.network.neutron [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 05:02:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:34 user nova-compute[72444]: DEBUG nova.compute.manager [req-d2fe060a-0618-4c24-a268-588ee0039a42 req-5248fbb0-82b9-4257-a82f-a76ed4044492 service nova] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Received event network-changed-ef8f695a-323f-430d-88ac-7e83cdfa8b51 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:02:34 user nova-compute[72444]: DEBUG nova.compute.manager [req-d2fe060a-0618-4c24-a268-588ee0039a42 req-5248fbb0-82b9-4257-a82f-a76ed4044492 service nova] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Refreshing instance network info cache due to event network-changed-ef8f695a-323f-430d-88ac-7e83cdfa8b51. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:02:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d2fe060a-0618-4c24-a268-588ee0039a42 req-5248fbb0-82b9-4257-a82f-a76ed4044492 service nova] Acquiring lock "refresh_cache-c10deaa3-d425-40b6-9b3f-d953164eadb8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:02:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:34 user nova-compute[72444]: DEBUG nova.network.neutron [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG nova.compute.manager [req-5fbcd024-c9c7-4272-bfb6-5affc7e4f2ef req-b16ef9f8-dd77-41e2-bb02-4aaa7f5038de service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Received event network-vif-unplugged-775b17bb-97a7-4a00-9368-198abafa4f8b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5fbcd024-c9c7-4272-bfb6-5affc7e4f2ef req-b16ef9f8-dd77-41e2-bb02-4aaa7f5038de service nova] Acquiring lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5fbcd024-c9c7-4272-bfb6-5affc7e4f2ef req-b16ef9f8-dd77-41e2-bb02-4aaa7f5038de service nova] Lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5fbcd024-c9c7-4272-bfb6-5affc7e4f2ef req-b16ef9f8-dd77-41e2-bb02-4aaa7f5038de service nova] Lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG nova.compute.manager [req-5fbcd024-c9c7-4272-bfb6-5affc7e4f2ef req-b16ef9f8-dd77-41e2-bb02-4aaa7f5038de service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] No waiting events found dispatching network-vif-unplugged-775b17bb-97a7-4a00-9368-198abafa4f8b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:02:35 user nova-compute[72444]: WARNING nova.compute.manager [req-5fbcd024-c9c7-4272-bfb6-5affc7e4f2ef req-b16ef9f8-dd77-41e2-bb02-4aaa7f5038de service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Received unexpected event network-vif-unplugged-775b17bb-97a7-4a00-9368-198abafa4f8b for instance with vm_state active and task_state resize_migrating.
Aug 03 05:02:35 user nova-compute[72444]: DEBUG nova.network.neutron [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Updating instance_info_cache with network_info: [{"id": "ef8f695a-323f-430d-88ac-7e83cdfa8b51", "address": "fa:16:3e:29:7b:75", "network": {"id": "bc45559b-dcbf-41d7-82b5-72a479e25ae6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-620825918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd9faa4713af40faab9d6f37da3e9562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8f695a-32", "ovs_interfaceid": "ef8f695a-323f-430d-88ac-7e83cdfa8b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Releasing lock "refresh_cache-c10deaa3-d425-40b6-9b3f-d953164eadb8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG nova.compute.manager [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Instance network_info: |[{"id": "ef8f695a-323f-430d-88ac-7e83cdfa8b51", "address": "fa:16:3e:29:7b:75", "network": {"id": "bc45559b-dcbf-41d7-82b5-72a479e25ae6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-620825918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd9faa4713af40faab9d6f37da3e9562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8f695a-32", "ovs_interfaceid": "ef8f695a-323f-430d-88ac-7e83cdfa8b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d2fe060a-0618-4c24-a268-588ee0039a42 req-5248fbb0-82b9-4257-a82f-a76ed4044492 service nova] Acquired lock "refresh_cache-c10deaa3-d425-40b6-9b3f-d953164eadb8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG nova.network.neutron [req-d2fe060a-0618-4c24-a268-588ee0039a42 req-5248fbb0-82b9-4257-a82f-a76ed4044492 service nova] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Refreshing network info cache for port ef8f695a-323f-430d-88ac-7e83cdfa8b51 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Start _get_guest_xml network_info=[{"id": "ef8f695a-323f-430d-88ac-7e83cdfa8b51", "address": "fa:16:3e:29:7b:75", "network": {"id": "bc45559b-dcbf-41d7-82b5-72a479e25ae6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-620825918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd9faa4713af40faab9d6f37da3e9562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8f695a-32", "ovs_interfaceid": "ef8f695a-323f-430d-88ac-7e83cdfa8b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 05:02:35 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:02:35 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:02:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:02:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1595956275',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1595956275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1595956',id=38,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJbsDF0MXdl32wOVoQK8HYheqnX83O99URXb1PZazUvgEGsnjgWDY6ZSF9OnXr6b9cGbtHi26kb4s9OGSmPzl6RD/qGS9qJ4Q5HBieIaWJu3RKjh3TdxL+gXFs+xayZ+w==',key_name='tempest-keypair-1116077515',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd9faa4713af40faab9d6f37da3e9562',ramdisk_id='',reservation_id='r-2f904z42',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-685172074',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:02:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47e6135e606e4f59b712680b76dc4c35',uuid=c10deaa3-d425-40b6-9b3f-d953164eadb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef8f695a-323f-430d-88ac-7e83cdfa8b51", "address": "fa:16:3e:29:7b:75", "network": {"id": "bc45559b-dcbf-41d7-82b5-72a479e25ae6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-620825918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd9faa4713af40faab9d6f37da3e9562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8f695a-32", "ovs_interfaceid": "ef8f695a-323f-430d-88ac-7e83cdfa8b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Converting VIF {"id": "ef8f695a-323f-430d-88ac-7e83cdfa8b51", "address": "fa:16:3e:29:7b:75", "network": {"id": "bc45559b-dcbf-41d7-82b5-72a479e25ae6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-620825918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd9faa4713af40faab9d6f37da3e9562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8f695a-32", "ovs_interfaceid": "ef8f695a-323f-430d-88ac-7e83cdfa8b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:7b:75,bridge_name='br-int',has_traffic_filtering=True,id=ef8f695a-323f-430d-88ac-7e83cdfa8b51,network=Network(bc45559b-dcbf-41d7-82b5-72a479e25ae6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8f695a-32') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG nova.objects.instance [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Lazy-loading 'pci_devices' on Instance uuid c10deaa3-d425-40b6-9b3f-d953164eadb8 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] End _get_guest_xml xml=<domain type="kvm">
Aug 03 05:02:35 user nova-compute[72444]:   <uuid>c10deaa3-d425-40b6-9b3f-d953164eadb8</uuid>
Aug 03 05:02:35 user nova-compute[72444]:   <name>instance-00000026</name>
Aug 03 05:02:35 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 05:02:35 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 05:02:35 user nova-compute[72444]:   <metadata>
Aug 03 05:02:35 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 05:02:35 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 05:02:35 user nova-compute[72444]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1595956275</nova:name>
Aug 03 05:02:35 user nova-compute[72444]:       <nova:creationTime>2023-08-03 05:02:35</nova:creationTime>
Aug 03 05:02:35 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 05:02:35 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 05:02:35 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 05:02:35 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 05:02:35 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 05:02:35 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 05:02:35 user nova-compute[72444]:       </nova:flavor>
Aug 03 05:02:35 user nova-compute[72444]:       <nova:owner>
Aug 03 05:02:35 user nova-compute[72444]:         <nova:user uuid="47e6135e606e4f59b712680b76dc4c35">tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member</nova:user>
Aug 03 05:02:35 user nova-compute[72444]:         <nova:project uuid="bd9faa4713af40faab9d6f37da3e9562">tempest-TestServerVolumeAttachScenarioOldVersion-685172074</nova:project>
Aug 03 05:02:35 user nova-compute[72444]:       </nova:owner>
Aug 03 05:02:35 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 05:02:35 user nova-compute[72444]:       <nova:ports>
Aug 03 05:02:35 user nova-compute[72444]:         <nova:port uuid="ef8f695a-323f-430d-88ac-7e83cdfa8b51">
Aug 03 05:02:35 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 03 05:02:35 user nova-compute[72444]:         </nova:port>
Aug 03 05:02:35 user nova-compute[72444]:       </nova:ports>
Aug 03 05:02:35 user nova-compute[72444]:     </nova:instance>
Aug 03 05:02:35 user nova-compute[72444]:   </metadata>
Aug 03 05:02:35 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 05:02:35 user nova-compute[72444]:     <system>
Aug 03 05:02:35 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 05:02:35 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 05:02:35 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 05:02:35 user nova-compute[72444]:       <entry name="serial">c10deaa3-d425-40b6-9b3f-d953164eadb8</entry>
Aug 03 05:02:35 user nova-compute[72444]:       <entry name="uuid">c10deaa3-d425-40b6-9b3f-d953164eadb8</entry>
Aug 03 05:02:35 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 05:02:35 user nova-compute[72444]:     </system>
Aug 03 05:02:35 user nova-compute[72444]:   </sysinfo>
Aug 03 05:02:35 user nova-compute[72444]:   <os>
Aug 03 05:02:35 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 05:02:35 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 05:02:35 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 05:02:35 user nova-compute[72444]:   </os>
Aug 03 05:02:35 user nova-compute[72444]:   <features>
Aug 03 05:02:35 user nova-compute[72444]:     <acpi/>
Aug 03 05:02:35 user nova-compute[72444]:     <apic/>
Aug 03 05:02:35 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 05:02:35 user nova-compute[72444]:   </features>
Aug 03 05:02:35 user nova-compute[72444]:   <clock offset="utc">
Aug 03 05:02:35 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 05:02:35 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 05:02:35 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 05:02:35 user nova-compute[72444]:   </clock>
Aug 03 05:02:35 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 05:02:35 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 05:02:35 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 05:02:35 user nova-compute[72444]:   </cpu>
Aug 03 05:02:35 user nova-compute[72444]:   <devices>
Aug 03 05:02:35 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 05:02:35 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 05:02:35 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/c10deaa3-d425-40b6-9b3f-d953164eadb8/disk"/>
Aug 03 05:02:35 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 05:02:35 user nova-compute[72444]:     </disk>
Aug 03 05:02:35 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 05:02:35 user nova-compute[72444]:       <mac address="fa:16:3e:29:7b:75"/>
Aug 03 05:02:35 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:02:35 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 05:02:35 user nova-compute[72444]:       <target dev="tapef8f695a-32"/>
Aug 03 05:02:35 user nova-compute[72444]:     </interface>
Aug 03 05:02:35 user nova-compute[72444]:     <serial type="pty">
Aug 03 05:02:35 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/c10deaa3-d425-40b6-9b3f-d953164eadb8/console.log" append="off"/>
Aug 03 05:02:35 user nova-compute[72444]:     </serial>
Aug 03 05:02:35 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 05:02:35 user nova-compute[72444]:     <video>
Aug 03 05:02:35 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:02:35 user nova-compute[72444]:     </video>
Aug 03 05:02:35 user nova-compute[72444]:     <rng model="virtio">
Aug 03 05:02:35 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 05:02:35 user nova-compute[72444]:     </rng>
Aug 03 05:02:35 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 05:02:35 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 05:02:35 user nova-compute[72444]:       <stats period="10"/>
Aug 03 05:02:35 user nova-compute[72444]:     </memballoon>
Aug 03 05:02:35 user nova-compute[72444]:   </devices>
Aug 03 05:02:35 user nova-compute[72444]: </domain>
Aug 03 05:02:35 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:02:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1595956275',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1595956275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1595956',id=38,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJbsDF0MXdl32wOVoQK8HYheqnX83O99URXb1PZazUvgEGsnjgWDY6ZSF9OnXr6b9cGbtHi26kb4s9OGSmPzl6RD/qGS9qJ4Q5HBieIaWJu3RKjh3TdxL+gXFs+xayZ+w==',key_name='tempest-keypair-1116077515',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd9faa4713af40faab9d6f37da3e9562',ramdisk_id='',reservation_id='r-2f904z42',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-685172074',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:02:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47e6135e606e4f59b712680b76dc4c35',uuid=c10deaa3-d425-40b6-9b3f-d953164eadb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef8f695a-323f-430d-88ac-7e83cdfa8b51", "address": "fa:16:3e:29:7b:75", "network": {"id": "bc45559b-dcbf-41d7-82b5-72a479e25ae6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-620825918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd9faa4713af40faab9d6f37da3e9562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8f695a-32", "ovs_interfaceid": "ef8f695a-323f-430d-88ac-7e83cdfa8b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Converting VIF {"id": "ef8f695a-323f-430d-88ac-7e83cdfa8b51", "address": "fa:16:3e:29:7b:75", "network": {"id": "bc45559b-dcbf-41d7-82b5-72a479e25ae6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-620825918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd9faa4713af40faab9d6f37da3e9562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8f695a-32", "ovs_interfaceid": "ef8f695a-323f-430d-88ac-7e83cdfa8b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:7b:75,bridge_name='br-int',has_traffic_filtering=True,id=ef8f695a-323f-430d-88ac-7e83cdfa8b51,network=Network(bc45559b-dcbf-41d7-82b5-72a479e25ae6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8f695a-32') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG os_vif [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:7b:75,bridge_name='br-int',has_traffic_filtering=True,id=ef8f695a-323f-430d-88ac-7e83cdfa8b51,network=Network(bc45559b-dcbf-41d7-82b5-72a479e25ae6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8f695a-32') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef8f695a-32, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapef8f695a-32, col_values=(('external_ids', {'iface-id': 'ef8f695a-323f-430d-88ac-7e83cdfa8b51', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:7b:75', 'vm-uuid': 'c10deaa3-d425-40b6-9b3f-d953164eadb8'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:35 user nova-compute[72444]: INFO os_vif [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:7b:75,bridge_name='br-int',has_traffic_filtering=True,id=ef8f695a-323f-430d-88ac-7e83cdfa8b51,network=Network(bc45559b-dcbf-41d7-82b5-72a479e25ae6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8f695a-32')
Aug 03 05:02:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] No VIF found with MAC fa:16:3e:29:7b:75, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:35 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Instance destroyed successfully.
Aug 03 05:02:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:58:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1296432438',display_name='tempest-ServerActionsTestOtherB-server-1296432438',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1296432438',id=35,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJ2xwGpHSyejfRET9nle34ymsQ3JqEh+tuKb2KyDC9LlCqAQDSefnEuOykG9x3OwiAXCAIlmzscOwuKKHQpDe3RMRIrjD9v6y95AwIln0JKokDq03KE9SlxC2ULq7kCag==',key_name='tempest-keypair-1872408921',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:58:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3ac3f775464f48d88f05efdf3aeb4fb8',ramdisk_id='',reservation_id='r-0ygb2937',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1191335247',owner_user_name='tempest-ServerActionsTestOtherB-1191335247-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T05:02:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32aef58e87044e47b99cd37e300393aa',uuid=4f225dc2-3011-4c15-bb8e-1ebb079a3b50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "775b17bb-97a7-4a00-9368-198abafa4f8b", "address": "fa:16:3e:65:c2:ad", "network": {"id": "dd246ddd-6ffb-4516-b262-ef339c3f195c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2067592626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2067592626-network", "vif_mac": "fa:16:3e:65:c2:ad"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac3f775464f48d88f05efdf3aeb4fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b17bb-97", "ovs_interfaceid": "775b17bb-97a7-4a00-9368-198abafa4f8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Converting VIF {"id": "775b17bb-97a7-4a00-9368-198abafa4f8b", "address": "fa:16:3e:65:c2:ad", "network": {"id": "dd246ddd-6ffb-4516-b262-ef339c3f195c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2067592626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2067592626-network", "vif_mac": "fa:16:3e:65:c2:ad"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac3f775464f48d88f05efdf3aeb4fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b17bb-97", "ovs_interfaceid": "775b17bb-97a7-4a00-9368-198abafa4f8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:c2:ad,bridge_name='br-int',has_traffic_filtering=True,id=775b17bb-97a7-4a00-9368-198abafa4f8b,network=Network(dd246ddd-6ffb-4516-b262-ef339c3f195c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775b17bb-97') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG os_vif [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:c2:ad,bridge_name='br-int',has_traffic_filtering=True,id=775b17bb-97a7-4a00-9368-198abafa4f8b,network=Network(dd246ddd-6ffb-4516-b262-ef339c3f195c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775b17bb-97') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap775b17bb-97, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:35 user nova-compute[72444]: INFO os_vif [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:c2:ad,bridge_name='br-int',has_traffic_filtering=True,id=775b17bb-97a7-4a00-9368-198abafa4f8b,network=Network(dd246ddd-6ffb-4516-b262-ef339c3f195c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775b17bb-97')
Aug 03 05:02:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VvBMfthQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:02:35 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:02:35 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15ffca5-ae1d-498a-b8b7-22b729e4c9ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca77131-4313-42cf-82b3-9a3fab654afb]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)
Aug 03 05:02:35 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)
Aug 03 05:02:35 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30a0dbf010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1'): ({'sdb'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Removing single pathed devices sdb {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ef526c-f00b-4f20-8799-0b5bd2bc59bb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:35 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac8049a-2f45-4122-b253-ecc1ea4d6f30]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Flushing IO for device /dev/sdb {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5cc5feb-079f-45d6-b3c7-612072a0dc0e]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG nova.network.neutron [req-d2fe060a-0618-4c24-a268-588ee0039a42 req-5248fbb0-82b9-4257-a82f-a76ed4044492 service nova] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Updated VIF entry in instance network info cache for port ef8f695a-323f-430d-88ac-7e83cdfa8b51. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG nova.network.neutron [req-d2fe060a-0618-4c24-a268-588ee0039a42 req-5248fbb0-82b9-4257-a82f-a76ed4044492 service nova] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Updating instance_info_cache with network_info: [{"id": "ef8f695a-323f-430d-88ac-7e83cdfa8b51", "address": "fa:16:3e:29:7b:75", "network": {"id": "bc45559b-dcbf-41d7-82b5-72a479e25ae6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-620825918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd9faa4713af40faab9d6f37da3e9562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8f695a-32", "ovs_interfaceid": "ef8f695a-323f-430d-88ac-7e83cdfa8b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d2fe060a-0618-4c24-a268-588ee0039a42 req-5248fbb0-82b9-4257-a82f-a76ed4044492 service nova] Releasing lock "refresh_cache-c10deaa3-d425-40b6-9b3f-d953164eadb8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc8ea35-8dd4-4dba-a058-803046cb0d62]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2a2f28-9ac7-4c75-8a8c-3877fb1181c1]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e45301-4c3d-46ff-8842-97c22468f47b]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1, portal: 172.16.0.220,3260]
Aug 03 05:02:36 user nova-compute[72444]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1, portal: 172.16.0.220,3260] successful.
Aug 03 05:02:36 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7896359-2ac3-473b-a0b7-45948a630b87]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.243s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] <== disconnect_volume: return (244ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50_resize/disk /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] CMD "cp -r /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50_resize/disk /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk" returned: 0 in 0.171s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50_resize/disk.info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk.info {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] CMD "cp -r /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50_resize/disk.info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk.info" returned: 0 in 0.031s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:37 user nova-compute[72444]: DEBUG nova.compute.manager [req-e497c037-6a96-434e-93e1-885147cc2bb6 req-2ea69bc0-1eb3-4d5a-93ef-1076fc665d7c service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Received event network-vif-plugged-775b17bb-97a7-4a00-9368-198abafa4f8b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:02:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e497c037-6a96-434e-93e1-885147cc2bb6 req-2ea69bc0-1eb3-4d5a-93ef-1076fc665d7c service nova] Acquiring lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:02:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e497c037-6a96-434e-93e1-885147cc2bb6 req-2ea69bc0-1eb3-4d5a-93ef-1076fc665d7c service nova] Lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:02:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e497c037-6a96-434e-93e1-885147cc2bb6 req-2ea69bc0-1eb3-4d5a-93ef-1076fc665d7c service nova] Lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:02:37 user nova-compute[72444]: DEBUG nova.compute.manager [req-e497c037-6a96-434e-93e1-885147cc2bb6 req-2ea69bc0-1eb3-4d5a-93ef-1076fc665d7c service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] No waiting events found dispatching network-vif-plugged-775b17bb-97a7-4a00-9368-198abafa4f8b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:02:37 user nova-compute[72444]: WARNING nova.compute.manager [req-e497c037-6a96-434e-93e1-885147cc2bb6 req-2ea69bc0-1eb3-4d5a-93ef-1076fc665d7c service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Received unexpected event network-vif-plugged-775b17bb-97a7-4a00-9368-198abafa4f8b for instance with vm_state active and task_state resize_migrating.
Aug 03 05:02:37 user nova-compute[72444]: DEBUG nova.compute.manager [req-e497c037-6a96-434e-93e1-885147cc2bb6 req-2ea69bc0-1eb3-4d5a-93ef-1076fc665d7c service nova] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Received event network-vif-plugged-ef8f695a-323f-430d-88ac-7e83cdfa8b51 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:02:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e497c037-6a96-434e-93e1-885147cc2bb6 req-2ea69bc0-1eb3-4d5a-93ef-1076fc665d7c service nova] Acquiring lock "c10deaa3-d425-40b6-9b3f-d953164eadb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:02:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e497c037-6a96-434e-93e1-885147cc2bb6 req-2ea69bc0-1eb3-4d5a-93ef-1076fc665d7c service nova] Lock "c10deaa3-d425-40b6-9b3f-d953164eadb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:02:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e497c037-6a96-434e-93e1-885147cc2bb6 req-2ea69bc0-1eb3-4d5a-93ef-1076fc665d7c service nova] Lock "c10deaa3-d425-40b6-9b3f-d953164eadb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:02:37 user nova-compute[72444]: DEBUG nova.compute.manager [req-e497c037-6a96-434e-93e1-885147cc2bb6 req-2ea69bc0-1eb3-4d5a-93ef-1076fc665d7c service nova] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] No waiting events found dispatching network-vif-plugged-ef8f695a-323f-430d-88ac-7e83cdfa8b51 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:02:37 user nova-compute[72444]: WARNING nova.compute.manager [req-e497c037-6a96-434e-93e1-885147cc2bb6 req-2ea69bc0-1eb3-4d5a-93ef-1076fc665d7c service nova] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Received unexpected event network-vif-plugged-ef8f695a-323f-430d-88ac-7e83cdfa8b51 for instance with vm_state building and task_state spawning.
Aug 03 05:02:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:37 user nova-compute[72444]: DEBUG nova.network.neutron [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Port 775b17bb-97a7-4a00-9368-198abafa4f8b binding to destination host user is already ACTIVE {{(pid=72444) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 03 05:02:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Acquiring lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:02:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:02:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:02:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Acquiring lock "refresh_cache-4f225dc2-3011-4c15-bb8e-1ebb079a3b50" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:02:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Acquired lock "refresh_cache-4f225dc2-3011-4c15-bb8e-1ebb079a3b50" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:02:38 user nova-compute[72444]: DEBUG nova.network.neutron [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 05:02:38 user nova-compute[72444]: DEBUG nova.network.neutron [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Updating instance_info_cache with network_info: [{"id": "775b17bb-97a7-4a00-9368-198abafa4f8b", "address": "fa:16:3e:65:c2:ad", "network": {"id": "dd246ddd-6ffb-4516-b262-ef339c3f195c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2067592626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac3f775464f48d88f05efdf3aeb4fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b17bb-97", "ovs_interfaceid": "775b17bb-97a7-4a00-9368-198abafa4f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:02:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Releasing lock "refresh_cache-4f225dc2-3011-4c15-bb8e-1ebb079a3b50" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:02:38 user nova-compute[72444]: DEBUG os_brick.utils [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:02:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc190d00-7a23-4c53-b0b1-43eee8c36517]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab716f2-10dc-4109-a0d2-bb2af749fc17]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38759a0-d14b-4e45-9585-296dbec6cef6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6183a8c-9176-4a9e-8806-52c9108f6716]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:02:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 05:02:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:02:38 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 05:02:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ce9d08-e23e-4f3f-9bec-12f9ac0eb885]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 05:02:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 05:02:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 05:02:38 user nova-compute[72444]: DEBUG os_brick.utils [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:02:38 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038958.9515407, c10deaa3-d425-40b6-9b3f-d953164eadb8 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:02:38 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] VM Resumed (Lifecycle Event)
Aug 03 05:02:38 user nova-compute[72444]: DEBUG nova.compute.manager [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 05:02:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 05:02:38 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Instance spawned successfully.
Aug 03 05:02:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 05:02:38 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:02:38 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:02:39 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 05:02:39 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038958.9594617, c10deaa3-d425-40b6-9b3f-d953164eadb8 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:02:39 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] VM Started (Lifecycle Event)
Aug 03 05:02:39 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:02:39 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:02:39 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:02:39 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:02:39 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:02:39 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:02:39 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:02:39 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:02:39 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 05:02:39 user nova-compute[72444]: INFO nova.compute.manager [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Took 5.63 seconds to spawn the instance on the hypervisor.
Aug 03 05:02:39 user nova-compute[72444]: DEBUG nova.compute.manager [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:02:39 user nova-compute[72444]: INFO nova.compute.manager [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Took 6.20 seconds to build instance.
Aug 03 05:02:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ce16d0f8-7692-4348-baf4-f1be1546f3e0 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Lock "c10deaa3-d425-40b6-9b3f-d953164eadb8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.285s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:02:39 user nova-compute[72444]: DEBUG nova.compute.manager [req-af86f239-2710-41b1-bda4-1697fae691a9 req-a2f6bb74-a14f-4bd8-aee7-0213c87e1f2e service nova] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Received event network-vif-plugged-ef8f695a-323f-430d-88ac-7e83cdfa8b51 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:02:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-af86f239-2710-41b1-bda4-1697fae691a9 req-a2f6bb74-a14f-4bd8-aee7-0213c87e1f2e service nova] Acquiring lock "c10deaa3-d425-40b6-9b3f-d953164eadb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:02:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-af86f239-2710-41b1-bda4-1697fae691a9 req-a2f6bb74-a14f-4bd8-aee7-0213c87e1f2e service nova] Lock "c10deaa3-d425-40b6-9b3f-d953164eadb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:02:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-af86f239-2710-41b1-bda4-1697fae691a9 req-a2f6bb74-a14f-4bd8-aee7-0213c87e1f2e service nova] Lock "c10deaa3-d425-40b6-9b3f-d953164eadb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:02:39 user nova-compute[72444]: DEBUG nova.compute.manager [req-af86f239-2710-41b1-bda4-1697fae691a9 req-a2f6bb74-a14f-4bd8-aee7-0213c87e1f2e service nova] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] No waiting events found dispatching network-vif-plugged-ef8f695a-323f-430d-88ac-7e83cdfa8b51 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:02:39 user nova-compute[72444]: WARNING nova.compute.manager [req-af86f239-2710-41b1-bda4-1697fae691a9 req-a2f6bb74-a14f-4bd8-aee7-0213c87e1f2e service nova] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Received unexpected event network-vif-plugged-ef8f695a-323f-430d-88ac-7e83cdfa8b51 for instance with vm_state active and task_state None.
Aug 03 05:02:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Starting finish_migration {{(pid=72444) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Instance directory exists: not creating {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 03 05:02:46 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Creating image(s)
Aug 03 05:02:46 user nova-compute[72444]: DEBUG nova.objects.instance [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4f225dc2-3011-4c15-bb8e-1ebb079a3b50 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.128s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk. size=21474836480 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk 21474836480 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk 21474836480" returned: 0 in 0.042s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Did not create local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Ensure instance console log exists: /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Start _get_guest_xml network_info=[{"id": "775b17bb-97a7-4a00-9368-198abafa4f8b", "address": "fa:16:3e:65:c2:ad", "network": {"id": "dd246ddd-6ffb-4516-b262-ef339c3f195c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2067592626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2067592626-network", "vif_mac": "fa:16:3e:65:c2:ad"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac3f775464f48d88f05efdf3aeb4fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b17bb-97", "ovs_interfaceid": "775b17bb-97a7-4a00-9368-198abafa4f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VvBMfthQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '4f225dc2-3011-4c15-bb8e-1ebb079a3b50', 'attached_at': '2023-08-03T05:02:46.000000', 'detached_at': '', 'volume_id': '2b52b731-02ae-4042-b0c7-41734eabc3b1', 'serial': '2b52b731-02ae-4042-b0c7-41734eabc3b1'}, 'disk_bus': 'virtio', 'attachment_id': '0218d54e-c83b-4f3f-a564-4831e2e58aea', 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 05:02:46 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:02:46 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:02:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG nova.objects.instance [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4f225dc2-3011-4c15-bb8e-1ebb079a3b50 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VvBMfthQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:02:46 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:02:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:02:46 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:02:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:02:46 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d8cb5e-450d-4e72-9472-1410f1261e67]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 05:02:46 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad5922e-3302-4a47-a476-7a164e6ed7a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1] added
Aug 03 05:02:46 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdcf6477-4c3e-456b-a103-3fd341b5b320]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[32270b1c-a58a-4c72-9d2a-1ddb72119c1b]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VvBMfthQ {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VvBMfthQ" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d482be-7a46-4916-b8cc-241250d4c8ce]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VvBMfthQ'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a012a867-4dc8-4193-a55f-df135c19233f]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[39dbe00e-e021-4424-a3b2-b759a333acb8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 03 05:02:46 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 03 05:02:46 user nova-compute[72444]:  {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:02:46 user nova-compute[72444]: WARNING os_brick.initiator.connectors.iscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 03 05:02:46 user nova-compute[72444]: 
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7cc7d5-899d-4353-ac7d-a354fca9a747]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1, portal: 172.16.0.220,3260]
Aug 03 05:02:46 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1, portal: 172.16.0.220,3260] successful.
Aug 03 05:02:46 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7a0241-0b0f-4714-a867-f577187c32fa]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[191cad45-9924-4dc6-9831-b30cabb079ed]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)
Aug 03 05:02:46 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)
Aug 03 05:02:46 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64cba74-40d5-4690-be0b-0e801bc67ef9]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 05:02:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VvBMfthQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 05:02:47 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:02:47 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23936643465326264', 'path': '/dev/sdb'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:02:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936643465326264', 'path': '/dev/sdb'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 05:02:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:58:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1296432438',display_name='tempest-ServerActionsTestOtherB-server-1296432438',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1296432438',id=35,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJ2xwGpHSyejfRET9nle34ymsQ3JqEh+tuKb2KyDC9LlCqAQDSefnEuOykG9x3OwiAXCAIlmzscOwuKKHQpDe3RMRIrjD9v6y95AwIln0JKokDq03KE9SlxC2ULq7kCag==',key_name='tempest-keypair-1872408921',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:58:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3ac3f775464f48d88f05efdf3aeb4fb8',ramdisk_id='',reservation_id='r-0ygb2937',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1191335247',owner_user_name='tempest-ServerActionsTestOtherB-1191335247-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:02:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32aef58e87044e47b99cd37e300393aa',uuid=4f225dc2-3011-4c15-bb8e-1ebb079a3b50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "775b17bb-97a7-4a00-9368-198abafa4f8b", "address": "fa:16:3e:65:c2:ad", "network": {"id": "dd246ddd-6ffb-4516-b262-ef339c3f195c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2067592626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2067592626-network", "vif_mac": "fa:16:3e:65:c2:ad"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac3f775464f48d88f05efdf3aeb4fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b17bb-97", "ovs_interfaceid": "775b17bb-97a7-4a00-9368-198abafa4f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 05:02:47 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Converting VIF {"id": "775b17bb-97a7-4a00-9368-198abafa4f8b", "address": "fa:16:3e:65:c2:ad", "network": {"id": "dd246ddd-6ffb-4516-b262-ef339c3f195c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2067592626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2067592626-network", "vif_mac": "fa:16:3e:65:c2:ad"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac3f775464f48d88f05efdf3aeb4fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b17bb-97", "ovs_interfaceid": "775b17bb-97a7-4a00-9368-198abafa4f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:02:47 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:c2:ad,bridge_name='br-int',has_traffic_filtering=True,id=775b17bb-97a7-4a00-9368-198abafa4f8b,network=Network(dd246ddd-6ffb-4516-b262-ef339c3f195c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775b17bb-97') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:02:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] End _get_guest_xml xml=<domain type="kvm">
Aug 03 05:02:47 user nova-compute[72444]:   <uuid>4f225dc2-3011-4c15-bb8e-1ebb079a3b50</uuid>
Aug 03 05:02:47 user nova-compute[72444]:   <name>instance-00000023</name>
Aug 03 05:02:47 user nova-compute[72444]:   <memory>2097152</memory>
Aug 03 05:02:47 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 05:02:47 user nova-compute[72444]:   <metadata>
Aug 03 05:02:47 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 05:02:47 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 05:02:47 user nova-compute[72444]:       <nova:name>tempest-ServerActionsTestOtherB-server-1296432438</nova:name>
Aug 03 05:02:47 user nova-compute[72444]:       <nova:creationTime>2023-08-03 05:02:46</nova:creationTime>
Aug 03 05:02:47 user nova-compute[72444]:       <nova:flavor name="m1.small">
Aug 03 05:02:47 user nova-compute[72444]:         <nova:memory>2048</nova:memory>
Aug 03 05:02:47 user nova-compute[72444]:         <nova:disk>20</nova:disk>
Aug 03 05:02:47 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 05:02:47 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 05:02:47 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 05:02:47 user nova-compute[72444]:       </nova:flavor>
Aug 03 05:02:47 user nova-compute[72444]:       <nova:owner>
Aug 03 05:02:47 user nova-compute[72444]:         <nova:user uuid="32aef58e87044e47b99cd37e300393aa">tempest-ServerActionsTestOtherB-1191335247-project-member</nova:user>
Aug 03 05:02:47 user nova-compute[72444]:         <nova:project uuid="3ac3f775464f48d88f05efdf3aeb4fb8">tempest-ServerActionsTestOtherB-1191335247</nova:project>
Aug 03 05:02:47 user nova-compute[72444]:       </nova:owner>
Aug 03 05:02:47 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 05:02:47 user nova-compute[72444]:       <nova:ports>
Aug 03 05:02:47 user nova-compute[72444]:         <nova:port uuid="775b17bb-97a7-4a00-9368-198abafa4f8b">
Aug 03 05:02:47 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 03 05:02:47 user nova-compute[72444]:         </nova:port>
Aug 03 05:02:47 user nova-compute[72444]:       </nova:ports>
Aug 03 05:02:47 user nova-compute[72444]:     </nova:instance>
Aug 03 05:02:47 user nova-compute[72444]:   </metadata>
Aug 03 05:02:47 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 05:02:47 user nova-compute[72444]:     <system>
Aug 03 05:02:47 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 05:02:47 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 05:02:47 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 05:02:47 user nova-compute[72444]:       <entry name="serial">4f225dc2-3011-4c15-bb8e-1ebb079a3b50</entry>
Aug 03 05:02:47 user nova-compute[72444]:       <entry name="uuid">4f225dc2-3011-4c15-bb8e-1ebb079a3b50</entry>
Aug 03 05:02:47 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 05:02:47 user nova-compute[72444]:     </system>
Aug 03 05:02:47 user nova-compute[72444]:   </sysinfo>
Aug 03 05:02:47 user nova-compute[72444]:   <os>
Aug 03 05:02:47 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 05:02:47 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 05:02:47 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 05:02:47 user nova-compute[72444]:   </os>
Aug 03 05:02:47 user nova-compute[72444]:   <features>
Aug 03 05:02:47 user nova-compute[72444]:     <acpi/>
Aug 03 05:02:47 user nova-compute[72444]:     <apic/>
Aug 03 05:02:47 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 05:02:47 user nova-compute[72444]:   </features>
Aug 03 05:02:47 user nova-compute[72444]:   <clock offset="utc">
Aug 03 05:02:47 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 05:02:47 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 05:02:47 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 05:02:47 user nova-compute[72444]:   </clock>
Aug 03 05:02:47 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 05:02:47 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 05:02:47 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 05:02:47 user nova-compute[72444]:   </cpu>
Aug 03 05:02:47 user nova-compute[72444]:   <devices>
Aug 03 05:02:47 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 05:02:47 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 05:02:47 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk"/>
Aug 03 05:02:47 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 05:02:47 user nova-compute[72444]:     </disk>
Aug 03 05:02:47 user nova-compute[72444]:     <disk type="block" device="disk">
Aug 03 05:02:47 user nova-compute[72444]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:02:47 user nova-compute[72444]:       <source dev="/dev/sdb"/>
Aug 03 05:02:47 user nova-compute[72444]:       <target dev="vdb" bus="virtio"/>
Aug 03 05:02:47 user nova-compute[72444]:       <serial>2b52b731-02ae-4042-b0c7-41734eabc3b1</serial>
Aug 03 05:02:47 user nova-compute[72444]:     </disk>
Aug 03 05:02:47 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 05:02:47 user nova-compute[72444]:       <mac address="fa:16:3e:65:c2:ad"/>
Aug 03 05:02:47 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:02:47 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 05:02:47 user nova-compute[72444]:       <target dev="tap775b17bb-97"/>
Aug 03 05:02:47 user nova-compute[72444]:     </interface>
Aug 03 05:02:47 user nova-compute[72444]:     <serial type="pty">
Aug 03 05:02:47 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/console.log" append="off"/>
Aug 03 05:02:47 user nova-compute[72444]:     </serial>
Aug 03 05:02:47 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 05:02:47 user nova-compute[72444]:     <video>
Aug 03 05:02:47 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:02:47 user nova-compute[72444]:     </video>
Aug 03 05:02:47 user nova-compute[72444]:     <rng model="virtio">
Aug 03 05:02:47 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 05:02:47 user nova-compute[72444]:     </rng>
Aug 03 05:02:47 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 05:02:47 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 05:02:47 user nova-compute[72444]:       <stats period="10"/>
Aug 03 05:02:47 user nova-compute[72444]:     </memballoon>
Aug 03 05:02:47 user nova-compute[72444]:   </devices>
Aug 03 05:02:47 user nova-compute[72444]: </domain>
Aug 03 05:02:47 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 05:02:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:58:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1296432438',display_name='tempest-ServerActionsTestOtherB-server-1296432438',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1296432438',id=35,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJ2xwGpHSyejfRET9nle34ymsQ3JqEh+tuKb2KyDC9LlCqAQDSefnEuOykG9x3OwiAXCAIlmzscOwuKKHQpDe3RMRIrjD9v6y95AwIln0JKokDq03KE9SlxC2ULq7kCag==',key_name='tempest-keypair-1872408921',keypairs=<?>,launch_index=0,launched_at=2023-08-03T04:58:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3ac3f775464f48d88f05efdf3aeb4fb8',ramdisk_id='',reservation_id='r-0ygb2937',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1191335247',owner_user_name='tempest-ServerActionsTestOtherB-1191335247-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:02:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32aef58e87044e47b99cd37e300393aa',uuid=4f225dc2-3011-4c15-bb8e-1ebb079a3b50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "775b17bb-97a7-4a00-9368-198abafa4f8b", "address": "fa:16:3e:65:c2:ad", "network": {"id": "dd246ddd-6ffb-4516-b262-ef339c3f195c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2067592626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2067592626-network", "vif_mac": "fa:16:3e:65:c2:ad"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac3f775464f48d88f05efdf3aeb4fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b17bb-97", "ovs_interfaceid": "775b17bb-97a7-4a00-9368-198abafa4f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 05:02:47 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Converting VIF {"id": "775b17bb-97a7-4a00-9368-198abafa4f8b", "address": "fa:16:3e:65:c2:ad", "network": {"id": "dd246ddd-6ffb-4516-b262-ef339c3f195c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2067592626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2067592626-network", "vif_mac": "fa:16:3e:65:c2:ad"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac3f775464f48d88f05efdf3aeb4fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b17bb-97", "ovs_interfaceid": "775b17bb-97a7-4a00-9368-198abafa4f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:02:47 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:c2:ad,bridge_name='br-int',has_traffic_filtering=True,id=775b17bb-97a7-4a00-9368-198abafa4f8b,network=Network(dd246ddd-6ffb-4516-b262-ef339c3f195c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775b17bb-97') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:02:47 user nova-compute[72444]: DEBUG os_vif [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:c2:ad,bridge_name='br-int',has_traffic_filtering=True,id=775b17bb-97a7-4a00-9368-198abafa4f8b,network=Network(dd246ddd-6ffb-4516-b262-ef339c3f195c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775b17bb-97') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 05:02:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:02:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 05:02:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap775b17bb-97, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:02:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap775b17bb-97, col_values=(('external_ids', {'iface-id': '775b17bb-97a7-4a00-9368-198abafa4f8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:c2:ad', 'vm-uuid': '4f225dc2-3011-4c15-bb8e-1ebb079a3b50'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:02:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:02:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:47 user nova-compute[72444]: INFO os_vif [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:c2:ad,bridge_name='br-int',has_traffic_filtering=True,id=775b17bb-97a7-4a00-9368-198abafa4f8b,network=Network(dd246ddd-6ffb-4516-b262-ef339c3f195c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775b17bb-97')
Aug 03 05:02:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:02:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:02:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] No VIF found with MAC fa:16:3e:65:c2:ad, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 05:02:48 user nova-compute[72444]: DEBUG nova.compute.manager [req-142dfe21-3991-4c7c-aad7-4640b7f6d449 req-e65609af-0ec2-4f67-84b5-9982ad6db43b service nova] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Received event network-changed-3409d644-fe83-4cee-aa78-9b0f8e360f50 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:02:48 user nova-compute[72444]: DEBUG nova.compute.manager [req-142dfe21-3991-4c7c-aad7-4640b7f6d449 req-e65609af-0ec2-4f67-84b5-9982ad6db43b service nova] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Refreshing instance network info cache due to event network-changed-3409d644-fe83-4cee-aa78-9b0f8e360f50. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:02:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-142dfe21-3991-4c7c-aad7-4640b7f6d449 req-e65609af-0ec2-4f67-84b5-9982ad6db43b service nova] Acquiring lock "refresh_cache-d5b2e7fa-a2cc-42c9-89da-8f8850e748be" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:02:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-142dfe21-3991-4c7c-aad7-4640b7f6d449 req-e65609af-0ec2-4f67-84b5-9982ad6db43b service nova] Acquired lock "refresh_cache-d5b2e7fa-a2cc-42c9-89da-8f8850e748be" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:02:48 user nova-compute[72444]: DEBUG nova.network.neutron [req-142dfe21-3991-4c7c-aad7-4640b7f6d449 req-e65609af-0ec2-4f67-84b5-9982ad6db43b service nova] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Refreshing network info cache for port 3409d644-fe83-4cee-aa78-9b0f8e360f50 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:02:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Acquiring lock "d5b2e7fa-a2cc-42c9-89da-8f8850e748be" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:02:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "d5b2e7fa-a2cc-42c9-89da-8f8850e748be" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:02:48 user nova-compute[72444]: DEBUG nova.objects.instance [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lazy-loading 'flavor' on Instance uuid d5b2e7fa-a2cc-42c9-89da-8f8850e748be {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:02:48 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Ignoring supplied device name: /dev/vdb
Aug 03 05:02:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "d5b2e7fa-a2cc-42c9-89da-8f8850e748be" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:02:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Acquiring lock "d5b2e7fa-a2cc-42c9-89da-8f8850e748be" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:02:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "d5b2e7fa-a2cc-42c9-89da-8f8850e748be" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:02:48 user nova-compute[72444]: INFO nova.compute.manager [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Attaching volume 6c67c8cb-8968-4c9e-8e89-3c2dea4d805a to /dev/vdb
Aug 03 05:02:48 user nova-compute[72444]: DEBUG os_brick.utils [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:02:48 user nova-compute[72444]: DEBUG nova.network.neutron [req-142dfe21-3991-4c7c-aad7-4640b7f6d449 req-e65609af-0ec2-4f67-84b5-9982ad6db43b service nova] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Updated VIF entry in instance network info cache for port 3409d644-fe83-4cee-aa78-9b0f8e360f50. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:02:48 user nova-compute[72444]: DEBUG nova.network.neutron [req-142dfe21-3991-4c7c-aad7-4640b7f6d449 req-e65609af-0ec2-4f67-84b5-9982ad6db43b service nova] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Updating instance_info_cache with network_info: [{"id": "3409d644-fe83-4cee-aa78-9b0f8e360f50", "address": "fa:16:3e:35:3c:5f", "network": {"id": "81d682a4-018d-4927-866c-2b16d48f16e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-921368252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff54227e82764df6abd50b83068c64de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3409d644-fe", "ovs_interfaceid": "3409d644-fe83-4cee-aa78-9b0f8e360f50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:02:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-142dfe21-3991-4c7c-aad7-4640b7f6d449 req-e65609af-0ec2-4f67-84b5-9982ad6db43b service nova] Releasing lock "refresh_cache-d5b2e7fa-a2cc-42c9-89da-8f8850e748be" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:02:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:48 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea56cda-e637-4a00-ade3-7e7349d15dfb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:48 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[81327927-2ea6-4874-bc3e-649b8a14291f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:48 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2b78f1-72e6-4f53-b7d3-6b389a5ee021]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:48 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1014f0f6-a5d3-43f0-8dea-625c2ec565f0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:02:48 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 05:02:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:48 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:02:48 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 05:02:48 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fe7dc7-76c1-4f24-aa2d-c197e781ae71]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:48 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 05:02:48 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 05:02:48 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 05:02:48 user nova-compute[72444]: DEBUG os_brick.utils [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:02:48 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Updating existing volume attachment record: f96a8995-fed7-4ec2-bce7-747477417df2 {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 05:02:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:49 user nova-compute[72444]: DEBUG nova.compute.manager [req-775c5e82-e59d-4152-b310-ebc76e9627b9 req-43323f68-a64f-4f06-bb8b-0d164f2aba54 service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Received event network-vif-plugged-775b17bb-97a7-4a00-9368-198abafa4f8b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:02:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-775c5e82-e59d-4152-b310-ebc76e9627b9 req-43323f68-a64f-4f06-bb8b-0d164f2aba54 service nova] Acquiring lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:02:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-775c5e82-e59d-4152-b310-ebc76e9627b9 req-43323f68-a64f-4f06-bb8b-0d164f2aba54 service nova] Lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:02:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-775c5e82-e59d-4152-b310-ebc76e9627b9 req-43323f68-a64f-4f06-bb8b-0d164f2aba54 service nova] Lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:02:49 user nova-compute[72444]: DEBUG nova.compute.manager [req-775c5e82-e59d-4152-b310-ebc76e9627b9 req-43323f68-a64f-4f06-bb8b-0d164f2aba54 service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] No waiting events found dispatching network-vif-plugged-775b17bb-97a7-4a00-9368-198abafa4f8b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:02:49 user nova-compute[72444]: WARNING nova.compute.manager [req-775c5e82-e59d-4152-b310-ebc76e9627b9 req-43323f68-a64f-4f06-bb8b-0d164f2aba54 service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Received unexpected event network-vif-plugged-775b17bb-97a7-4a00-9368-198abafa4f8b for instance with vm_state active and task_state resize_finish.
Aug 03 05:02:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:50 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691038955.8745222, 4f225dc2-3011-4c15-bb8e-1ebb079a3b50 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:02:50 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] VM Stopped (Lifecycle Event)
Aug 03 05:02:50 user nova-compute[72444]: DEBUG nova.compute.manager [None req-c0c446e2-8943-448d-93a2-884326745d88 None None] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:02:51 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038971.2717524, 4f225dc2-3011-4c15-bb8e-1ebb079a3b50 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:02:51 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] VM Resumed (Lifecycle Event)
Aug 03 05:02:51 user nova-compute[72444]: DEBUG nova.compute.manager [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 05:02:51 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Instance running successfully.
Aug 03 05:02:51 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Failed to set time: agent not configured {{(pid=72444) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 03 05:02:51 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-4367b6a4-8460-49bf-99b6-7b38f9962f8c tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] finish_migration finished successfully. {{(pid=72444) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 03 05:02:51 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:02:51 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:02:51 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 03 05:02:51 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038971.2762442, 4f225dc2-3011-4c15-bb8e-1ebb079a3b50 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:02:51 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] VM Started (Lifecycle Event)
Aug 03 05:02:51 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:02:51 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:02:51 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 03 05:02:51 user nova-compute[72444]: DEBUG nova.compute.manager [req-be1ec170-b72a-431b-bce9-a71a80e7055c req-679e5a20-5d45-4b50-9e6a-946bf3198191 service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Received event network-vif-plugged-775b17bb-97a7-4a00-9368-198abafa4f8b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:02:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-be1ec170-b72a-431b-bce9-a71a80e7055c req-679e5a20-5d45-4b50-9e6a-946bf3198191 service nova] Acquiring lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:02:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-be1ec170-b72a-431b-bce9-a71a80e7055c req-679e5a20-5d45-4b50-9e6a-946bf3198191 service nova] Lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:02:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-be1ec170-b72a-431b-bce9-a71a80e7055c req-679e5a20-5d45-4b50-9e6a-946bf3198191 service nova] Lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:02:51 user nova-compute[72444]: DEBUG nova.compute.manager [req-be1ec170-b72a-431b-bce9-a71a80e7055c req-679e5a20-5d45-4b50-9e6a-946bf3198191 service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] No waiting events found dispatching network-vif-plugged-775b17bb-97a7-4a00-9368-198abafa4f8b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:02:51 user nova-compute[72444]: WARNING nova.compute.manager [req-be1ec170-b72a-431b-bce9-a71a80e7055c req-679e5a20-5d45-4b50-9e6a-946bf3198191 service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Received unexpected event network-vif-plugged-775b17bb-97a7-4a00-9368-198abafa4f8b for instance with vm_state active and task_state resize_finish.
Aug 03 05:02:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:54 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:02:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HJZODefq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:02:56 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:02:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:02:56 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:02:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:02:56 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 05:02:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27715bc-c6d1-43b3-8724-d07cb9ad423e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 05:02:56 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[21463ec6-3457-459c-85ea-7a74d4ba06a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a] added
Aug 03 05:02:56 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29b1754-b892-4848-bf81-52b6bb073312]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebf0950-96aa-4699-b6b0-bc011bce3552]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HJZODefq {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HJZODefq" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3663ef-2045-42dd-95ff-9bebdab7648f]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HJZODefq'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbe7670-5fd4-4b85-aecc-e4256257365a]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f00bf9-5dec-44d8-89e6-005f447425a6]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)
Aug 03 05:02:56 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)
Aug 03 05:02:56 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd832f0-cc65-454a-ae6f-e632c3a229d9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a, portal: 172.16.0.220,3260]
Aug 03 05:02:56 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a, portal: 172.16.0.220,3260] successful.
Aug 03 05:02:56 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2831fc52-9698-47aa-8bf8-6d4e40ef20d6]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9bb91f-774a-4611-b794-207b76304fb1]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)
Aug 03 05:02:56 user nova-compute[72444]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a (non-flash)
Aug 03 05:02:56 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)
Aug 03 05:02:56 user nova-compute[72444]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a (non-flash)
Aug 03 05:02:56 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ea41f2-9030-4fa6-87f1-522c8066b106]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HJZODefq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 05:02:56 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:02:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquiring lock "53f34c9b-a064-4de8-b278-4455be0b513a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:02:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "53f34c9b-a064-4de8-b278-4455be0b513a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:02:57 user nova-compute[72444]: DEBUG nova.compute.manager [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 05:02:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:02:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:02:57 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 05:02:57 user nova-compute[72444]: INFO nova.compute.claims [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Claim successful on node user
Aug 03 05:02:57 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:02:57 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:02:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.347s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:02:57 user nova-compute[72444]: DEBUG nova.compute.manager [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 05:02:57 user nova-compute[72444]: DEBUG nova.compute.manager [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 05:02:57 user nova-compute[72444]: DEBUG nova.network.neutron [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 05:02:57 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 05:02:57 user nova-compute[72444]: DEBUG nova.compute.manager [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 05:02:57 user nova-compute[72444]: DEBUG nova.policy [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9458c7bd532e4451904ca404bf35427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd787b7db6a684a008a03c55e292b0d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 05:02:57 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:02:57 user nova-compute[72444]: DEBUG nova.compute.manager [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 05:02:57 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 05:02:57 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Creating image(s)
Aug 03 05:02:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquiring lock "/opt/stack/data/nova/instances/53f34c9b-a064-4de8-b278-4455be0b513a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:02:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "/opt/stack/data/nova/instances/53f34c9b-a064-4de8-b278-4455be0b513a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:02:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "/opt/stack/data/nova/instances/53f34c9b-a064-4de8-b278-4455be0b513a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:02:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquiring lock "3655f7fe9631b1da9a81c3a279bedb099ef0165c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:02:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "3655f7fe9631b1da9a81c3a279bedb099ef0165c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:02:57 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:02:57 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23661316634613064', 'path': '/dev/sdc'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:02:57 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661316634613064', 'path': '/dev/sdc'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 05:02:57 user nova-compute[72444]: DEBUG nova.objects.instance [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lazy-loading 'flavor' on Instance uuid d5b2e7fa-a2cc-42c9-89da-8f8850e748be {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:02:57 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 05:02:57 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:02:57 user nova-compute[72444]:   <source dev="/dev/sdc"/>
Aug 03 05:02:57 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 05:02:57 user nova-compute[72444]:   <serial>6c67c8cb-8968-4c9e-8e89-3c2dea4d805a</serial>
Aug 03 05:02:57 user nova-compute[72444]: </disk>
Aug 03 05:02:57 user nova-compute[72444]:  {{(pid=72444) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 05:02:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3655f7fe9631b1da9a81c3a279bedb099ef0165c.part --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:02:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:02:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] No VIF found with MAC fa:16:3e:35:3c:5f, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 05:02:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3655f7fe9631b1da9a81c3a279bedb099ef0165c.part --force-share --output=json" returned: 0 in 0.174s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:58 user nova-compute[72444]: DEBUG nova.virt.images [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] 739b74ca-ca60-4e72-8ac5-51ce4b3d8b9e was qcow2, converting to raw {{(pid=72444) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 03 05:02:58 user nova-compute[72444]: DEBUG nova.privsep.utils [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72444) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 03 05:02:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3655f7fe9631b1da9a81c3a279bedb099ef0165c.part /opt/stack/data/nova/instances/_base/3655f7fe9631b1da9a81c3a279bedb099ef0165c.converted {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:58 user nova-compute[72444]: DEBUG nova.network.neutron [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Successfully created port: 70d97df3-9ab0-4619-83ed-bef86a0bfc6b {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 05:02:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0dc8bbf6-5e8b-417a-97de-77309db3e782 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "d5b2e7fa-a2cc-42c9-89da-8f8850e748be" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.764s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:02:58 user nova-compute[72444]: DEBUG nova.compute.manager [req-81b8e118-f0f6-41e9-b1d1-f652dca48d8c req-b1ad7631-b18b-4932-920c-975309823393 service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Received event network-changed-06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:02:58 user nova-compute[72444]: DEBUG nova.compute.manager [req-81b8e118-f0f6-41e9-b1d1-f652dca48d8c req-b1ad7631-b18b-4932-920c-975309823393 service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Refreshing instance network info cache due to event network-changed-06e85273-4218-48ad-b2d8-fa4a3875a57c. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:02:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-81b8e118-f0f6-41e9-b1d1-f652dca48d8c req-b1ad7631-b18b-4932-920c-975309823393 service nova] Acquiring lock "refresh_cache-dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:02:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-81b8e118-f0f6-41e9-b1d1-f652dca48d8c req-b1ad7631-b18b-4932-920c-975309823393 service nova] Acquired lock "refresh_cache-dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:02:58 user nova-compute[72444]: DEBUG nova.network.neutron [req-81b8e118-f0f6-41e9-b1d1-f652dca48d8c req-b1ad7631-b18b-4932-920c-975309823393 service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Refreshing network info cache for port 06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:02:58 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:02:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 05:02:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3655f7fe9631b1da9a81c3a279bedb099ef0165c.part /opt/stack/data/nova/instances/_base/3655f7fe9631b1da9a81c3a279bedb099ef0165c.converted" returned: 0 in 0.623s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3655f7fe9631b1da9a81c3a279bedb099ef0165c.converted --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3655f7fe9631b1da9a81c3a279bedb099ef0165c.converted --force-share --output=json" returned: 0 in 0.151s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "3655f7fe9631b1da9a81c3a279bedb099ef0165c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.391s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:02:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3655f7fe9631b1da9a81c3a279bedb099ef0165c --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:59 user nova-compute[72444]: DEBUG nova.network.neutron [req-81b8e118-f0f6-41e9-b1d1-f652dca48d8c req-b1ad7631-b18b-4932-920c-975309823393 service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Updated VIF entry in instance network info cache for port 06e85273-4218-48ad-b2d8-fa4a3875a57c. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:02:59 user nova-compute[72444]: DEBUG nova.network.neutron [req-81b8e118-f0f6-41e9-b1d1-f652dca48d8c req-b1ad7631-b18b-4932-920c-975309823393 service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Updating instance_info_cache with network_info: [{"id": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "address": "fa:16:3e:a4:56:cc", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e85273-42", "ovs_interfaceid": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:02:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3655f7fe9631b1da9a81c3a279bedb099ef0165c --force-share --output=json" returned: 0 in 0.165s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquiring lock "3655f7fe9631b1da9a81c3a279bedb099ef0165c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:02:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "3655f7fe9631b1da9a81c3a279bedb099ef0165c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:02:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3655f7fe9631b1da9a81c3a279bedb099ef0165c --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-81b8e118-f0f6-41e9-b1d1-f652dca48d8c req-b1ad7631-b18b-4932-920c-975309823393 service nova] Releasing lock "refresh_cache-dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:02:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3655f7fe9631b1da9a81c3a279bedb099ef0165c --force-share --output=json" returned: 0 in 0.148s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3655f7fe9631b1da9a81c3a279bedb099ef0165c,backing_fmt=raw /opt/stack/data/nova/instances/53f34c9b-a064-4de8-b278-4455be0b513a/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3655f7fe9631b1da9a81c3a279bedb099ef0165c,backing_fmt=raw /opt/stack/data/nova/instances/53f34c9b-a064-4de8-b278-4455be0b513a/disk 1073741824" returned: 0 in 0.057s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "3655f7fe9631b1da9a81c3a279bedb099ef0165c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:02:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3655f7fe9631b1da9a81c3a279bedb099ef0165c --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:59 user nova-compute[72444]: DEBUG nova.network.neutron [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Successfully updated port: 70d97df3-9ab0-4619-83ed-bef86a0bfc6b {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 05:02:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquiring lock "refresh_cache-53f34c9b-a064-4de8-b278-4455be0b513a" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:02:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquired lock "refresh_cache-53f34c9b-a064-4de8-b278-4455be0b513a" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:02:59 user nova-compute[72444]: DEBUG nova.network.neutron [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 05:02:59 user nova-compute[72444]: DEBUG nova.compute.manager [req-7c26c4af-a8bc-4e65-865d-50b7f4768121 req-3e1eb5b0-1be8-4206-a3e6-96535c27dc33 service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Received event network-changed-70d97df3-9ab0-4619-83ed-bef86a0bfc6b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:02:59 user nova-compute[72444]: DEBUG nova.compute.manager [req-7c26c4af-a8bc-4e65-865d-50b7f4768121 req-3e1eb5b0-1be8-4206-a3e6-96535c27dc33 service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Refreshing instance network info cache due to event network-changed-70d97df3-9ab0-4619-83ed-bef86a0bfc6b. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:02:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7c26c4af-a8bc-4e65-865d-50b7f4768121 req-3e1eb5b0-1be8-4206-a3e6-96535c27dc33 service nova] Acquiring lock "refresh_cache-53f34c9b-a064-4de8-b278-4455be0b513a" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:02:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3655f7fe9631b1da9a81c3a279bedb099ef0165c --force-share --output=json" returned: 0 in 0.153s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:59 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Checking if we can resize image /opt/stack/data/nova/instances/53f34c9b-a064-4de8-b278-4455be0b513a/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 05:02:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f34c9b-a064-4de8-b278-4455be0b513a/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:02:59 user nova-compute[72444]: DEBUG nova.network.neutron [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 05:02:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f34c9b-a064-4de8-b278-4455be0b513a/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:02:59 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Cannot resize image /opt/stack/data/nova/instances/53f34c9b-a064-4de8-b278-4455be0b513a/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 05:02:59 user nova-compute[72444]: DEBUG nova.objects.instance [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lazy-loading 'migration_context' on Instance uuid 53f34c9b-a064-4de8-b278-4455be0b513a {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:02:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 05:02:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Ensure instance console log exists: /opt/stack/data/nova/instances/53f34c9b-a064-4de8-b278-4455be0b513a/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 05:02:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:02:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:02:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG nova.network.neutron [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Updating instance_info_cache with network_info: [{"id": "70d97df3-9ab0-4619-83ed-bef86a0bfc6b", "address": "fa:16:3e:49:df:1f", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d97df3-9a", "ovs_interfaceid": "70d97df3-9ab0-4619-83ed-bef86a0bfc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Releasing lock "refresh_cache-53f34c9b-a064-4de8-b278-4455be0b513a" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG nova.compute.manager [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Instance network_info: |[{"id": "70d97df3-9ab0-4619-83ed-bef86a0bfc6b", "address": "fa:16:3e:49:df:1f", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d97df3-9a", "ovs_interfaceid": "70d97df3-9ab0-4619-83ed-bef86a0bfc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7c26c4af-a8bc-4e65-865d-50b7f4768121 req-3e1eb5b0-1be8-4206-a3e6-96535c27dc33 service nova] Acquired lock "refresh_cache-53f34c9b-a064-4de8-b278-4455be0b513a" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG nova.network.neutron [req-7c26c4af-a8bc-4e65-865d-50b7f4768121 req-3e1eb5b0-1be8-4206-a3e6-96535c27dc33 service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Refreshing network info cache for port 70d97df3-9ab0-4619-83ed-bef86a0bfc6b {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Start _get_guest_xml network_info=[{"id": "70d97df3-9ab0-4619-83ed-bef86a0bfc6b", "address": "fa:16:3e:49:df:1f", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d97df3-9a", "ovs_interfaceid": "70d97df3-9ab0-4619-83ed-bef86a0bfc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T05:02:54Z,direct_url=<?>,disk_format='qcow2',id=739b74ca-ca60-4e72-8ac5-51ce4b3d8b9e,min_disk=0,min_ram=0,name='tempest-scenario-img--1365350522',owner='d787b7db6a684a008a03c55e292b0d5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T05:02:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '739b74ca-ca60-4e72-8ac5-51ce4b3d8b9e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 05:03:00 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:03:00 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:03:00 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T05:02:54Z,direct_url=<?>,disk_format='qcow2',id=739b74ca-ca60-4e72-8ac5-51ce4b3d8b9e,min_disk=0,min_ram=0,name='tempest-scenario-img--1365350522',owner='d787b7db6a684a008a03c55e292b0d5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T05:02:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:02:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-907495048',display_name='tempest-TestMinimumBasicScenario-server-907495048',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-907495048',id=39,image_ref='739b74ca-ca60-4e72-8ac5-51ce4b3d8b9e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7eGkcx7Tl4DNy3XzBpxm0grWydaYgJZM6hsL9CIXMxsSAH0x2E/xx/wxGBkTlBSzVpnmTQ5QCLwYeJxGO7nVisdXF/SyHOSNF21rajQ8oh13kCyZIgGQbUqotqomtR9g==',key_name='tempest-TestMinimumBasicScenario-837536290',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d787b7db6a684a008a03c55e292b0d5c',ramdisk_id='',reservation_id='r-8dy5rlxh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='739b74ca-ca60-4e72-8ac5-51ce4b3d8b9e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1132477023',owner_user_name='tempest-TestMinimumBasicScenario-1132477023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:02:58Z,user_data=None,user_id='9458c7bd532e4451904ca404bf35427b',uuid=53f34c9b-a064-4de8-b278-4455be0b513a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70d97df3-9ab0-4619-83ed-bef86a0bfc6b", "address": "fa:16:3e:49:df:1f", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d97df3-9a", "ovs_interfaceid": "70d97df3-9ab0-4619-83ed-bef86a0bfc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Converting VIF {"id": "70d97df3-9ab0-4619-83ed-bef86a0bfc6b", "address": "fa:16:3e:49:df:1f", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d97df3-9a", "ovs_interfaceid": "70d97df3-9ab0-4619-83ed-bef86a0bfc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:df:1f,bridge_name='br-int',has_traffic_filtering=True,id=70d97df3-9ab0-4619-83ed-bef86a0bfc6b,network=Network(87c23a2e-233d-487e-9789-d4eb24a63856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d97df3-9a') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG nova.objects.instance [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lazy-loading 'pci_devices' on Instance uuid 53f34c9b-a064-4de8-b278-4455be0b513a {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] End _get_guest_xml xml=<domain type="kvm">
Aug 03 05:03:00 user nova-compute[72444]:   <uuid>53f34c9b-a064-4de8-b278-4455be0b513a</uuid>
Aug 03 05:03:00 user nova-compute[72444]:   <name>instance-00000027</name>
Aug 03 05:03:00 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 05:03:00 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 05:03:00 user nova-compute[72444]:   <metadata>
Aug 03 05:03:00 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 05:03:00 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 05:03:00 user nova-compute[72444]:       <nova:name>tempest-TestMinimumBasicScenario-server-907495048</nova:name>
Aug 03 05:03:00 user nova-compute[72444]:       <nova:creationTime>2023-08-03 05:03:00</nova:creationTime>
Aug 03 05:03:00 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 05:03:00 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 05:03:00 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 05:03:00 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 05:03:00 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 05:03:00 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 05:03:00 user nova-compute[72444]:       </nova:flavor>
Aug 03 05:03:00 user nova-compute[72444]:       <nova:owner>
Aug 03 05:03:00 user nova-compute[72444]:         <nova:user uuid="9458c7bd532e4451904ca404bf35427b">tempest-TestMinimumBasicScenario-1132477023-project-member</nova:user>
Aug 03 05:03:00 user nova-compute[72444]:         <nova:project uuid="d787b7db6a684a008a03c55e292b0d5c">tempest-TestMinimumBasicScenario-1132477023</nova:project>
Aug 03 05:03:00 user nova-compute[72444]:       </nova:owner>
Aug 03 05:03:00 user nova-compute[72444]:       <nova:root type="image" uuid="739b74ca-ca60-4e72-8ac5-51ce4b3d8b9e"/>
Aug 03 05:03:00 user nova-compute[72444]:       <nova:ports>
Aug 03 05:03:00 user nova-compute[72444]:         <nova:port uuid="70d97df3-9ab0-4619-83ed-bef86a0bfc6b">
Aug 03 05:03:00 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 03 05:03:00 user nova-compute[72444]:         </nova:port>
Aug 03 05:03:00 user nova-compute[72444]:       </nova:ports>
Aug 03 05:03:00 user nova-compute[72444]:     </nova:instance>
Aug 03 05:03:00 user nova-compute[72444]:   </metadata>
Aug 03 05:03:00 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 05:03:00 user nova-compute[72444]:     <system>
Aug 03 05:03:00 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 05:03:00 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 05:03:00 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 05:03:00 user nova-compute[72444]:       <entry name="serial">53f34c9b-a064-4de8-b278-4455be0b513a</entry>
Aug 03 05:03:00 user nova-compute[72444]:       <entry name="uuid">53f34c9b-a064-4de8-b278-4455be0b513a</entry>
Aug 03 05:03:00 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 05:03:00 user nova-compute[72444]:     </system>
Aug 03 05:03:00 user nova-compute[72444]:   </sysinfo>
Aug 03 05:03:00 user nova-compute[72444]:   <os>
Aug 03 05:03:00 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 05:03:00 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 05:03:00 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 05:03:00 user nova-compute[72444]:   </os>
Aug 03 05:03:00 user nova-compute[72444]:   <features>
Aug 03 05:03:00 user nova-compute[72444]:     <acpi/>
Aug 03 05:03:00 user nova-compute[72444]:     <apic/>
Aug 03 05:03:00 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 05:03:00 user nova-compute[72444]:   </features>
Aug 03 05:03:00 user nova-compute[72444]:   <clock offset="utc">
Aug 03 05:03:00 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 05:03:00 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 05:03:00 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 05:03:00 user nova-compute[72444]:   </clock>
Aug 03 05:03:00 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 05:03:00 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 05:03:00 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 05:03:00 user nova-compute[72444]:   </cpu>
Aug 03 05:03:00 user nova-compute[72444]:   <devices>
Aug 03 05:03:00 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 05:03:00 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 05:03:00 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/53f34c9b-a064-4de8-b278-4455be0b513a/disk"/>
Aug 03 05:03:00 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 05:03:00 user nova-compute[72444]:     </disk>
Aug 03 05:03:00 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 05:03:00 user nova-compute[72444]:       <mac address="fa:16:3e:49:df:1f"/>
Aug 03 05:03:00 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:03:00 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 05:03:00 user nova-compute[72444]:       <target dev="tap70d97df3-9a"/>
Aug 03 05:03:00 user nova-compute[72444]:     </interface>
Aug 03 05:03:00 user nova-compute[72444]:     <serial type="pty">
Aug 03 05:03:00 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/53f34c9b-a064-4de8-b278-4455be0b513a/console.log" append="off"/>
Aug 03 05:03:00 user nova-compute[72444]:     </serial>
Aug 03 05:03:00 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 05:03:00 user nova-compute[72444]:     <video>
Aug 03 05:03:00 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:03:00 user nova-compute[72444]:     </video>
Aug 03 05:03:00 user nova-compute[72444]:     <rng model="virtio">
Aug 03 05:03:00 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 05:03:00 user nova-compute[72444]:     </rng>
Aug 03 05:03:00 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 05:03:00 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 05:03:00 user nova-compute[72444]:       <stats period="10"/>
Aug 03 05:03:00 user nova-compute[72444]:     </memballoon>
Aug 03 05:03:00 user nova-compute[72444]:   </devices>
Aug 03 05:03:00 user nova-compute[72444]: </domain>
Aug 03 05:03:00 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:02:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-907495048',display_name='tempest-TestMinimumBasicScenario-server-907495048',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-907495048',id=39,image_ref='739b74ca-ca60-4e72-8ac5-51ce4b3d8b9e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7eGkcx7Tl4DNy3XzBpxm0grWydaYgJZM6hsL9CIXMxsSAH0x2E/xx/wxGBkTlBSzVpnmTQ5QCLwYeJxGO7nVisdXF/SyHOSNF21rajQ8oh13kCyZIgGQbUqotqomtR9g==',key_name='tempest-TestMinimumBasicScenario-837536290',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d787b7db6a684a008a03c55e292b0d5c',ramdisk_id='',reservation_id='r-8dy5rlxh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='739b74ca-ca60-4e72-8ac5-51ce4b3d8b9e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1132477023',owner_user_name='tempest-TestMinimumBasicScenario-1132477023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:02:58Z,user_data=None,user_id='9458c7bd532e4451904ca404bf35427b',uuid=53f34c9b-a064-4de8-b278-4455be0b513a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70d97df3-9ab0-4619-83ed-bef86a0bfc6b", "address": "fa:16:3e:49:df:1f", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d97df3-9a", "ovs_interfaceid": "70d97df3-9ab0-4619-83ed-bef86a0bfc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Converting VIF {"id": "70d97df3-9ab0-4619-83ed-bef86a0bfc6b", "address": "fa:16:3e:49:df:1f", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d97df3-9a", "ovs_interfaceid": "70d97df3-9ab0-4619-83ed-bef86a0bfc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:df:1f,bridge_name='br-int',has_traffic_filtering=True,id=70d97df3-9ab0-4619-83ed-bef86a0bfc6b,network=Network(87c23a2e-233d-487e-9789-d4eb24a63856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d97df3-9a') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG os_vif [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:df:1f,bridge_name='br-int',has_traffic_filtering=True,id=70d97df3-9ab0-4619-83ed-bef86a0bfc6b,network=Network(87c23a2e-233d-487e-9789-d4eb24a63856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d97df3-9a') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70d97df3-9a, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap70d97df3-9a, col_values=(('external_ids', {'iface-id': '70d97df3-9ab0-4619-83ed-bef86a0bfc6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:df:1f', 'vm-uuid': '53f34c9b-a064-4de8-b278-4455be0b513a'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:00 user nova-compute[72444]: INFO os_vif [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:df:1f,bridge_name='br-int',has_traffic_filtering=True,id=70d97df3-9ab0-4619-83ed-bef86a0bfc6b,network=Network(87c23a2e-233d-487e-9789-d4eb24a63856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d97df3-9a')
Aug 03 05:03:00 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] No VIF found with MAC fa:16:3e:49:df:1f, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG nova.network.neutron [req-7c26c4af-a8bc-4e65-865d-50b7f4768121 req-3e1eb5b0-1be8-4206-a3e6-96535c27dc33 service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Updated VIF entry in instance network info cache for port 70d97df3-9ab0-4619-83ed-bef86a0bfc6b. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG nova.network.neutron [req-7c26c4af-a8bc-4e65-865d-50b7f4768121 req-3e1eb5b0-1be8-4206-a3e6-96535c27dc33 service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Updating instance_info_cache with network_info: [{"id": "70d97df3-9ab0-4619-83ed-bef86a0bfc6b", "address": "fa:16:3e:49:df:1f", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d97df3-9a", "ovs_interfaceid": "70d97df3-9ab0-4619-83ed-bef86a0bfc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7c26c4af-a8bc-4e65-865d-50b7f4768121 req-3e1eb5b0-1be8-4206-a3e6-96535c27dc33 service nova] Releasing lock "refresh_cache-53f34c9b-a064-4de8-b278-4455be0b513a" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-4f225dc2-3011-4c15-bb8e-1ebb079a3b50" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-4f225dc2-3011-4c15-bb8e-1ebb079a3b50" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:03:00 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 05:03:01 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Updating instance_info_cache with network_info: [{"id": "775b17bb-97a7-4a00-9368-198abafa4f8b", "address": "fa:16:3e:65:c2:ad", "network": {"id": "dd246ddd-6ffb-4516-b262-ef339c3f195c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2067592626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac3f775464f48d88f05efdf3aeb4fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b17bb-97", "ovs_interfaceid": "775b17bb-97a7-4a00-9368-198abafa4f8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:03:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-4f225dc2-3011-4c15-bb8e-1ebb079a3b50" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:03:01 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 05:03:01 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:03:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:02 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:02 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:02 user nova-compute[72444]: DEBUG nova.compute.manager [req-50263117-d82d-4ce5-ab60-eba21a3d88e5 req-01079d71-3e3e-41e9-9f02-f3e3c0461be4 service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Received event network-vif-plugged-70d97df3-9ab0-4619-83ed-bef86a0bfc6b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:03:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-50263117-d82d-4ce5-ab60-eba21a3d88e5 req-01079d71-3e3e-41e9-9f02-f3e3c0461be4 service nova] Acquiring lock "53f34c9b-a064-4de8-b278-4455be0b513a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:03:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-50263117-d82d-4ce5-ab60-eba21a3d88e5 req-01079d71-3e3e-41e9-9f02-f3e3c0461be4 service nova] Lock "53f34c9b-a064-4de8-b278-4455be0b513a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:03:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-50263117-d82d-4ce5-ab60-eba21a3d88e5 req-01079d71-3e3e-41e9-9f02-f3e3c0461be4 service nova] Lock "53f34c9b-a064-4de8-b278-4455be0b513a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:03:02 user nova-compute[72444]: DEBUG nova.compute.manager [req-50263117-d82d-4ce5-ab60-eba21a3d88e5 req-01079d71-3e3e-41e9-9f02-f3e3c0461be4 service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] No waiting events found dispatching network-vif-plugged-70d97df3-9ab0-4619-83ed-bef86a0bfc6b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:03:02 user nova-compute[72444]: WARNING nova.compute.manager [req-50263117-d82d-4ce5-ab60-eba21a3d88e5 req-01079d71-3e3e-41e9-9f02-f3e3c0461be4 service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Received unexpected event network-vif-plugged-70d97df3-9ab0-4619-83ed-bef86a0bfc6b for instance with vm_state building and task_state spawning.
Aug 03 05:03:02 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:02 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:02 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:03:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c7e4c566-f057-43c7-8e82-d9f909dc58a2 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:03:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c7e4c566-f057-43c7-8e82-d9f909dc58a2 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:03:03 user nova-compute[72444]: INFO nova.compute.manager [None req-c7e4c566-f057-43c7-8e82-d9f909dc58a2 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Shelving
Aug 03 05:03:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:03 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038983.8398883, 53f34c9b-a064-4de8-b278-4455be0b513a => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:03:03 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] VM Resumed (Lifecycle Event)
Aug 03 05:03:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 05:03:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 05:03:03 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Instance spawned successfully.
Aug 03 05:03:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 05:03:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:03:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:03:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:03:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:03:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:03:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:03:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:03:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:03:03 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:03:03 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 05:03:03 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691038983.840241, 53f34c9b-a064-4de8-b278-4455be0b513a => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:03:03 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] VM Started (Lifecycle Event)
Aug 03 05:03:03 user nova-compute[72444]: DEBUG nova.compute.manager [req-9181d507-f6a8-452f-aad8-1656f2512445 req-77b88106-bae1-4b67-9e6c-bf6ccdcd83ef service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Received event network-vif-unplugged-06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:03:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9181d507-f6a8-452f-aad8-1656f2512445 req-77b88106-bae1-4b67-9e6c-bf6ccdcd83ef service nova] Acquiring lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:03:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9181d507-f6a8-452f-aad8-1656f2512445 req-77b88106-bae1-4b67-9e6c-bf6ccdcd83ef service nova] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:03:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9181d507-f6a8-452f-aad8-1656f2512445 req-77b88106-bae1-4b67-9e6c-bf6ccdcd83ef service nova] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:03:03 user nova-compute[72444]: DEBUG nova.compute.manager [req-9181d507-f6a8-452f-aad8-1656f2512445 req-77b88106-bae1-4b67-9e6c-bf6ccdcd83ef service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] No waiting events found dispatching network-vif-unplugged-06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:03:03 user nova-compute[72444]: WARNING nova.compute.manager [req-9181d507-f6a8-452f-aad8-1656f2512445 req-77b88106-bae1-4b67-9e6c-bf6ccdcd83ef service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Received unexpected event network-vif-unplugged-06e85273-4218-48ad-b2d8-fa4a3875a57c for instance with vm_state active and task_state shelving.
Aug 03 05:03:04 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:03:04 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:03:04 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 05:03:04 user nova-compute[72444]: INFO nova.compute.manager [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Took 6.43 seconds to spawn the instance on the hypervisor.
Aug 03 05:03:04 user nova-compute[72444]: DEBUG nova.compute.manager [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:03:04 user nova-compute[72444]: INFO nova.compute.manager [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Took 7.18 seconds to build instance.
Aug 03 05:03:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-bfd3f3e5-fcf8-4368-895f-e6de723c37dd tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "53f34c9b-a064-4de8-b278-4455be0b513a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.285s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:03:04 user nova-compute[72444]: DEBUG nova.compute.manager [req-aa8c56d8-7de3-4c26-9c35-d360a2471ef3 req-dc7cb59a-a9d7-400f-a0d0-28c82518a4b9 service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Received event network-vif-plugged-70d97df3-9ab0-4619-83ed-bef86a0bfc6b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:03:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-aa8c56d8-7de3-4c26-9c35-d360a2471ef3 req-dc7cb59a-a9d7-400f-a0d0-28c82518a4b9 service nova] Acquiring lock "53f34c9b-a064-4de8-b278-4455be0b513a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:03:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-aa8c56d8-7de3-4c26-9c35-d360a2471ef3 req-dc7cb59a-a9d7-400f-a0d0-28c82518a4b9 service nova] Lock "53f34c9b-a064-4de8-b278-4455be0b513a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:03:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-aa8c56d8-7de3-4c26-9c35-d360a2471ef3 req-dc7cb59a-a9d7-400f-a0d0-28c82518a4b9 service nova] Lock "53f34c9b-a064-4de8-b278-4455be0b513a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:03:04 user nova-compute[72444]: DEBUG nova.compute.manager [req-aa8c56d8-7de3-4c26-9c35-d360a2471ef3 req-dc7cb59a-a9d7-400f-a0d0-28c82518a4b9 service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] No waiting events found dispatching network-vif-plugged-70d97df3-9ab0-4619-83ed-bef86a0bfc6b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:03:04 user nova-compute[72444]: WARNING nova.compute.manager [req-aa8c56d8-7de3-4c26-9c35-d360a2471ef3 req-dc7cb59a-a9d7-400f-a0d0-28c82518a4b9 service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Received unexpected event network-vif-plugged-70d97df3-9ab0-4619-83ed-bef86a0bfc6b for instance with vm_state active and task_state None.
Aug 03 05:03:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:04 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Instance destroyed successfully.
Aug 03 05:03:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:04 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-c7e4c566-f057-43c7-8e82-d9f909dc58a2 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Beginning cold snapshot process
Aug 03 05:03:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:04 user nova-compute[72444]: DEBUG nova.privsep.utils [None req-c7e4c566-f057-43c7-8e82-d9f909dc58a2 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72444) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 03 05:03:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-c7e4c566-f057-43c7-8e82-d9f909dc58a2 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/disk /opt/stack/data/nova/instances/snapshots/tmp7_s_rf72/920a26df509d47e58f94eae61a82d7af {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:03:04 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:03:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:03:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:03:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:03:04 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:03:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b2e7fa-a2cc-42c9-89da-8f8850e748be/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:03:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:03:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b2e7fa-a2cc-42c9-89da-8f8850e748be/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:03:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b2e7fa-a2cc-42c9-89da-8f8850e748be/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:03:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-c7e4c566-f057-43c7-8e82-d9f909dc58a2 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/disk /opt/stack/data/nova/instances/snapshots/tmp7_s_rf72/920a26df509d47e58f94eae61a82d7af" returned: 0 in 0.675s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:03:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:05 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-c7e4c566-f057-43c7-8e82-d9f909dc58a2 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Snapshot extracted, beginning image upload
Aug 03 05:03:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b2e7fa-a2cc-42c9-89da-8f8850e748be/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:03:05 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 05:03:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:03:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:03:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:03:05 user nova-compute[72444]: DEBUG nova.compute.manager [req-b3b18a3a-b97d-448c-a594-d32ebe2b8884 req-479e7c00-6036-40c0-8e82-065ae6f9cbaf service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Received event network-vif-plugged-06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:03:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b3b18a3a-b97d-448c-a594-d32ebe2b8884 req-479e7c00-6036-40c0-8e82-065ae6f9cbaf service nova] Acquiring lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:03:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b3b18a3a-b97d-448c-a594-d32ebe2b8884 req-479e7c00-6036-40c0-8e82-065ae6f9cbaf service nova] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:03:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b3b18a3a-b97d-448c-a594-d32ebe2b8884 req-479e7c00-6036-40c0-8e82-065ae6f9cbaf service nova] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:03:05 user nova-compute[72444]: DEBUG nova.compute.manager [req-b3b18a3a-b97d-448c-a594-d32ebe2b8884 req-479e7c00-6036-40c0-8e82-065ae6f9cbaf service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] No waiting events found dispatching network-vif-plugged-06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:03:05 user nova-compute[72444]: WARNING nova.compute.manager [req-b3b18a3a-b97d-448c-a594-d32ebe2b8884 req-479e7c00-6036-40c0-8e82-065ae6f9cbaf service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Received unexpected event network-vif-plugged-06e85273-4218-48ad-b2d8-fa4a3875a57c for instance with vm_state active and task_state shelving_image_uploading.
Aug 03 05:03:05 user nova-compute[72444]: DEBUG nova.compute.manager [req-b3b18a3a-b97d-448c-a594-d32ebe2b8884 req-479e7c00-6036-40c0-8e82-065ae6f9cbaf service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Received event network-vif-plugged-06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:03:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b3b18a3a-b97d-448c-a594-d32ebe2b8884 req-479e7c00-6036-40c0-8e82-065ae6f9cbaf service nova] Acquiring lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:03:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b3b18a3a-b97d-448c-a594-d32ebe2b8884 req-479e7c00-6036-40c0-8e82-065ae6f9cbaf service nova] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:03:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b3b18a3a-b97d-448c-a594-d32ebe2b8884 req-479e7c00-6036-40c0-8e82-065ae6f9cbaf service nova] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:03:05 user nova-compute[72444]: DEBUG nova.compute.manager [req-b3b18a3a-b97d-448c-a594-d32ebe2b8884 req-479e7c00-6036-40c0-8e82-065ae6f9cbaf service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] No waiting events found dispatching network-vif-plugged-06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:03:05 user nova-compute[72444]: WARNING nova.compute.manager [req-b3b18a3a-b97d-448c-a594-d32ebe2b8884 req-479e7c00-6036-40c0-8e82-065ae6f9cbaf service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Received unexpected event network-vif-plugged-06e85273-4218-48ad-b2d8-fa4a3875a57c for instance with vm_state active and task_state shelving_image_uploading.
Aug 03 05:03:05 user nova-compute[72444]: DEBUG nova.compute.manager [req-b3b18a3a-b97d-448c-a594-d32ebe2b8884 req-479e7c00-6036-40c0-8e82-065ae6f9cbaf service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Received event network-vif-plugged-06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:03:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b3b18a3a-b97d-448c-a594-d32ebe2b8884 req-479e7c00-6036-40c0-8e82-065ae6f9cbaf service nova] Acquiring lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:03:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b3b18a3a-b97d-448c-a594-d32ebe2b8884 req-479e7c00-6036-40c0-8e82-065ae6f9cbaf service nova] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:03:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b3b18a3a-b97d-448c-a594-d32ebe2b8884 req-479e7c00-6036-40c0-8e82-065ae6f9cbaf service nova] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:03:05 user nova-compute[72444]: DEBUG nova.compute.manager [req-b3b18a3a-b97d-448c-a594-d32ebe2b8884 req-479e7c00-6036-40c0-8e82-065ae6f9cbaf service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] No waiting events found dispatching network-vif-plugged-06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:03:05 user nova-compute[72444]: WARNING nova.compute.manager [req-b3b18a3a-b97d-448c-a594-d32ebe2b8884 req-479e7c00-6036-40c0-8e82-065ae6f9cbaf service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Received unexpected event network-vif-plugged-06e85273-4218-48ad-b2d8-fa4a3875a57c for instance with vm_state active and task_state shelving_image_uploading.
Aug 03 05:03:05 user nova-compute[72444]: DEBUG nova.compute.manager [req-b3b18a3a-b97d-448c-a594-d32ebe2b8884 req-479e7c00-6036-40c0-8e82-065ae6f9cbaf service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Received event network-vif-unplugged-06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:03:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b3b18a3a-b97d-448c-a594-d32ebe2b8884 req-479e7c00-6036-40c0-8e82-065ae6f9cbaf service nova] Acquiring lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:03:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b3b18a3a-b97d-448c-a594-d32ebe2b8884 req-479e7c00-6036-40c0-8e82-065ae6f9cbaf service nova] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:03:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b3b18a3a-b97d-448c-a594-d32ebe2b8884 req-479e7c00-6036-40c0-8e82-065ae6f9cbaf service nova] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:03:05 user nova-compute[72444]: DEBUG nova.compute.manager [req-b3b18a3a-b97d-448c-a594-d32ebe2b8884 req-479e7c00-6036-40c0-8e82-065ae6f9cbaf service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] No waiting events found dispatching network-vif-unplugged-06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:03:05 user nova-compute[72444]: WARNING nova.compute.manager [req-b3b18a3a-b97d-448c-a594-d32ebe2b8884 req-479e7c00-6036-40c0-8e82-065ae6f9cbaf service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Received unexpected event network-vif-unplugged-06e85273-4218-48ad-b2d8-fa4a3875a57c for instance with vm_state active and task_state shelving_image_uploading.
Aug 03 05:03:05 user nova-compute[72444]: DEBUG nova.compute.manager [req-b3b18a3a-b97d-448c-a594-d32ebe2b8884 req-479e7c00-6036-40c0-8e82-065ae6f9cbaf service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Received event network-vif-plugged-06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:03:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b3b18a3a-b97d-448c-a594-d32ebe2b8884 req-479e7c00-6036-40c0-8e82-065ae6f9cbaf service nova] Acquiring lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:03:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b3b18a3a-b97d-448c-a594-d32ebe2b8884 req-479e7c00-6036-40c0-8e82-065ae6f9cbaf service nova] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:03:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b3b18a3a-b97d-448c-a594-d32ebe2b8884 req-479e7c00-6036-40c0-8e82-065ae6f9cbaf service nova] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:03:05 user nova-compute[72444]: DEBUG nova.compute.manager [req-b3b18a3a-b97d-448c-a594-d32ebe2b8884 req-479e7c00-6036-40c0-8e82-065ae6f9cbaf service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] No waiting events found dispatching network-vif-plugged-06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:03:05 user nova-compute[72444]: WARNING nova.compute.manager [req-b3b18a3a-b97d-448c-a594-d32ebe2b8884 req-479e7c00-6036-40c0-8e82-065ae6f9cbaf service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Received unexpected event network-vif-plugged-06e85273-4218-48ad-b2d8-fa4a3875a57c for instance with vm_state active and task_state shelving_image_uploading.
Aug 03 05:03:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:03:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10deaa3-d425-40b6-9b3f-d953164eadb8/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:03:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10deaa3-d425-40b6-9b3f-d953164eadb8/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:03:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10deaa3-d425-40b6-9b3f-d953164eadb8/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:03:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10deaa3-d425-40b6-9b3f-d953164eadb8/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:03:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f34c9b-a064-4de8-b278-4455be0b513a/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:03:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f34c9b-a064-4de8-b278-4455be0b513a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:03:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f34c9b-a064-4de8-b278-4455be0b513a/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:03:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f34c9b-a064-4de8-b278-4455be0b513a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:03:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:03:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:03:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:03:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:03:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 05:03:07 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:03:07 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:03:07 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=8151MB free_disk=25.384552001953125GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:03:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:03:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:03:07 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Applying migration context for instance 4f225dc2-3011-4c15-bb8e-1ebb079a3b50 as it has an incoming, in-progress migration 33ed3e3d-68a7-48f5-93c6-ff84fb352b8d. Migration status is finished {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 03 05:03:07 user nova-compute[72444]: INFO nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Updating resource usage from migration 33ed3e3d-68a7-48f5-93c6-ff84fb352b8d
Aug 03 05:03:07 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance d5b2e7fa-a2cc-42c9-89da-8f8850e748be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:03:07 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:03:07 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance c10deaa3-d425-40b6-9b3f-d953164eadb8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:03:07 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Migration 33ed3e3d-68a7-48f5-93c6-ff84fb352b8d is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 03 05:03:07 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 4f225dc2-3011-4c15-bb8e-1ebb079a3b50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:03:07 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 53f34c9b-a064-4de8-b278-4455be0b513a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:03:07 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:03:07 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=25GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:03:07 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:03:07 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:03:07 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:03:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.400s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:03:08 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-c7e4c566-f057-43c7-8e82-d9f909dc58a2 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Snapshot image upload complete
Aug 03 05:03:08 user nova-compute[72444]: DEBUG nova.compute.manager [None req-c7e4c566-f057-43c7-8e82-d9f909dc58a2 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:03:08 user nova-compute[72444]: INFO nova.compute.manager [None req-c7e4c566-f057-43c7-8e82-d9f909dc58a2 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Shelve offloading
Aug 03 05:03:08 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Instance destroyed successfully.
Aug 03 05:03:08 user nova-compute[72444]: DEBUG nova.compute.manager [None req-c7e4c566-f057-43c7-8e82-d9f909dc58a2 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:03:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c7e4c566-f057-43c7-8e82-d9f909dc58a2 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "refresh_cache-dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:03:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c7e4c566-f057-43c7-8e82-d9f909dc58a2 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquired lock "refresh_cache-dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:03:08 user nova-compute[72444]: DEBUG nova.network.neutron [None req-c7e4c566-f057-43c7-8e82-d9f909dc58a2 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 05:03:08 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:03:08 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:03:09 user nova-compute[72444]: DEBUG nova.network.neutron [None req-c7e4c566-f057-43c7-8e82-d9f909dc58a2 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Updating instance_info_cache with network_info: [{"id": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "address": "fa:16:3e:a4:56:cc", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e85273-42", "ovs_interfaceid": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:03:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c7e4c566-f057-43c7-8e82-d9f909dc58a2 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Releasing lock "refresh_cache-dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:03:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:10 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Instance destroyed successfully.
Aug 03 05:03:10 user nova-compute[72444]: DEBUG nova.objects.instance [None req-c7e4c566-f057-43c7-8e82-d9f909dc58a2 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lazy-loading 'resources' on Instance uuid dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:03:10 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-c7e4c566-f057-43c7-8e82-d9f909dc58a2 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:01:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1501682490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1501682490',id=37,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrIKQNieskQ5HIAC8bQPEDKoCrerktuCSqbnOrkAEuAh6cCBuPVrlD3Z1OOSXPqY/Ndp7grTBVvg9CJlEgBhUnbbt61T0LtdVmOEXUXEZ86SUTqwjbbnzXye2pofWqM9w==',key_name='tempest-keypair-2139993245',keypairs=<?>,launch_index=0,launched_at=2023-08-03T05:01:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ccf62b9ebb5f487184e3b84bbe7e73ad',ramdisk_id='',reservation_id='r-0f6l9ob9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-941210092',owner_user_name='tempest-AttachVolumeShelveTestJSON-941210092-project-member',shelved_at='2023-08-03T05:03:08.449413',shelved_host='user',shelved_image_id='41a0f80e-c0ba-49d5-b000-079aafba018b'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T05:03:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bff27e3d2ae04049b35afe1bfcc7352b',uuid=dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "address": "fa:16:3e:a4:56:cc", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e85273-42", "ovs_interfaceid": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 05:03:10 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-c7e4c566-f057-43c7-8e82-d9f909dc58a2 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Converting VIF {"id": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "address": "fa:16:3e:a4:56:cc", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e85273-42", "ovs_interfaceid": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:03:10 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-c7e4c566-f057-43c7-8e82-d9f909dc58a2 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:56:cc,bridge_name='br-int',has_traffic_filtering=True,id=06e85273-4218-48ad-b2d8-fa4a3875a57c,network=Network(3e3f34b4-1878-4a24-b0b2-ab0472fb62d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06e85273-42') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:03:10 user nova-compute[72444]: DEBUG os_vif [None req-c7e4c566-f057-43c7-8e82-d9f909dc58a2 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:56:cc,bridge_name='br-int',has_traffic_filtering=True,id=06e85273-4218-48ad-b2d8-fa4a3875a57c,network=Network(3e3f34b4-1878-4a24-b0b2-ab0472fb62d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06e85273-42') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 05:03:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06e85273-42, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:03:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:10 user nova-compute[72444]: INFO os_vif [None req-c7e4c566-f057-43c7-8e82-d9f909dc58a2 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:56:cc,bridge_name='br-int',has_traffic_filtering=True,id=06e85273-4218-48ad-b2d8-fa4a3875a57c,network=Network(3e3f34b4-1878-4a24-b0b2-ab0472fb62d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06e85273-42')
Aug 03 05:03:10 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-c7e4c566-f057-43c7-8e82-d9f909dc58a2 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Deleting instance files /opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8_del
Aug 03 05:03:10 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-c7e4c566-f057-43c7-8e82-d9f909dc58a2 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Deletion of /opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8_del complete
Aug 03 05:03:10 user nova-compute[72444]: DEBUG nova.compute.manager [req-90b3fb7c-3fdd-461a-854f-ee7c472b10b6 req-29cc13fb-5267-4376-a6bf-857a4b8d4b7a service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Received event network-changed-06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:03:10 user nova-compute[72444]: DEBUG nova.compute.manager [req-90b3fb7c-3fdd-461a-854f-ee7c472b10b6 req-29cc13fb-5267-4376-a6bf-857a4b8d4b7a service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Refreshing instance network info cache due to event network-changed-06e85273-4218-48ad-b2d8-fa4a3875a57c. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:03:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-90b3fb7c-3fdd-461a-854f-ee7c472b10b6 req-29cc13fb-5267-4376-a6bf-857a4b8d4b7a service nova] Acquiring lock "refresh_cache-dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:03:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-90b3fb7c-3fdd-461a-854f-ee7c472b10b6 req-29cc13fb-5267-4376-a6bf-857a4b8d4b7a service nova] Acquired lock "refresh_cache-dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:03:10 user nova-compute[72444]: DEBUG nova.network.neutron [req-90b3fb7c-3fdd-461a-854f-ee7c472b10b6 req-29cc13fb-5267-4376-a6bf-857a4b8d4b7a service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Refreshing network info cache for port 06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:03:10 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-c7e4c566-f057-43c7-8e82-d9f909dc58a2 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Deleted allocations for instance dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8
Aug 03 05:03:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c7e4c566-f057-43c7-8e82-d9f909dc58a2 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:03:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c7e4c566-f057-43c7-8e82-d9f909dc58a2 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:03:10 user nova-compute[72444]: DEBUG nova.objects.instance [None req-c7e4c566-f057-43c7-8e82-d9f909dc58a2 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lazy-loading 'numa_topology' on Instance uuid dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:03:10 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-c7e4c566-f057-43c7-8e82-d9f909dc58a2 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:03:10 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-c7e4c566-f057-43c7-8e82-d9f909dc58a2 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:03:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c7e4c566-f057-43c7-8e82-d9f909dc58a2 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.259s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:03:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c7e4c566-f057-43c7-8e82-d9f909dc58a2 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.345s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:03:10 user nova-compute[72444]: DEBUG nova.network.neutron [req-90b3fb7c-3fdd-461a-854f-ee7c472b10b6 req-29cc13fb-5267-4376-a6bf-857a4b8d4b7a service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Updated VIF entry in instance network info cache for port 06e85273-4218-48ad-b2d8-fa4a3875a57c. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:03:10 user nova-compute[72444]: DEBUG nova.network.neutron [req-90b3fb7c-3fdd-461a-854f-ee7c472b10b6 req-29cc13fb-5267-4376-a6bf-857a4b8d4b7a service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Updating instance_info_cache with network_info: [{"id": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "address": "fa:16:3e:a4:56:cc", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap06e85273-42", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:03:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-90b3fb7c-3fdd-461a-854f-ee7c472b10b6 req-29cc13fb-5267-4376-a6bf-857a4b8d4b7a service nova] Releasing lock "refresh_cache-dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:03:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:19 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691038984.5289466, dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:03:19 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] VM Stopped (Lifecycle Event)
Aug 03 05:03:19 user nova-compute[72444]: DEBUG nova.compute.manager [None req-7b4a94ca-e213-40ca-bcab-449d5125a277 None None] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:03:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7f4022c1-a4e4-4811-86ff-743251b3c7c3 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Acquiring lock "d5b2e7fa-a2cc-42c9-89da-8f8850e748be" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7f4022c1-a4e4-4811-86ff-743251b3c7c3 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "d5b2e7fa-a2cc-42c9-89da-8f8850e748be" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:03:21 user nova-compute[72444]: INFO nova.compute.manager [None req-7f4022c1-a4e4-4811-86ff-743251b3c7c3 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Detaching volume 6c67c8cb-8968-4c9e-8e89-3c2dea4d805a
Aug 03 05:03:21 user nova-compute[72444]: INFO nova.virt.block_device [None req-7f4022c1-a4e4-4811-86ff-743251b3c7c3 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Attempting to driver detach volume 6c67c8cb-8968-4c9e-8e89-3c2dea4d805a from mountpoint /dev/vdb
Aug 03 05:03:21 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-7f4022c1-a4e4-4811-86ff-743251b3c7c3 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Attempting to detach device vdb from instance d5b2e7fa-a2cc-42c9-89da-8f8850e748be from the persistent domain config. {{(pid=72444) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-7f4022c1-a4e4-4811-86ff-743251b3c7c3 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 05:03:21 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:03:21 user nova-compute[72444]:   <source dev="/dev/sdc"/>
Aug 03 05:03:21 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 05:03:21 user nova-compute[72444]:   <serial>6c67c8cb-8968-4c9e-8e89-3c2dea4d805a</serial>
Aug 03 05:03:21 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 05:03:21 user nova-compute[72444]: </disk>
Aug 03 05:03:21 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d7d30897-0240-4bea-91a0-de418c49db7d tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Acquiring lock "d5b2e7fa-a2cc-42c9-89da-8f8850e748be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:03:21 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-7f4022c1-a4e4-4811-86ff-743251b3c7c3 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Successfully detached device vdb from instance d5b2e7fa-a2cc-42c9-89da-8f8850e748be from the persistent domain config.
Aug 03 05:03:21 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-7f4022c1-a4e4-4811-86ff-743251b3c7c3 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d5b2e7fa-a2cc-42c9-89da-8f8850e748be from the live domain config. {{(pid=72444) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-7f4022c1-a4e4-4811-86ff-743251b3c7c3 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 05:03:21 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:03:21 user nova-compute[72444]:   <source dev="/dev/sdc"/>
Aug 03 05:03:21 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 05:03:21 user nova-compute[72444]:   <serial>6c67c8cb-8968-4c9e-8e89-3c2dea4d805a</serial>
Aug 03 05:03:21 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 05:03:21 user nova-compute[72444]: </disk>
Aug 03 05:03:21 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Received event <DeviceRemovedEvent: 1691039001.7567003, d5b2e7fa-a2cc-42c9-89da-8f8850e748be => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72444) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-7f4022c1-a4e4-4811-86ff-743251b3c7c3 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d5b2e7fa-a2cc-42c9-89da-8f8850e748be {{(pid=72444) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 05:03:21 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-7f4022c1-a4e4-4811-86ff-743251b3c7c3 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Successfully detached device vdb from instance d5b2e7fa-a2cc-42c9-89da-8f8850e748be from the live domain config.
Aug 03 05:03:21 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f4022c1-a4e4-4811-86ff-743251b3c7c3 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4022c1-a4e4-4811-86ff-743251b3c7c3 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HJZODefq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:03:21 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-7f4022c1-a4e4-4811-86ff-743251b3c7c3 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:03:21 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-7f4022c1-a4e4-4811-86ff-743251b3c7c3 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-7f4022c1-a4e4-4811-86ff-743251b3c7c3 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4022c1-a4e4-4811-86ff-743251b3c7c3 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc00a5d-c9b4-4f84-a3dc-ce15b2bc49cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fb10e9-7e37-4724-938e-347812618992]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4022c1-a4e4-4811-86ff-743251b3c7c3 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)
Aug 03 05:03:21 user nova-compute[72444]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a (non-flash)
Aug 03 05:03:21 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4022c1-a4e4-4811-86ff-743251b3c7c3 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)
Aug 03 05:03:21 user nova-compute[72444]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a (non-flash)
Aug 03 05:03:21 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4022c1-a4e4-4811-86ff-743251b3c7c3 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f309412d750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a'): ({'sdc'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-7f4022c1-a4e4-4811-86ff-743251b3c7c3 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Removing single pathed devices sdc {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89902c5-7005-4334-a338-49ee0fc72520]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[59394b31-4b66-453a-8712-ae667b4ff53f]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-7f4022c1-a4e4-4811-86ff-743251b3c7c3 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Flushing IO for device /dev/sdc {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2885fe2-22d0-401e-878f-578e7ec78091]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-7f4022c1-a4e4-4811-86ff-743251b3c7c3 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea35d41-eae2-4572-9e70-efc29a1060d5]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-7f4022c1-a4e4-4811-86ff-743251b3c7c3 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-7f4022c1-a4e4-4811-86ff-743251b3c7c3 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] SCSI volumes sdc have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4022c1-a4e4-4811-86ff-743251b3c7c3 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f35829-594b-4cf0-9942-d7e3fca6781e]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4022c1-a4e4-4811-86ff-743251b3c7c3 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:03:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:03:22 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:03:22 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea0d4dc-679e-450b-8c5b-0250b28b35e8]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:03:22 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4022c1-a4e4-4811-86ff-743251b3c7c3 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a, portal: 172.16.0.220,3260]
Aug 03 05:03:22 user nova-compute[72444]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a, portal: 172.16.0.220,3260] successful.
Aug 03 05:03:22 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:03:22 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:03:22 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:03:22 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cd5a06-ea0a-4374-8295-15f0a1c11e92]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:03:22 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4022c1-a4e4-4811-86ff-743251b3c7c3 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:03:22 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-7f4022c1-a4e4-4811-86ff-743251b3c7c3 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:03:22 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4022c1-a4e4-4811-86ff-743251b3c7c3 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] <== disconnect_volume: return (286ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:03:22 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f4022c1-a4e4-4811-86ff-743251b3c7c3 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 05:03:22 user nova-compute[72444]: DEBUG nova.objects.instance [None req-7f4022c1-a4e4-4811-86ff-743251b3c7c3 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lazy-loading 'flavor' on Instance uuid d5b2e7fa-a2cc-42c9-89da-8f8850e748be {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:03:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7f4022c1-a4e4-4811-86ff-743251b3c7c3 tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "d5b2e7fa-a2cc-42c9-89da-8f8850e748be" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.634s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:03:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d7d30897-0240-4bea-91a0-de418c49db7d tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "d5b2e7fa-a2cc-42c9-89da-8f8850e748be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.526s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:03:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d7d30897-0240-4bea-91a0-de418c49db7d tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Acquiring lock "d5b2e7fa-a2cc-42c9-89da-8f8850e748be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:03:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d7d30897-0240-4bea-91a0-de418c49db7d tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "d5b2e7fa-a2cc-42c9-89da-8f8850e748be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:03:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d7d30897-0240-4bea-91a0-de418c49db7d tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "d5b2e7fa-a2cc-42c9-89da-8f8850e748be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:03:22 user nova-compute[72444]: INFO nova.compute.manager [None req-d7d30897-0240-4bea-91a0-de418c49db7d tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Terminating instance
Aug 03 05:03:22 user nova-compute[72444]: DEBUG nova.compute.manager [None req-d7d30897-0240-4bea-91a0-de418c49db7d tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 05:03:22 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:22 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:22 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:22 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:23 user nova-compute[72444]: DEBUG nova.compute.manager [req-d85c6e60-945b-42c1-b14f-db1efef9a16b req-a86d4bbd-63e7-489f-9277-b2da98257d1a service nova] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Received event network-vif-unplugged-3409d644-fe83-4cee-aa78-9b0f8e360f50 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:03:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d85c6e60-945b-42c1-b14f-db1efef9a16b req-a86d4bbd-63e7-489f-9277-b2da98257d1a service nova] Acquiring lock "d5b2e7fa-a2cc-42c9-89da-8f8850e748be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:03:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d85c6e60-945b-42c1-b14f-db1efef9a16b req-a86d4bbd-63e7-489f-9277-b2da98257d1a service nova] Lock "d5b2e7fa-a2cc-42c9-89da-8f8850e748be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:03:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d85c6e60-945b-42c1-b14f-db1efef9a16b req-a86d4bbd-63e7-489f-9277-b2da98257d1a service nova] Lock "d5b2e7fa-a2cc-42c9-89da-8f8850e748be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:03:23 user nova-compute[72444]: DEBUG nova.compute.manager [req-d85c6e60-945b-42c1-b14f-db1efef9a16b req-a86d4bbd-63e7-489f-9277-b2da98257d1a service nova] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] No waiting events found dispatching network-vif-unplugged-3409d644-fe83-4cee-aa78-9b0f8e360f50 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:03:23 user nova-compute[72444]: DEBUG nova.compute.manager [req-d85c6e60-945b-42c1-b14f-db1efef9a16b req-a86d4bbd-63e7-489f-9277-b2da98257d1a service nova] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Received event network-vif-unplugged-3409d644-fe83-4cee-aa78-9b0f8e360f50 for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 05:03:23 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Instance destroyed successfully.
Aug 03 05:03:23 user nova-compute[72444]: DEBUG nova.objects.instance [None req-d7d30897-0240-4bea-91a0-de418c49db7d tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lazy-loading 'resources' on Instance uuid d5b2e7fa-a2cc-42c9-89da-8f8850e748be {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:03:23 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-d7d30897-0240-4bea-91a0-de418c49db7d tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:00:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1568052423',display_name='tempest-VolumesSnapshotTestJSON-instance-1568052423',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1568052423',id=36,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMVSN4d7HcTHBX9+mlhHZwr5RsMG0JEfi6Z8LVzw0wUC6ClxVDVSJnzwhbvnu8TKOpqHEnitbHDDR5cHtoCmML76rqwQLIjNhI3indYu+lzLxtCT6GmhlNtuBvBwYgQBQ==',key_name='tempest-keypair-2112991317',keypairs=<?>,launch_index=0,launched_at=2023-08-03T05:01:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ff54227e82764df6abd50b83068c64de',ramdisk_id='',reservation_id='r-by6rii9v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1757877731',owner_user_name='tempest-VolumesSnapshotTestJSON-1757877731-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T05:01:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be669ca3889044c7920db180a9a82ae2',uuid=d5b2e7fa-a2cc-42c9-89da-8f8850e748be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3409d644-fe83-4cee-aa78-9b0f8e360f50", "address": "fa:16:3e:35:3c:5f", "network": {"id": "81d682a4-018d-4927-866c-2b16d48f16e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-921368252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff54227e82764df6abd50b83068c64de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3409d644-fe", "ovs_interfaceid": "3409d644-fe83-4cee-aa78-9b0f8e360f50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 05:03:23 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-d7d30897-0240-4bea-91a0-de418c49db7d tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Converting VIF {"id": "3409d644-fe83-4cee-aa78-9b0f8e360f50", "address": "fa:16:3e:35:3c:5f", "network": {"id": "81d682a4-018d-4927-866c-2b16d48f16e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-921368252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff54227e82764df6abd50b83068c64de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3409d644-fe", "ovs_interfaceid": "3409d644-fe83-4cee-aa78-9b0f8e360f50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:03:23 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-d7d30897-0240-4bea-91a0-de418c49db7d tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:3c:5f,bridge_name='br-int',has_traffic_filtering=True,id=3409d644-fe83-4cee-aa78-9b0f8e360f50,network=Network(81d682a4-018d-4927-866c-2b16d48f16e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3409d644-fe') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:03:23 user nova-compute[72444]: DEBUG os_vif [None req-d7d30897-0240-4bea-91a0-de418c49db7d tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:3c:5f,bridge_name='br-int',has_traffic_filtering=True,id=3409d644-fe83-4cee-aa78-9b0f8e360f50,network=Network(81d682a4-018d-4927-866c-2b16d48f16e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3409d644-fe') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 05:03:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3409d644-fe, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:03:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:03:23 user nova-compute[72444]: INFO os_vif [None req-d7d30897-0240-4bea-91a0-de418c49db7d tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:3c:5f,bridge_name='br-int',has_traffic_filtering=True,id=3409d644-fe83-4cee-aa78-9b0f8e360f50,network=Network(81d682a4-018d-4927-866c-2b16d48f16e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3409d644-fe')
Aug 03 05:03:23 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7d30897-0240-4bea-91a0-de418c49db7d tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 05:03:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d30897-0240-4bea-91a0-de418c49db7d tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HJZODefq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:03:23 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-d7d30897-0240-4bea-91a0-de418c49db7d tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:03:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-d7d30897-0240-4bea-91a0-de418c49db7d tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:03:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-d7d30897-0240-4bea-91a0-de418c49db7d tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:03:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d30897-0240-4bea-91a0-de418c49db7d tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c67c8cb-8968-4c9e-8e89-3c2dea4d805a', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 05:03:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:03:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:03:23 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdb62ed-0d5f-4e01-b89a-238d661519b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:03:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:03:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:03:23 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb4a7bd-c488-41ee-8a5f-9f4d2c5c7934]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:03:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d30897-0240-4bea-91a0-de418c49db7d tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)
Aug 03 05:03:23 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:03:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d30897-0240-4bea-91a0-de418c49db7d tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)
Aug 03 05:03:23 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:03:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d30897-0240-4bea-91a0-de418c49db7d tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30941d69e0>, {}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 05:03:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d30897-0240-4bea-91a0-de418c49db7d tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Disconnecting from: [] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 05:03:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-d7d30897-0240-4bea-91a0-de418c49db7d tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.043s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:03:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d30897-0240-4bea-91a0-de418c49db7d tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] <== disconnect_volume: return (44ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:03:23 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7d30897-0240-4bea-91a0-de418c49db7d tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 05:03:23 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-d7d30897-0240-4bea-91a0-de418c49db7d tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Deleting instance files /opt/stack/data/nova/instances/d5b2e7fa-a2cc-42c9-89da-8f8850e748be_del
Aug 03 05:03:23 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-d7d30897-0240-4bea-91a0-de418c49db7d tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Deletion of /opt/stack/data/nova/instances/d5b2e7fa-a2cc-42c9-89da-8f8850e748be_del complete
Aug 03 05:03:23 user nova-compute[72444]: INFO nova.compute.manager [None req-d7d30897-0240-4bea-91a0-de418c49db7d tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 03 05:03:23 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-d7d30897-0240-4bea-91a0-de418c49db7d tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 05:03:23 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 05:03:23 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 05:03:24 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:03:24 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Took 0.94 seconds to deallocate network for instance.
Aug 03 05:03:24 user nova-compute[72444]: WARNING nova.volume.cinder [None req-d7d30897-0240-4bea-91a0-de418c49db7d tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Attachment f96a8995-fed7-4ec2-bce7-747477417df2 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = f96a8995-fed7-4ec2-bce7-747477417df2. (HTTP 404) (Request-ID: req-d8d28e58-3475-45ac-953d-ef16e726ae04)
Aug 03 05:03:24 user nova-compute[72444]: INFO nova.compute.manager [None req-d7d30897-0240-4bea-91a0-de418c49db7d tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Took 0.02 seconds to detach 1 volumes for instance.
Aug 03 05:03:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d7d30897-0240-4bea-91a0-de418c49db7d tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:03:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d7d30897-0240-4bea-91a0-de418c49db7d tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:03:24 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-d7d30897-0240-4bea-91a0-de418c49db7d tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:03:25 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-d7d30897-0240-4bea-91a0-de418c49db7d tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:03:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d7d30897-0240-4bea-91a0-de418c49db7d tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.201s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:03:25 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-d7d30897-0240-4bea-91a0-de418c49db7d tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Deleted allocations for instance d5b2e7fa-a2cc-42c9-89da-8f8850e748be
Aug 03 05:03:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d7d30897-0240-4bea-91a0-de418c49db7d tempest-VolumesSnapshotTestJSON-1757877731 tempest-VolumesSnapshotTestJSON-1757877731-project-member] Lock "d5b2e7fa-a2cc-42c9-89da-8f8850e748be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.320s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:03:25 user nova-compute[72444]: DEBUG nova.compute.manager [req-07305130-b60c-417a-8e03-bc1c66de21bf req-315138b9-d3ff-4fd1-9db2-9f9278cdb3be service nova] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Received event network-vif-plugged-3409d644-fe83-4cee-aa78-9b0f8e360f50 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:03:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-07305130-b60c-417a-8e03-bc1c66de21bf req-315138b9-d3ff-4fd1-9db2-9f9278cdb3be service nova] Acquiring lock "d5b2e7fa-a2cc-42c9-89da-8f8850e748be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:03:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-07305130-b60c-417a-8e03-bc1c66de21bf req-315138b9-d3ff-4fd1-9db2-9f9278cdb3be service nova] Lock "d5b2e7fa-a2cc-42c9-89da-8f8850e748be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:03:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-07305130-b60c-417a-8e03-bc1c66de21bf req-315138b9-d3ff-4fd1-9db2-9f9278cdb3be service nova] Lock "d5b2e7fa-a2cc-42c9-89da-8f8850e748be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:03:25 user nova-compute[72444]: DEBUG nova.compute.manager [req-07305130-b60c-417a-8e03-bc1c66de21bf req-315138b9-d3ff-4fd1-9db2-9f9278cdb3be service nova] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] No waiting events found dispatching network-vif-plugged-3409d644-fe83-4cee-aa78-9b0f8e360f50 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:03:25 user nova-compute[72444]: WARNING nova.compute.manager [req-07305130-b60c-417a-8e03-bc1c66de21bf req-315138b9-d3ff-4fd1-9db2-9f9278cdb3be service nova] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Received unexpected event network-vif-plugged-3409d644-fe83-4cee-aa78-9b0f8e360f50 for instance with vm_state deleted and task_state None.
Aug 03 05:03:25 user nova-compute[72444]: DEBUG nova.compute.manager [req-07305130-b60c-417a-8e03-bc1c66de21bf req-315138b9-d3ff-4fd1-9db2-9f9278cdb3be service nova] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Received event network-vif-deleted-3409d644-fe83-4cee-aa78-9b0f8e360f50 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:03:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:38 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691039003.6671705, d5b2e7fa-a2cc-42c9-89da-8f8850e748be => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:03:38 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] VM Stopped (Lifecycle Event)
Aug 03 05:03:38 user nova-compute[72444]: DEBUG nova.compute.manager [None req-c6954f4c-f0cd-43fd-8526-0d13404ac0d1 None None] [instance: d5b2e7fa-a2cc-42c9-89da-8f8850e748be] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:03:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:43 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:48 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:03:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:03:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:03:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:03:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:03:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:56 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:03:57 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:03:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:03:58 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:03:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 05:04:01 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:04:02 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:04:02 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:04:02 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Skipping network cache update for instance because it has been migrated to another host. {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9886}}
Aug 03 05:04:02 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Didn't find any instances for network info cache update. {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 03 05:04:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:04:04 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:04:05 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:04:05 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:04:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:04:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:04:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:04:05 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:04:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10deaa3-d425-40b6-9b3f-d953164eadb8/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10deaa3-d425-40b6-9b3f-d953164eadb8/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10deaa3-d425-40b6-9b3f-d953164eadb8/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10deaa3-d425-40b6-9b3f-d953164eadb8/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f34c9b-a064-4de8-b278-4455be0b513a/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f34c9b-a064-4de8-b278-4455be0b513a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f34c9b-a064-4de8-b278-4455be0b513a/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f34c9b-a064-4de8-b278-4455be0b513a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 05:04:07 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:04:07 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:04:07 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=8345MB free_disk=25.35580825805664GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:04:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:04:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:04:07 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Applying migration context for instance 4f225dc2-3011-4c15-bb8e-1ebb079a3b50 as it has an incoming, in-progress migration 33ed3e3d-68a7-48f5-93c6-ff84fb352b8d. Migration status is finished {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 03 05:04:07 user nova-compute[72444]: INFO nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Updating resource usage from migration 33ed3e3d-68a7-48f5-93c6-ff84fb352b8d
Aug 03 05:04:07 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance c10deaa3-d425-40b6-9b3f-d953164eadb8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:04:07 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Migration 33ed3e3d-68a7-48f5-93c6-ff84fb352b8d is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 03 05:04:07 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 4f225dc2-3011-4c15-bb8e-1ebb079a3b50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:04:07 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 53f34c9b-a064-4de8-b278-4455be0b513a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:04:07 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:04:07 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=23GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:04:07 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:04:07 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:04:07 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:04:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.297s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:04:08 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:04:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:04:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:04:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:04:18 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:04:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:04:23 user nova-compute[72444]: DEBUG nova.network.neutron [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Port 775b17bb-97a7-4a00-9368-198abafa4f8b binding to destination host user is already ACTIVE {{(pid=72444) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 03 05:04:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Acquiring lock "refresh_cache-4f225dc2-3011-4c15-bb8e-1ebb079a3b50" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:04:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Acquired lock "refresh_cache-4f225dc2-3011-4c15-bb8e-1ebb079a3b50" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:04:23 user nova-compute[72444]: DEBUG nova.network.neutron [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 05:04:23 user nova-compute[72444]: DEBUG nova.compute.manager [req-08a7f4b9-4004-4471-862f-0b20e9b66fe9 req-e5728ce7-72f4-4fed-8134-07ee5e713d61 service nova] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Received event network-changed-ef8f695a-323f-430d-88ac-7e83cdfa8b51 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:04:23 user nova-compute[72444]: DEBUG nova.compute.manager [req-08a7f4b9-4004-4471-862f-0b20e9b66fe9 req-e5728ce7-72f4-4fed-8134-07ee5e713d61 service nova] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Refreshing instance network info cache due to event network-changed-ef8f695a-323f-430d-88ac-7e83cdfa8b51. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:04:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-08a7f4b9-4004-4471-862f-0b20e9b66fe9 req-e5728ce7-72f4-4fed-8134-07ee5e713d61 service nova] Acquiring lock "refresh_cache-c10deaa3-d425-40b6-9b3f-d953164eadb8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:04:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-08a7f4b9-4004-4471-862f-0b20e9b66fe9 req-e5728ce7-72f4-4fed-8134-07ee5e713d61 service nova] Acquired lock "refresh_cache-c10deaa3-d425-40b6-9b3f-d953164eadb8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:04:23 user nova-compute[72444]: DEBUG nova.network.neutron [req-08a7f4b9-4004-4471-862f-0b20e9b66fe9 req-e5728ce7-72f4-4fed-8134-07ee5e713d61 service nova] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Refreshing network info cache for port ef8f695a-323f-430d-88ac-7e83cdfa8b51 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:04:24 user nova-compute[72444]: DEBUG nova.network.neutron [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Updating instance_info_cache with network_info: [{"id": "775b17bb-97a7-4a00-9368-198abafa4f8b", "address": "fa:16:3e:65:c2:ad", "network": {"id": "dd246ddd-6ffb-4516-b262-ef339c3f195c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2067592626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac3f775464f48d88f05efdf3aeb4fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b17bb-97", "ovs_interfaceid": "775b17bb-97a7-4a00-9368-198abafa4f8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:04:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Releasing lock "refresh_cache-4f225dc2-3011-4c15-bb8e-1ebb079a3b50" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:04:24 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Creating tmpfile /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/tmprlli1kvc to verify with other compute node that the instance is on the same shared storage. {{(pid=72444) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 03 05:04:24 user nova-compute[72444]: DEBUG nova.network.neutron [req-08a7f4b9-4004-4471-862f-0b20e9b66fe9 req-e5728ce7-72f4-4fed-8134-07ee5e713d61 service nova] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Updated VIF entry in instance network info cache for port ef8f695a-323f-430d-88ac-7e83cdfa8b51. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:04:24 user nova-compute[72444]: DEBUG nova.network.neutron [req-08a7f4b9-4004-4471-862f-0b20e9b66fe9 req-e5728ce7-72f4-4fed-8134-07ee5e713d61 service nova] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Updating instance_info_cache with network_info: [{"id": "ef8f695a-323f-430d-88ac-7e83cdfa8b51", "address": "fa:16:3e:29:7b:75", "network": {"id": "bc45559b-dcbf-41d7-82b5-72a479e25ae6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-620825918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd9faa4713af40faab9d6f37da3e9562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8f695a-32", "ovs_interfaceid": "ef8f695a-323f-430d-88ac-7e83cdfa8b51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:04:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-08a7f4b9-4004-4471-862f-0b20e9b66fe9 req-e5728ce7-72f4-4fed-8134-07ee5e713d61 service nova] Releasing lock "refresh_cache-c10deaa3-d425-40b6-9b3f-d953164eadb8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:04:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:04:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:04:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:04:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:04:24 user nova-compute[72444]: DEBUG nova.compute.manager [req-39501224-633c-4f58-8cd6-93b6b7a69be0 req-46ae40eb-de7e-476e-bd73-9bf6f1fa7c6e service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Received event network-vif-unplugged-775b17bb-97a7-4a00-9368-198abafa4f8b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:04:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-39501224-633c-4f58-8cd6-93b6b7a69be0 req-46ae40eb-de7e-476e-bd73-9bf6f1fa7c6e service nova] Acquiring lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:04:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-39501224-633c-4f58-8cd6-93b6b7a69be0 req-46ae40eb-de7e-476e-bd73-9bf6f1fa7c6e service nova] Lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:04:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-39501224-633c-4f58-8cd6-93b6b7a69be0 req-46ae40eb-de7e-476e-bd73-9bf6f1fa7c6e service nova] Lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:04:24 user nova-compute[72444]: DEBUG nova.compute.manager [req-39501224-633c-4f58-8cd6-93b6b7a69be0 req-46ae40eb-de7e-476e-bd73-9bf6f1fa7c6e service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] No waiting events found dispatching network-vif-unplugged-775b17bb-97a7-4a00-9368-198abafa4f8b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:04:24 user nova-compute[72444]: WARNING nova.compute.manager [req-39501224-633c-4f58-8cd6-93b6b7a69be0 req-46ae40eb-de7e-476e-bd73-9bf6f1fa7c6e service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Received unexpected event network-vif-unplugged-775b17bb-97a7-4a00-9368-198abafa4f8b for instance with vm_state resized and task_state resize_reverting.
Aug 03 05:04:25 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Instance destroyed successfully.
Aug 03 05:04:25 user nova-compute[72444]: DEBUG nova.objects.instance [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lazy-loading 'resources' on Instance uuid 4f225dc2-3011-4c15-bb8e-1ebb079a3b50 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:58:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1296432438',display_name='tempest-ServerActionsTestOtherB-server-1296432438',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1296432438',id=35,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJ2xwGpHSyejfRET9nle34ymsQ3JqEh+tuKb2KyDC9LlCqAQDSefnEuOykG9x3OwiAXCAIlmzscOwuKKHQpDe3RMRIrjD9v6y95AwIln0JKokDq03KE9SlxC2ULq7kCag==',key_name='tempest-keypair-1872408921',keypairs=<?>,launch_index=0,launched_at=2023-08-03T05:02:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ac3f775464f48d88f05efdf3aeb4fb8',ramdisk_id='',reservation_id='r-0ygb2937',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1191335247',owner_user_name='tempest-ServerActionsTestOtherB-1191335247-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T05:02:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32aef58e87044e47b99cd37e300393aa',uuid=4f225dc2-3011-4c15-bb8e-1ebb079a3b50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "775b17bb-97a7-4a00-9368-198abafa4f8b", "address": "fa:16:3e:65:c2:ad", "network": {"id": "dd246ddd-6ffb-4516-b262-ef339c3f195c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2067592626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac3f775464f48d88f05efdf3aeb4fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b17bb-97", "ovs_interfaceid": "775b17bb-97a7-4a00-9368-198abafa4f8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Converting VIF {"id": "775b17bb-97a7-4a00-9368-198abafa4f8b", "address": "fa:16:3e:65:c2:ad", "network": {"id": "dd246ddd-6ffb-4516-b262-ef339c3f195c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2067592626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac3f775464f48d88f05efdf3aeb4fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b17bb-97", "ovs_interfaceid": "775b17bb-97a7-4a00-9368-198abafa4f8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:c2:ad,bridge_name='br-int',has_traffic_filtering=True,id=775b17bb-97a7-4a00-9368-198abafa4f8b,network=Network(dd246ddd-6ffb-4516-b262-ef339c3f195c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775b17bb-97') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG os_vif [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:c2:ad,bridge_name='br-int',has_traffic_filtering=True,id=775b17bb-97a7-4a00-9368-198abafa4f8b,network=Network(dd246ddd-6ffb-4516-b262-ef339c3f195c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775b17bb-97') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap775b17bb-97, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:04:25 user nova-compute[72444]: INFO os_vif [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:c2:ad,bridge_name='br-int',has_traffic_filtering=True,id=775b17bb-97a7-4a00-9368-198abafa4f8b,network=Network(dd246ddd-6ffb-4516-b262-ef339c3f195c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775b17bb-97')
Aug 03 05:04:25 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VvBMfthQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:04:25 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:04:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[72388798-0c31-4d98-a27b-9b69015ec694]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3132ad-d431-471d-b294-121b86956911]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)
Aug 03 05:04:25 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)
Aug 03 05:04:25 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308c5e6c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1'): ({'sdb'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Removing single pathed devices sdb {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[096a1051-7ace-4b10-a345-1beffcc3b0af]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b17b8c1-ab95-4a63-9574-318168b119fc]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Flushing IO for device /dev/sdb {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cea1a7-ced6-4548-ba13-dd98b25cb149]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.029s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b539f239-72c0-456c-9f96-fedc8a8ef38b]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[889444a1-55e1-4523-aefc-59351a0588e6]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[899fb285-21b3-4e29-a847-4f28cad8f89a]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1, portal: 172.16.0.220,3260]
Aug 03 05:04:25 user nova-compute[72444]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1, portal: 172.16.0.220,3260] successful.
Aug 03 05:04:25 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed6a122-9125-4f2f-89a3-7ad21644d76c]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.236s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] <== disconnect_volume: return (238ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:04:25 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 05:04:26 user nova-compute[72444]: DEBUG nova.compute.manager [req-b619c1f0-737c-4bb6-a1da-e27d6bc65bfe req-098a2dfe-949d-4606-9cbe-438a7975d6e8 service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Received event network-vif-plugged-775b17bb-97a7-4a00-9368-198abafa4f8b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:04:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b619c1f0-737c-4bb6-a1da-e27d6bc65bfe req-098a2dfe-949d-4606-9cbe-438a7975d6e8 service nova] Acquiring lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:04:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b619c1f0-737c-4bb6-a1da-e27d6bc65bfe req-098a2dfe-949d-4606-9cbe-438a7975d6e8 service nova] Lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:04:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b619c1f0-737c-4bb6-a1da-e27d6bc65bfe req-098a2dfe-949d-4606-9cbe-438a7975d6e8 service nova] Lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:04:26 user nova-compute[72444]: DEBUG nova.compute.manager [req-b619c1f0-737c-4bb6-a1da-e27d6bc65bfe req-098a2dfe-949d-4606-9cbe-438a7975d6e8 service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] No waiting events found dispatching network-vif-plugged-775b17bb-97a7-4a00-9368-198abafa4f8b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:04:26 user nova-compute[72444]: WARNING nova.compute.manager [req-b619c1f0-737c-4bb6-a1da-e27d6bc65bfe req-098a2dfe-949d-4606-9cbe-438a7975d6e8 service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Received unexpected event network-vif-plugged-775b17bb-97a7-4a00-9368-198abafa4f8b for instance with vm_state resized and task_state resize_reverting.
Aug 03 05:04:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Acquiring lock "c10deaa3-d425-40b6-9b3f-d953164eadb8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:04:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Lock "c10deaa3-d425-40b6-9b3f-d953164eadb8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:04:28 user nova-compute[72444]: DEBUG nova.objects.instance [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Lazy-loading 'flavor' on Instance uuid c10deaa3-d425-40b6-9b3f-d953164eadb8 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:04:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Lock "c10deaa3-d425-40b6-9b3f-d953164eadb8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:04:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Acquiring lock "c10deaa3-d425-40b6-9b3f-d953164eadb8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:04:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Lock "c10deaa3-d425-40b6-9b3f-d953164eadb8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:04:28 user nova-compute[72444]: INFO nova.compute.manager [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Attaching volume f9f75971-9922-435d-9073-6b58f6c8f130 to /dev/vdb
Aug 03 05:04:28 user nova-compute[72444]: DEBUG os_brick.utils [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:04:28 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:28 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:28 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82877ba-cbf9-4c13-9256-c26b42a0ef44]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:28 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:28 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:28 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f0f7ad-f2aa-462f-bba5-d44ff5327ee8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:28 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:28 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:28 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da523b1-b6e6-49ff-befa-f783fa9d2ec8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:28 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef498251-ab42-464f-9921-11cabc3df51d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:28 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:28 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:04:28 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 05:04:28 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:28 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:04:28 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 05:04:28 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0471cb2-a433-459d-9f4e-00e62744c465]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:28 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 05:04:28 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 05:04:28 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 05:04:28 user nova-compute[72444]: DEBUG os_brick.utils [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:04:28 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Updating existing volume attachment record: 1dd5802e-d934-4a8f-9d9d-ebd5fbccc4aa {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 05:04:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:04:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:04:29 user nova-compute[72444]: DEBUG nova.objects.instance [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lazy-loading 'migration_context' on Instance uuid 4f225dc2-3011-4c15-bb8e-1ebb079a3b50 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:04:29 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:04:29 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:04:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.259s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:04:29 user nova-compute[72444]: INFO nova.compute.manager [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Swapping old allocation on dict_keys(['b624a913-bb6b-4a17-8cd7-7b0950cff161']) held by migration 33ed3e3d-68a7-48f5-93c6-ff84fb352b8d for instance
Aug 03 05:04:30 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Overwriting current allocation {'allocations': {'b624a913-bb6b-4a17-8cd7-7b0950cff161': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 46}}, 'project_id': '3ac3f775464f48d88f05efdf3aeb4fb8', 'user_id': '32aef58e87044e47b99cd37e300393aa', 'consumer_generation': 1} on consumer 4f225dc2-3011-4c15-bb8e-1ebb079a3b50 {{(pid=72444) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 03 05:04:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Acquiring lock "refresh_cache-4f225dc2-3011-4c15-bb8e-1ebb079a3b50" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:04:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Acquired lock "refresh_cache-4f225dc2-3011-4c15-bb8e-1ebb079a3b50" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:04:30 user nova-compute[72444]: DEBUG nova.network.neutron [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 05:04:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:04:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:04:30 user nova-compute[72444]: DEBUG nova.network.neutron [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Updating instance_info_cache with network_info: [{"id": "775b17bb-97a7-4a00-9368-198abafa4f8b", "address": "fa:16:3e:65:c2:ad", "network": {"id": "dd246ddd-6ffb-4516-b262-ef339c3f195c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2067592626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac3f775464f48d88f05efdf3aeb4fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b17bb-97", "ovs_interfaceid": "775b17bb-97a7-4a00-9368-198abafa4f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:04:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Releasing lock "refresh_cache-4f225dc2-3011-4c15-bb8e-1ebb079a3b50" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:04:30 user nova-compute[72444]: DEBUG os_brick.utils [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:04:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:30 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce951d3f-7823-44f8-b952-11e6cc3a6cc9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:30 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfc3b31-9cd8-4476-99bb-0c0292b66b3a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:30 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd6301f-edc5-4f61-bc99-a3918b4acae5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:30 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a43163c-800a-43fe-a933-2beb3e6f366d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:04:30 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 05:04:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:04:30 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 05:04:30 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8abd994-1639-4437-a6c5-ee408a4d7f3e]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:30 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 05:04:30 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 05:04:30 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 05:04:30 user nova-compute[72444]: DEBUG os_brick.utils [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:04:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:04:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vRZYAfXq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:04:39 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:04:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:04:39 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:04:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:04:39 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 05:04:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ee2b47-6493-492b-aa99-23cc630c68b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 05:04:39 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130 -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f75da8b-9db5-4eec-ad2a-17ca58f4075f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130] added
Aug 03 05:04:39 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6465a79-4e4c-495e-a43d-1fdd0b548d23]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be55295-1630-4ef2-bc57-f452d10be7d6]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vRZYAfXq {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vRZYAfXq" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad363396-0b66-4643-b85c-7f8e26d63697]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vRZYAfXq'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f58511-e1e9-4fd3-abd2-4573b0ca97fa]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f3e237-5219-42a2-9fc5-03a3f0d92e77]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 03 05:04:39 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 03 05:04:39 user nova-compute[72444]:  {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:04:39 user nova-compute[72444]: WARNING os_brick.initiator.connectors.iscsi [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 03 05:04:39 user nova-compute[72444]: 
Aug 03 05:04:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130 -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[447eb23b-bc08-471e-afb7-9de0be3e224c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130, portal: 172.16.0.220,3260]
Aug 03 05:04:39 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130, portal: 172.16.0.220,3260] successful.
Aug 03 05:04:39 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdce469-0be2-497d-b580-ff31dd8fc804]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4197f21f-1998-42ec-b360-70e4c2aafa31]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130 (non-flash)
Aug 03 05:04:39 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130 (non-flash)
Aug 03 05:04:39 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e69f96-a1d4-48ca-921b-00395d4648c1]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:39 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: None {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 05:04:40 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691039065.2802505, 4f225dc2-3011-4c15-bb8e-1ebb079a3b50 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:04:40 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] VM Stopped (Lifecycle Event)
Aug 03 05:04:40 user nova-compute[72444]: DEBUG nova.compute.manager [None req-71dc7fc7-71d4-4a01-9400-f4e3882eaf88 None None] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:04:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:04:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:04:40 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 05:04:40 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vRZYAfXq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 05:04:40 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:04:40 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26630353264653063', 'path': '/dev/sdb'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:04:40 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630353264653063', 'path': '/dev/sdb'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 05:04:40 user nova-compute[72444]: DEBUG nova.objects.instance [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Lazy-loading 'flavor' on Instance uuid c10deaa3-d425-40b6-9b3f-d953164eadb8 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:04:40 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 05:04:40 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:04:40 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 05:04:40 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 05:04:40 user nova-compute[72444]:   <serial>f9f75971-9922-435d-9073-6b58f6c8f130</serial>
Aug 03 05:04:40 user nova-compute[72444]: </disk>
Aug 03 05:04:40 user nova-compute[72444]:  {{(pid=72444) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 05:04:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:04:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:04:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] No VIF found with MAC fa:16:3e:29:7b:75, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 05:04:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-fa7c19c5-ff11-4207-b306-7053ea70b947 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Lock "c10deaa3-d425-40b6-9b3f-d953164eadb8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.879s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:04:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8ffeffb3-34bd-4ec3-bead-19d1e6402a94 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Acquiring lock "c10deaa3-d425-40b6-9b3f-d953164eadb8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:04:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8ffeffb3-34bd-4ec3-bead-19d1e6402a94 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Lock "c10deaa3-d425-40b6-9b3f-d953164eadb8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:04:42 user nova-compute[72444]: INFO nova.compute.manager [None req-8ffeffb3-34bd-4ec3-bead-19d1e6402a94 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Detaching volume f9f75971-9922-435d-9073-6b58f6c8f130
Aug 03 05:04:43 user nova-compute[72444]: INFO nova.virt.block_device [None req-8ffeffb3-34bd-4ec3-bead-19d1e6402a94 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Attempting to driver detach volume f9f75971-9922-435d-9073-6b58f6c8f130 from mountpoint /dev/vdb
Aug 03 05:04:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-8ffeffb3-34bd-4ec3-bead-19d1e6402a94 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Attempting to detach device vdb from instance c10deaa3-d425-40b6-9b3f-d953164eadb8 from the persistent domain config. {{(pid=72444) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-8ffeffb3-34bd-4ec3-bead-19d1e6402a94 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 05:04:43 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:04:43 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 05:04:43 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 05:04:43 user nova-compute[72444]:   <serial>f9f75971-9922-435d-9073-6b58f6c8f130</serial>
Aug 03 05:04:43 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 05:04:43 user nova-compute[72444]: </disk>
Aug 03 05:04:43 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 05:04:43 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-8ffeffb3-34bd-4ec3-bead-19d1e6402a94 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Successfully detached device vdb from instance c10deaa3-d425-40b6-9b3f-d953164eadb8 from the persistent domain config.
Aug 03 05:04:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-8ffeffb3-34bd-4ec3-bead-19d1e6402a94 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c10deaa3-d425-40b6-9b3f-d953164eadb8 from the live domain config. {{(pid=72444) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-8ffeffb3-34bd-4ec3-bead-19d1e6402a94 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 05:04:43 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:04:43 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 05:04:43 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 05:04:43 user nova-compute[72444]:   <serial>f9f75971-9922-435d-9073-6b58f6c8f130</serial>
Aug 03 05:04:43 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 05:04:43 user nova-compute[72444]: </disk>
Aug 03 05:04:43 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Received event <DeviceRemovedEvent: 1691039083.4872274, c10deaa3-d425-40b6-9b3f-d953164eadb8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72444) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-8ffeffb3-34bd-4ec3-bead-19d1e6402a94 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c10deaa3-d425-40b6-9b3f-d953164eadb8 {{(pid=72444) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 05:04:43 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-8ffeffb3-34bd-4ec3-bead-19d1e6402a94 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Successfully detached device vdb from instance c10deaa3-d425-40b6-9b3f-d953164eadb8 from the live domain config.
Aug 03 05:04:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ffeffb3-34bd-4ec3-bead-19d1e6402a94 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffeffb3-34bd-4ec3-bead-19d1e6402a94 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vRZYAfXq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:04:43 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-8ffeffb3-34bd-4ec3-bead-19d1e6402a94 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:04:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-8ffeffb3-34bd-4ec3-bead-19d1e6402a94 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-8ffeffb3-34bd-4ec3-bead-19d1e6402a94 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffeffb3-34bd-4ec3-bead-19d1e6402a94 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5a3557-fb8e-4741-a3c6-9beae8460057]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1e87e1-a5c9-4e44-97da-52a1572bbef7]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffeffb3-34bd-4ec3-bead-19d1e6402a94 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130 (non-flash)
Aug 03 05:04:43 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffeffb3-34bd-4ec3-bead-19d1e6402a94 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130 (non-flash)
Aug 03 05:04:43 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffeffb3-34bd-4ec3-bead-19d1e6402a94 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308c27f640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130'): ({'sdb'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-8ffeffb3-34bd-4ec3-bead-19d1e6402a94 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Removing single pathed devices sdb {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91271e8-674e-4141-a9e5-1fe7ba27a4d6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e63c140-2b3d-443d-8f71-b0ead188b9db]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-8ffeffb3-34bd-4ec3-bead-19d1e6402a94 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Flushing IO for device /dev/sdb {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba71951f-7869-4f69-bd62-07939fc8583e]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-8ffeffb3-34bd-4ec3-bead-19d1e6402a94 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2b8d21-cb7c-4a74-a902-c09da5b1298b]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-8ffeffb3-34bd-4ec3-bead-19d1e6402a94 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-8ffeffb3-34bd-4ec3-bead-19d1e6402a94 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffeffb3-34bd-4ec3-bead-19d1e6402a94 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8425030c-c8fa-492d-a7fc-9780ef876e36]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffeffb3-34bd-4ec3-bead-19d1e6402a94 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130 -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d0e4d1-bfa0-4635-9da4-7830e00a6714]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffeffb3-34bd-4ec3-bead-19d1e6402a94 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130, portal: 172.16.0.220,3260]
Aug 03 05:04:43 user nova-compute[72444]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130, portal: 172.16.0.220,3260] successful.
Aug 03 05:04:43 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130 -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9f75971-9922-435d-9073-6b58f6c8f130 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be62f1d-1c33-4c09-a814-8b8c7b864f78]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffeffb3-34bd-4ec3-bead-19d1e6402a94 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-8ffeffb3-34bd-4ec3-bead-19d1e6402a94 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.249s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffeffb3-34bd-4ec3-bead-19d1e6402a94 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] <== disconnect_volume: return (250ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:04:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ffeffb3-34bd-4ec3-bead-19d1e6402a94 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 05:04:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:04:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:04:50 user nova-compute[72444]: DEBUG nova.objects.instance [None req-8ffeffb3-34bd-4ec3-bead-19d1e6402a94 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Lazy-loading 'flavor' on Instance uuid c10deaa3-d425-40b6-9b3f-d953164eadb8 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:04:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8ffeffb3-34bd-4ec3-bead-19d1e6402a94 tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Lock "c10deaa3-d425-40b6-9b3f-d953164eadb8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.804s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:04:50 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Starting finish_revert_migration {{(pid=72444) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Start _get_guest_xml network_info=[{"id": "775b17bb-97a7-4a00-9368-198abafa4f8b", "address": "fa:16:3e:65:c2:ad", "network": {"id": "dd246ddd-6ffb-4516-b262-ef339c3f195c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2067592626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac3f775464f48d88f05efdf3aeb4fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b17bb-97", "ovs_interfaceid": "775b17bb-97a7-4a00-9368-198abafa4f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VvBMfthQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '4f225dc2-3011-4c15-bb8e-1ebb079a3b50', 'attached_at': '2023-08-03T05:04:51.000000', 'detached_at': '', 'volume_id': '2b52b731-02ae-4042-b0c7-41734eabc3b1', 'serial': '2b52b731-02ae-4042-b0c7-41734eabc3b1'}, 'disk_bus': 'virtio', 'attachment_id': '468834ce-4dd3-4a87-8d4b-efdc207d6cfe', 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 05:04:51 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:04:51 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:04:51 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG nova.objects.instance [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4f225dc2-3011-4c15-bb8e-1ebb079a3b50 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VvBMfthQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:04:51 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:04:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:04:51 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:04:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:04:51 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba5b1e3-7b72-4735-9dd8-e9ca755eda8d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 05:04:51 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb7e9e7-cf72-4d17-bca9-238537c3cdbd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1] added
Aug 03 05:04:51 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f784b8-3543-4a1c-9cf8-80773c93ef06]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fca864-ed25-44ae-9619-bc99dc359925]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VvBMfthQ {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VvBMfthQ" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8245d9-9883-49c3-b136-66b24d8ffeff]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VvBMfthQ'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82cd82a-97a9-4c06-a335-9b5057dd6284]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdd0ab2-eb7b-4a51-a536-23bfeb34143f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 03 05:04:51 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 03 05:04:51 user nova-compute[72444]:  {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:04:51 user nova-compute[72444]: WARNING os_brick.initiator.connectors.iscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 03 05:04:51 user nova-compute[72444]: 
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5b8b23-7a06-4b8e-b680-428c799e5eae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1, portal: 172.16.0.220,3260]
Aug 03 05:04:51 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1, portal: 172.16.0.220,3260] successful.
Aug 03 05:04:51 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c98309-7b05-40a3-8945-e4656b53f05a]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[241d1c13-d494-4d36-8127-7a1e38aee66a]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)
Aug 03 05:04:51 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)
Aug 03 05:04:51 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b684b7-252a-4564-ab7e-fc8f7833ff30]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VvBMfthQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquiring lock "53f34c9b-a064-4de8-b278-4455be0b513a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "53f34c9b-a064-4de8-b278-4455be0b513a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG nova.objects.instance [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lazy-loading 'flavor' on Instance uuid 53f34c9b-a064-4de8-b278-4455be0b513a {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "53f34c9b-a064-4de8-b278-4455be0b513a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquiring lock "53f34c9b-a064-4de8-b278-4455be0b513a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "53f34c9b-a064-4de8-b278-4455be0b513a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:04:51 user nova-compute[72444]: INFO nova.compute.manager [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Attaching volume eb2795ec-187c-4dea-a784-f4728300b46a to /dev/vdb
Aug 03 05:04:51 user nova-compute[72444]: DEBUG os_brick.utils [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[936527fd-5209-4018-bf40-d7a0deb76d9a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f22e02-3b63-4e32-8670-a834c115de34]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c82f95-d265-4012-9883-90ce0815b191]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[43845066-5801-46b6-a071-0f37164b30f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:04:51 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 05:04:51 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c53ab6-fd72-4ac3-a996-5f113c9d62f0]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG os_brick.utils [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:04:51 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Updating existing volume attachment record: fa7f5a8b-6647-402f-9fa8-fbdbc0c0aeaa {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 05:04:52 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:04:52 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23936643465326264', 'path': '/dev/sdb'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:04:52 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936643465326264', 'path': '/dev/sdb'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 05:04:52 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:58:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1296432438',display_name='tempest-ServerActionsTestOtherB-server-1296432438',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1296432438',id=35,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJ2xwGpHSyejfRET9nle34ymsQ3JqEh+tuKb2KyDC9LlCqAQDSefnEuOykG9x3OwiAXCAIlmzscOwuKKHQpDe3RMRIrjD9v6y95AwIln0JKokDq03KE9SlxC2ULq7kCag==',key_name='tempest-keypair-1872408921',keypairs=<?>,launch_index=0,launched_at=2023-08-03T05:02:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3ac3f775464f48d88f05efdf3aeb4fb8',ramdisk_id='',reservation_id='r-0ygb2937',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1191335247',owner_user_name='tempest-ServerActionsTestOtherB-1191335247-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T05:04:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32aef58e87044e47b99cd37e300393aa',uuid=4f225dc2-3011-4c15-bb8e-1ebb079a3b50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "775b17bb-97a7-4a00-9368-198abafa4f8b", "address": "fa:16:3e:65:c2:ad", "network": {"id": "dd246ddd-6ffb-4516-b262-ef339c3f195c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2067592626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac3f775464f48d88f05efdf3aeb4fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b17bb-97", "ovs_interfaceid": "775b17bb-97a7-4a00-9368-198abafa4f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 05:04:52 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Converting VIF {"id": "775b17bb-97a7-4a00-9368-198abafa4f8b", "address": "fa:16:3e:65:c2:ad", "network": {"id": "dd246ddd-6ffb-4516-b262-ef339c3f195c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2067592626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac3f775464f48d88f05efdf3aeb4fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b17bb-97", "ovs_interfaceid": "775b17bb-97a7-4a00-9368-198abafa4f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:04:52 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:c2:ad,bridge_name='br-int',has_traffic_filtering=True,id=775b17bb-97a7-4a00-9368-198abafa4f8b,network=Network(dd246ddd-6ffb-4516-b262-ef339c3f195c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775b17bb-97') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:04:52 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] End _get_guest_xml xml=<domain type="kvm">
Aug 03 05:04:52 user nova-compute[72444]:   <uuid>4f225dc2-3011-4c15-bb8e-1ebb079a3b50</uuid>
Aug 03 05:04:52 user nova-compute[72444]:   <name>instance-00000023</name>
Aug 03 05:04:52 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 05:04:52 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 05:04:52 user nova-compute[72444]:   <metadata>
Aug 03 05:04:52 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 05:04:52 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 05:04:52 user nova-compute[72444]:       <nova:name>tempest-ServerActionsTestOtherB-server-1296432438</nova:name>
Aug 03 05:04:52 user nova-compute[72444]:       <nova:creationTime>2023-08-03 05:04:51</nova:creationTime>
Aug 03 05:04:52 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 05:04:52 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 05:04:52 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 05:04:52 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 05:04:52 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 05:04:52 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 05:04:52 user nova-compute[72444]:       </nova:flavor>
Aug 03 05:04:52 user nova-compute[72444]:       <nova:owner>
Aug 03 05:04:52 user nova-compute[72444]:         <nova:user uuid="32aef58e87044e47b99cd37e300393aa">tempest-ServerActionsTestOtherB-1191335247-project-member</nova:user>
Aug 03 05:04:52 user nova-compute[72444]:         <nova:project uuid="3ac3f775464f48d88f05efdf3aeb4fb8">tempest-ServerActionsTestOtherB-1191335247</nova:project>
Aug 03 05:04:52 user nova-compute[72444]:       </nova:owner>
Aug 03 05:04:52 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 05:04:52 user nova-compute[72444]:       <nova:ports>
Aug 03 05:04:52 user nova-compute[72444]:         <nova:port uuid="775b17bb-97a7-4a00-9368-198abafa4f8b">
Aug 03 05:04:52 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 03 05:04:52 user nova-compute[72444]:         </nova:port>
Aug 03 05:04:52 user nova-compute[72444]:       </nova:ports>
Aug 03 05:04:52 user nova-compute[72444]:     </nova:instance>
Aug 03 05:04:52 user nova-compute[72444]:   </metadata>
Aug 03 05:04:52 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 05:04:52 user nova-compute[72444]:     <system>
Aug 03 05:04:52 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 05:04:52 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 05:04:52 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 05:04:52 user nova-compute[72444]:       <entry name="serial">4f225dc2-3011-4c15-bb8e-1ebb079a3b50</entry>
Aug 03 05:04:52 user nova-compute[72444]:       <entry name="uuid">4f225dc2-3011-4c15-bb8e-1ebb079a3b50</entry>
Aug 03 05:04:52 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 05:04:52 user nova-compute[72444]:     </system>
Aug 03 05:04:52 user nova-compute[72444]:   </sysinfo>
Aug 03 05:04:52 user nova-compute[72444]:   <os>
Aug 03 05:04:52 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 05:04:52 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 05:04:52 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 05:04:52 user nova-compute[72444]:   </os>
Aug 03 05:04:52 user nova-compute[72444]:   <features>
Aug 03 05:04:52 user nova-compute[72444]:     <acpi/>
Aug 03 05:04:52 user nova-compute[72444]:     <apic/>
Aug 03 05:04:52 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 05:04:52 user nova-compute[72444]:   </features>
Aug 03 05:04:52 user nova-compute[72444]:   <clock offset="utc">
Aug 03 05:04:52 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 05:04:52 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 05:04:52 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 05:04:52 user nova-compute[72444]:   </clock>
Aug 03 05:04:52 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 05:04:52 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 05:04:52 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 05:04:52 user nova-compute[72444]:   </cpu>
Aug 03 05:04:52 user nova-compute[72444]:   <devices>
Aug 03 05:04:52 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 05:04:52 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 05:04:52 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk"/>
Aug 03 05:04:52 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 05:04:52 user nova-compute[72444]:     </disk>
Aug 03 05:04:52 user nova-compute[72444]:     <disk type="block" device="disk">
Aug 03 05:04:52 user nova-compute[72444]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:04:52 user nova-compute[72444]:       <source dev="/dev/sdb"/>
Aug 03 05:04:52 user nova-compute[72444]:       <target dev="vdb" bus="virtio"/>
Aug 03 05:04:52 user nova-compute[72444]:       <serial>2b52b731-02ae-4042-b0c7-41734eabc3b1</serial>
Aug 03 05:04:52 user nova-compute[72444]:     </disk>
Aug 03 05:04:52 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 05:04:52 user nova-compute[72444]:       <mac address="fa:16:3e:65:c2:ad"/>
Aug 03 05:04:52 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:04:52 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 05:04:52 user nova-compute[72444]:       <target dev="tap775b17bb-97"/>
Aug 03 05:04:52 user nova-compute[72444]:     </interface>
Aug 03 05:04:52 user nova-compute[72444]:     <serial type="pty">
Aug 03 05:04:52 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/console.log" append="off"/>
Aug 03 05:04:52 user nova-compute[72444]:     </serial>
Aug 03 05:04:52 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 05:04:52 user nova-compute[72444]:     <video>
Aug 03 05:04:52 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:04:52 user nova-compute[72444]:     </video>
Aug 03 05:04:52 user nova-compute[72444]:     <rng model="virtio">
Aug 03 05:04:52 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 05:04:52 user nova-compute[72444]:     </rng>
Aug 03 05:04:52 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 05:04:52 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 05:04:52 user nova-compute[72444]:       <stats period="10"/>
Aug 03 05:04:52 user nova-compute[72444]:     </memballoon>
Aug 03 05:04:52 user nova-compute[72444]:   </devices>
Aug 03 05:04:52 user nova-compute[72444]: </domain>
Aug 03 05:04:52 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 05:04:52 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:58:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1296432438',display_name='tempest-ServerActionsTestOtherB-server-1296432438',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1296432438',id=35,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJ2xwGpHSyejfRET9nle34ymsQ3JqEh+tuKb2KyDC9LlCqAQDSefnEuOykG9x3OwiAXCAIlmzscOwuKKHQpDe3RMRIrjD9v6y95AwIln0JKokDq03KE9SlxC2ULq7kCag==',key_name='tempest-keypair-1872408921',keypairs=<?>,launch_index=0,launched_at=2023-08-03T05:02:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3ac3f775464f48d88f05efdf3aeb4fb8',ramdisk_id='',reservation_id='r-0ygb2937',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1191335247',owner_user_name='tempest-ServerActionsTestOtherB-1191335247-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T05:04:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32aef58e87044e47b99cd37e300393aa',uuid=4f225dc2-3011-4c15-bb8e-1ebb079a3b50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "775b17bb-97a7-4a00-9368-198abafa4f8b", "address": "fa:16:3e:65:c2:ad", "network": {"id": "dd246ddd-6ffb-4516-b262-ef339c3f195c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2067592626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac3f775464f48d88f05efdf3aeb4fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b17bb-97", "ovs_interfaceid": "775b17bb-97a7-4a00-9368-198abafa4f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 05:04:52 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Converting VIF {"id": "775b17bb-97a7-4a00-9368-198abafa4f8b", "address": "fa:16:3e:65:c2:ad", "network": {"id": "dd246ddd-6ffb-4516-b262-ef339c3f195c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2067592626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac3f775464f48d88f05efdf3aeb4fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b17bb-97", "ovs_interfaceid": "775b17bb-97a7-4a00-9368-198abafa4f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:04:52 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:c2:ad,bridge_name='br-int',has_traffic_filtering=True,id=775b17bb-97a7-4a00-9368-198abafa4f8b,network=Network(dd246ddd-6ffb-4516-b262-ef339c3f195c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775b17bb-97') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:04:52 user nova-compute[72444]: DEBUG os_vif [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:c2:ad,bridge_name='br-int',has_traffic_filtering=True,id=775b17bb-97a7-4a00-9368-198abafa4f8b,network=Network(dd246ddd-6ffb-4516-b262-ef339c3f195c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775b17bb-97') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 05:04:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:04:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:04:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 05:04:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:04:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap775b17bb-97, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:04:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap775b17bb-97, col_values=(('external_ids', {'iface-id': '775b17bb-97a7-4a00-9368-198abafa4f8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:c2:ad', 'vm-uuid': '4f225dc2-3011-4c15-bb8e-1ebb079a3b50'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:04:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:04:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:04:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:04:52 user nova-compute[72444]: INFO os_vif [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:c2:ad,bridge_name='br-int',has_traffic_filtering=True,id=775b17bb-97a7-4a00-9368-198abafa4f8b,network=Network(dd246ddd-6ffb-4516-b262-ef339c3f195c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775b17bb-97')
Aug 03 05:04:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:04:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:04:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:04:54 user nova-compute[72444]: DEBUG nova.compute.manager [req-f0093580-d10f-48f4-9079-e578cde26692 req-b84cde9b-9b77-41f1-8f4c-18d5334efe35 service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Received event network-vif-plugged-775b17bb-97a7-4a00-9368-198abafa4f8b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:04:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f0093580-d10f-48f4-9079-e578cde26692 req-b84cde9b-9b77-41f1-8f4c-18d5334efe35 service nova] Acquiring lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:04:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f0093580-d10f-48f4-9079-e578cde26692 req-b84cde9b-9b77-41f1-8f4c-18d5334efe35 service nova] Lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:04:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f0093580-d10f-48f4-9079-e578cde26692 req-b84cde9b-9b77-41f1-8f4c-18d5334efe35 service nova] Lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:04:54 user nova-compute[72444]: DEBUG nova.compute.manager [req-f0093580-d10f-48f4-9079-e578cde26692 req-b84cde9b-9b77-41f1-8f4c-18d5334efe35 service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] No waiting events found dispatching network-vif-plugged-775b17bb-97a7-4a00-9368-198abafa4f8b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:04:54 user nova-compute[72444]: WARNING nova.compute.manager [req-f0093580-d10f-48f4-9079-e578cde26692 req-b84cde9b-9b77-41f1-8f4c-18d5334efe35 service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Received unexpected event network-vif-plugged-775b17bb-97a7-4a00-9368-198abafa4f8b for instance with vm_state resized and task_state resize_reverting.
Aug 03 05:04:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:04:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:04:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:04:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:04:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:04:55 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:04:55 user nova-compute[72444]: INFO nova.compute.manager [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Unshelving
Aug 03 05:04:55 user nova-compute[72444]: INFO nova.virt.block_device [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Booting with volume 728b2fc5-c145-4a19-ab00-e145e8c63ce9 at /dev/vdc
Aug 03 05:04:55 user nova-compute[72444]: DEBUG os_brick.utils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:04:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:55 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d0667f-0761-4423-b661-1a3c2eba079e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:55 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:56 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d19a2bc-0939-4dfc-8007-21be18d05b82]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:04:56 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b414b636-ef39-498b-b82f-2786bc39913b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:56 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[89332f63-f454-4bdb-8314-3917d8ff7800]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:04:56 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691039096.0404117, 4f225dc2-3011-4c15-bb8e-1ebb079a3b50 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:04:56 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] VM Resumed (Lifecycle Event)
Aug 03 05:04:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 05:04:56 user nova-compute[72444]: DEBUG nova.compute.manager [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 05:04:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:04:56 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Instance running successfully.
Aug 03 05:04:56 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] finish_revert_migration finished successfully. {{(pid=72444) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 03 05:04:56 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:04:56 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 05:04:56 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fd1bbc-c95b-435a-bade-1233be00bc61]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:04:56 user nova-compute[72444]: DEBUG nova.compute.manager [req-d3b63885-1272-4238-b828-e133c6d57b32 req-906f0e12-96aa-4247-8f08-f6333a0e893d service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Received event network-vif-plugged-775b17bb-97a7-4a00-9368-198abafa4f8b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:04:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d3b63885-1272-4238-b828-e133c6d57b32 req-906f0e12-96aa-4247-8f08-f6333a0e893d service nova] Acquiring lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:04:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d3b63885-1272-4238-b828-e133c6d57b32 req-906f0e12-96aa-4247-8f08-f6333a0e893d service nova] Lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:04:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d3b63885-1272-4238-b828-e133c6d57b32 req-906f0e12-96aa-4247-8f08-f6333a0e893d service nova] Lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:04:56 user nova-compute[72444]: DEBUG nova.compute.manager [req-d3b63885-1272-4238-b828-e133c6d57b32 req-906f0e12-96aa-4247-8f08-f6333a0e893d service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] No waiting events found dispatching network-vif-plugged-775b17bb-97a7-4a00-9368-198abafa4f8b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:04:56 user nova-compute[72444]: WARNING nova.compute.manager [req-d3b63885-1272-4238-b828-e133c6d57b32 req-906f0e12-96aa-4247-8f08-f6333a0e893d service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Received unexpected event network-vif-plugged-775b17bb-97a7-4a00-9368-198abafa4f8b for instance with vm_state resized and task_state resize_reverting.
Aug 03 05:04:56 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:04:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 05:04:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 05:04:56 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 05:04:56 user nova-compute[72444]: DEBUG os_brick.utils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:04:56 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Updating existing volume attachment record: 2da4f94b-0947-4886-bd35-2bf17527ef35 {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 05:04:56 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:04:56 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 03 05:04:56 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691039096.0419037, 4f225dc2-3011-4c15-bb8e-1ebb079a3b50 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:04:56 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] VM Started (Lifecycle Event)
Aug 03 05:04:56 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:04:56 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:04:56 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 03 05:04:56 user nova-compute[72444]: INFO nova.compute.manager [None req-0206217b-07c9-425b-bff7-9ddbe1886aa5 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Updating instance to original state: 'active'
Aug 03 05:04:57 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:04:57 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:04:57 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:04:59 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:04:59 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 05:05:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:02 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:02 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:05:02 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:05:02 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Rebuilding the list of instances to heal {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 05:05:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-4f225dc2-3011-4c15-bb8e-1ebb079a3b50" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:05:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-4f225dc2-3011-4c15-bb8e-1ebb079a3b50" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:05:03 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 05:05:03 user nova-compute[72444]: DEBUG nova.objects.instance [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lazy-loading 'info_cache' on Instance uuid 4f225dc2-3011-4c15-bb8e-1ebb079a3b50 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:05:03 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Updating instance_info_cache with network_info: [{"id": "775b17bb-97a7-4a00-9368-198abafa4f8b", "address": "fa:16:3e:65:c2:ad", "network": {"id": "dd246ddd-6ffb-4516-b262-ef339c3f195c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2067592626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac3f775464f48d88f05efdf3aeb4fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b17bb-97", "ovs_interfaceid": "775b17bb-97a7-4a00-9368-198abafa4f8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:05:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-4f225dc2-3011-4c15-bb8e-1ebb079a3b50" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:05:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 05:05:03 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:05:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:05:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:05:03 user nova-compute[72444]: DEBUG nova.objects.instance [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lazy-loading 'pci_requests' on Instance uuid dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:05:03 user nova-compute[72444]: DEBUG nova.objects.instance [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lazy-loading 'numa_topology' on Instance uuid dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:05:03 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 05:05:03 user nova-compute[72444]: INFO nova.compute.claims [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Claim successful on node user
Aug 03 05:05:04 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:05:04 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:05:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.291s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:05:04 user nova-compute[72444]: INFO nova.network.neutron [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Updating port 06e85273-4218-48ad-b2d8-fa4a3875a57c with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 03 05:05:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "refresh_cache-dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:05:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquired lock "refresh_cache-dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:05:04 user nova-compute[72444]: DEBUG nova.network.neutron [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 05:05:05 user nova-compute[72444]: DEBUG nova.compute.manager [req-d4590995-ba07-4285-9c38-12beb230d67f req-28fba03d-cfe7-4354-85f3-1767142a7455 service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Received event network-changed-06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:05:05 user nova-compute[72444]: DEBUG nova.compute.manager [req-d4590995-ba07-4285-9c38-12beb230d67f req-28fba03d-cfe7-4354-85f3-1767142a7455 service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Refreshing instance network info cache due to event network-changed-06e85273-4218-48ad-b2d8-fa4a3875a57c. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:05:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d4590995-ba07-4285-9c38-12beb230d67f req-28fba03d-cfe7-4354-85f3-1767142a7455 service nova] Acquiring lock "refresh_cache-dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:05:05 user nova-compute[72444]: DEBUG nova.network.neutron [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Updating instance_info_cache with network_info: [{"id": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "address": "fa:16:3e:a4:56:cc", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e85273-42", "ovs_interfaceid": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:05:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Releasing lock "refresh_cache-dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:05:05 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 05:05:05 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Creating image(s)
Aug 03 05:05:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "/opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:05:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "/opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:05:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "/opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:05:05 user nova-compute[72444]: DEBUG nova.objects.instance [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lazy-loading 'trusted_certs' on Instance uuid dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:05:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d4590995-ba07-4285-9c38-12beb230d67f req-28fba03d-cfe7-4354-85f3-1767142a7455 service nova] Acquired lock "refresh_cache-dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:05:05 user nova-compute[72444]: DEBUG nova.network.neutron [req-d4590995-ba07-4285-9c38-12beb230d67f req-28fba03d-cfe7-4354-85f3-1767142a7455 service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Refreshing network info cache for port 06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:05:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "8fa9e0e0ea39b028e5ad74be808f9bc31b3cef4d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:05:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "8fa9e0e0ea39b028e5ad74be808f9bc31b3cef4d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:05:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8fa9e0e0ea39b028e5ad74be808f9bc31b3cef4d.part --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:05:06 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:05:06 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:05:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8fa9e0e0ea39b028e5ad74be808f9bc31b3cef4d.part --force-share --output=json" returned: 0 in 0.134s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:05:06 user nova-compute[72444]: DEBUG nova.virt.images [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] 41a0f80e-c0ba-49d5-b000-079aafba018b was qcow2, converting to raw {{(pid=72444) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 03 05:05:06 user nova-compute[72444]: DEBUG nova.privsep.utils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72444) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 03 05:05:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8fa9e0e0ea39b028e5ad74be808f9bc31b3cef4d.part /opt/stack/data/nova/instances/_base/8fa9e0e0ea39b028e5ad74be808f9bc31b3cef4d.converted {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG nova.network.neutron [req-d4590995-ba07-4285-9c38-12beb230d67f req-28fba03d-cfe7-4354-85f3-1767142a7455 service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Updated VIF entry in instance network info cache for port 06e85273-4218-48ad-b2d8-fa4a3875a57c. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG nova.network.neutron [req-d4590995-ba07-4285-9c38-12beb230d67f req-28fba03d-cfe7-4354-85f3-1767142a7455 service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Updating instance_info_cache with network_info: [{"id": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "address": "fa:16:3e:a4:56:cc", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e85273-42", "ovs_interfaceid": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d4590995-ba07-4285-9c38-12beb230d67f req-28fba03d-cfe7-4354-85f3-1767142a7455 service nova] Releasing lock "refresh_cache-dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8fa9e0e0ea39b028e5ad74be808f9bc31b3cef4d.part /opt/stack/data/nova/instances/_base/8fa9e0e0ea39b028e5ad74be808f9bc31b3cef4d.converted" returned: 0 in 0.692s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8fa9e0e0ea39b028e5ad74be808f9bc31b3cef4d.converted --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8fa9e0e0ea39b028e5ad74be808f9bc31b3cef4d.converted --force-share --output=json" returned: 0 in 0.133s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "8fa9e0e0ea39b028e5ad74be808f9bc31b3cef4d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.096s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8fa9e0e0ea39b028e5ad74be808f9bc31b3cef4d --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ajuVNogF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:05:07 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:05:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:05:07 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:05:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:05:07 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 05:05:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8fa9e0e0ea39b028e5ad74be808f9bc31b3cef4d --force-share --output=json" returned: 0 in 0.147s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "8fa9e0e0ea39b028e5ad74be808f9bc31b3cef4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "8fa9e0e0ea39b028e5ad74be808f9bc31b3cef4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8fa9e0e0ea39b028e5ad74be808f9bc31b3cef4d --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3787c666-3db0-43ff-ac54-c3b0ad4c906c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 05:05:07 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a721b99-db7f-43cc-bc75-cff830dcb714]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a] added
Aug 03 05:05:07 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af09e1c-83eb-4792-a8de-5eb08dfc21ed]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[039ff26c-0339-46f0-adf3-7b82c16e2013]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ajuVNogF {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ajuVNogF" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cd194f-572b-4caa-9d35-1543cbc24c18]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ajuVNogF'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8fa9e0e0ea39b028e5ad74be808f9bc31b3cef4d --force-share --output=json" returned: 0 in 0.136s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8fa9e0e0ea39b028e5ad74be808f9bc31b3cef4d,backing_fmt=raw /opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa7eb12-2972-4c73-9e8b-cd7db199d1a6]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8fa9e0e0ea39b028e5ad74be808f9bc31b3cef4d,backing_fmt=raw /opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/disk 1073741824" returned: 0 in 0.057s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "8fa9e0e0ea39b028e5ad74be808f9bc31b3cef4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8fa9e0e0ea39b028e5ad74be808f9bc31b3cef4d --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5871e510-80c3-4790-abde-8d6f442a1d02]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)
Aug 03 05:05:07 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)
Aug 03 05:05:07 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:05:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:05:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:05:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:05:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:05:08 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:05:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:05:08 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[867e27f4-74f7-4cac-8037-8b4a75cab1fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:05:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a, portal: 172.16.0.220,3260]
Aug 03 05:05:08 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a, portal: 172.16.0.220,3260] successful.
Aug 03 05:05:08 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:05:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:05:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:05:08 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[498872cb-7f65-49c5-8552-9a10fc3af06a]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:05:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:05:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:05:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:05:08 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3f1134-7571-4623-8fb2-64b4045b74ed]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:05:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)
Aug 03 05:05:08 user nova-compute[72444]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a (non-flash)
Aug 03 05:05:08 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:05:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)
Aug 03 05:05:08 user nova-compute[72444]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a (non-flash)
Aug 03 05:05:08 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:05:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.419s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:05:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 05:05:08 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 05:05:08 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 05:05:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:05:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8fa9e0e0ea39b028e5ad74be808f9bc31b3cef4d --force-share --output=json" returned: 0 in 0.224s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:05:08 user nova-compute[72444]: DEBUG nova.objects.instance [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lazy-loading 'migration_context' on Instance uuid dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:05:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:05:08 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35291c7-863e-4720-8783-1b278c6f5191]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:05:08 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 05:05:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ajuVNogF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 05:05:08 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Rebasing disk image.
Aug 03 05:05:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:05:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10deaa3-d425-40b6-9b3f-d953164eadb8/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:05:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.190s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:05:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e -F raw /opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/disk {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:05:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10deaa3-d425-40b6-9b3f-d953164eadb8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:05:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10deaa3-d425-40b6-9b3f-d953164eadb8/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:05:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10deaa3-d425-40b6-9b3f-d953164eadb8/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:05:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f34c9b-a064-4de8-b278-4455be0b513a/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:05:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f34c9b-a064-4de8-b278-4455be0b513a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:05:08 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f34c9b-a064-4de8-b278-4455be0b513a/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:05:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f34c9b-a064-4de8-b278-4455be0b513a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:05:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:05:09 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.464s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:05:09 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] <== connect_volume: return (1468ms) {'type': 'block', 'scsi_wwn': '23465303663303330', 'path': '/dev/sdc'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:05:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465303663303330', 'path': '/dev/sdc'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 05:05:09 user nova-compute[72444]: DEBUG nova.objects.instance [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lazy-loading 'flavor' on Instance uuid 53f34c9b-a064-4de8-b278-4455be0b513a {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:05:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:05:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:05:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 05:05:09 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:05:09 user nova-compute[72444]:   <source dev="/dev/sdc"/>
Aug 03 05:05:09 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 05:05:09 user nova-compute[72444]:   <serial>eb2795ec-187c-4dea-a784-f4728300b46a</serial>
Aug 03 05:05:09 user nova-compute[72444]: </disk>
Aug 03 05:05:09 user nova-compute[72444]:  {{(pid=72444) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 05:05:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:05:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 05:05:10 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:05:10 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:05:10 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=8277MB free_disk=25.28626251220703GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:05:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:05:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:05:10 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:05:10 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:05:10 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] No VIF found with MAC fa:16:3e:49:df:1f, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 05:05:10 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance c10deaa3-d425-40b6-9b3f-d953164eadb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:05:10 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 4f225dc2-3011-4c15-bb8e-1ebb079a3b50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:05:10 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 53f34c9b-a064-4de8-b278-4455be0b513a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:05:10 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (b624a913-bb6b-4a17-8cd7-7b0950cff161): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Aug 03 05:05:10 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:05:10 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:05:10 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:05:10 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:05:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b5a4b664-aa5e-4eb9-81cb-db4d9981794b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "53f34c9b-a064-4de8-b278-4455be0b513a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.637s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:05:10 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:05:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.432s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:05:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e -F raw /opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/disk" returned: 0 in 2.684s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Ensure instance console log exists: /opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Start _get_guest_xml network_info=[{"id": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "address": "fa:16:3e:a4:56:cc", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e85273-42", "ovs_interfaceid": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='ecebe564a9d678bade2714812a4b6487',container_format='bare',created_at=2023-08-03T05:03:03Z,direct_url=<?>,disk_format='qcow2',id=41a0f80e-c0ba-49d5-b000-079aafba018b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1501682490-shelved',owner='ccf62b9ebb5f487184e3b84bbe7e73ad',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-03T05:03:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tsGMTQVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8', 'attached_at': '', 'detached_at': '', 'volume_id': '728b2fc5-c145-4a19-ab00-e145e8c63ce9', 'serial': '728b2fc5-c145-4a19-ab00-e145e8c63ce9'}, 'disk_bus': 'virtio', 'attachment_id': '2da4f94b-0947-4886-bd35-2bf17527ef35', 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 05:05:11 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:05:11 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:05:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='ecebe564a9d678bade2714812a4b6487',container_format='bare',created_at=2023-08-03T05:03:03Z,direct_url=<?>,disk_format='qcow2',id=41a0f80e-c0ba-49d5-b000-079aafba018b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1501682490-shelved',owner='ccf62b9ebb5f487184e3b84bbe7e73ad',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-03T05:03:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG nova.objects.instance [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lazy-loading 'vcpu_model' on Instance uuid dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tsGMTQVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:05:11 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:05:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:05:11 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:05:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.135s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:05:11 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 05:05:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[46720655-3642-47e0-86a7-adfde1b9e729]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 05:05:11 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b5a131-dc1e-487a-ac7d-a29c262f7c63]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9] added
Aug 03 05:05:11 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8ca379-9108-4b25-9bb9-5f066e089de1]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b052061b-c05d-4350-8964-ea60d7e469b9]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tsGMTQVa {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tsGMTQVa" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a2a045-3cc9-4b67-a990-3a7ee01d2d58]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tsGMTQVa'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf309726-49d7-49e2-9da9-2ee672756aaa]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a374f60-a65c-401e-9c55-906e0a07a7cd]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)
Aug 03 05:05:11 user nova-compute[72444]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a (non-flash)
Aug 03 05:05:11 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)
Aug 03 05:05:11 user nova-compute[72444]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a (non-flash)
Aug 03 05:05:11 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9 -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2a2c13-a280-4517-b9fe-3254805d1829]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9, portal: 172.16.0.220,3260]
Aug 03 05:05:11 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9, portal: 172.16.0.220,3260] successful.
Aug 03 05:05:11 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a4779d-8216-49fd-9ee1-86c596b27c5e]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e7912f-60fc-4c9f-bdfb-1d3b1f500546]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)
Aug 03 05:05:11 user nova-compute[72444]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a (non-flash)
Aug 03 05:05:11 user nova-compute[72444]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9 (non-flash)
Aug 03 05:05:11 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)
Aug 03 05:05:11 user nova-compute[72444]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a (non-flash)
Aug 03 05:05:11 user nova-compute[72444]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9 (non-flash)
Aug 03 05:05:11 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] HCTL ('35', '-', '-', 0) found on session 48 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8215915e-24f7-4cc3-a2e7-daea5bbc4171]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 05:05:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tsGMTQVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 05:05:12 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.489s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:05:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] <== connect_volume: return (1491ms) {'type': 'block', 'scsi_wwn': '23662313231336531', 'path': '/dev/sdd'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:05:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662313231336531', 'path': '/dev/sdd'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 05:05:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-03T05:01:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1501682490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1501682490',id=37,image_ref='41a0f80e-c0ba-49d5-b000-079aafba018b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2139993245',keypairs=<?>,launch_index=0,launched_at=2023-08-03T05:01:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ccf62b9ebb5f487184e3b84bbe7e73ad',ramdisk_id='',reservation_id='r-0f6l9ob9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-941210092',owner_user_name='tempest-AttachVolumeShelveTestJSON-941210092-project-member',shelved_at='2023-08-03T05:03:08.449413',shelved_host='user',shelved_image_id='41a0f80e-c0ba-49d5-b000-079aafba018b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:04:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bff27e3d2ae04049b35afe1bfcc7352b',uuid=dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "address": "fa:16:3e:a4:56:cc", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e85273-42", "ovs_interfaceid": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 05:05:12 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Converting VIF {"id": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "address": "fa:16:3e:a4:56:cc", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e85273-42", "ovs_interfaceid": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:05:12 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:56:cc,bridge_name='br-int',has_traffic_filtering=True,id=06e85273-4218-48ad-b2d8-fa4a3875a57c,network=Network(3e3f34b4-1878-4a24-b0b2-ab0472fb62d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06e85273-42') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:05:12 user nova-compute[72444]: DEBUG nova.objects.instance [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lazy-loading 'pci_devices' on Instance uuid dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:05:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] End _get_guest_xml xml=<domain type="kvm">
Aug 03 05:05:12 user nova-compute[72444]:   <uuid>dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8</uuid>
Aug 03 05:05:12 user nova-compute[72444]:   <name>instance-00000025</name>
Aug 03 05:05:12 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 05:05:12 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 05:05:12 user nova-compute[72444]:   <metadata>
Aug 03 05:05:12 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 05:05:12 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 05:05:12 user nova-compute[72444]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1501682490</nova:name>
Aug 03 05:05:12 user nova-compute[72444]:       <nova:creationTime>2023-08-03 05:05:11</nova:creationTime>
Aug 03 05:05:12 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 05:05:12 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 05:05:12 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 05:05:12 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 05:05:12 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 05:05:12 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 05:05:12 user nova-compute[72444]:       </nova:flavor>
Aug 03 05:05:12 user nova-compute[72444]:       <nova:owner>
Aug 03 05:05:12 user nova-compute[72444]:         <nova:user uuid="bff27e3d2ae04049b35afe1bfcc7352b">tempest-AttachVolumeShelveTestJSON-941210092-project-member</nova:user>
Aug 03 05:05:12 user nova-compute[72444]:         <nova:project uuid="ccf62b9ebb5f487184e3b84bbe7e73ad">tempest-AttachVolumeShelveTestJSON-941210092</nova:project>
Aug 03 05:05:12 user nova-compute[72444]:       </nova:owner>
Aug 03 05:05:12 user nova-compute[72444]:       <nova:root type="image" uuid="41a0f80e-c0ba-49d5-b000-079aafba018b"/>
Aug 03 05:05:12 user nova-compute[72444]:       <nova:ports>
Aug 03 05:05:12 user nova-compute[72444]:         <nova:port uuid="06e85273-4218-48ad-b2d8-fa4a3875a57c">
Aug 03 05:05:12 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 03 05:05:12 user nova-compute[72444]:         </nova:port>
Aug 03 05:05:12 user nova-compute[72444]:       </nova:ports>
Aug 03 05:05:12 user nova-compute[72444]:     </nova:instance>
Aug 03 05:05:12 user nova-compute[72444]:   </metadata>
Aug 03 05:05:12 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 05:05:12 user nova-compute[72444]:     <system>
Aug 03 05:05:12 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 05:05:12 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 05:05:12 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 05:05:12 user nova-compute[72444]:       <entry name="serial">dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8</entry>
Aug 03 05:05:12 user nova-compute[72444]:       <entry name="uuid">dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8</entry>
Aug 03 05:05:12 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 05:05:12 user nova-compute[72444]:     </system>
Aug 03 05:05:12 user nova-compute[72444]:   </sysinfo>
Aug 03 05:05:12 user nova-compute[72444]:   <os>
Aug 03 05:05:12 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 05:05:12 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 05:05:12 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 05:05:12 user nova-compute[72444]:   </os>
Aug 03 05:05:12 user nova-compute[72444]:   <features>
Aug 03 05:05:12 user nova-compute[72444]:     <acpi/>
Aug 03 05:05:12 user nova-compute[72444]:     <apic/>
Aug 03 05:05:12 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 05:05:12 user nova-compute[72444]:   </features>
Aug 03 05:05:12 user nova-compute[72444]:   <clock offset="utc">
Aug 03 05:05:12 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 05:05:12 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 05:05:12 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 05:05:12 user nova-compute[72444]:   </clock>
Aug 03 05:05:12 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 05:05:12 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 05:05:12 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 05:05:12 user nova-compute[72444]:   </cpu>
Aug 03 05:05:12 user nova-compute[72444]:   <devices>
Aug 03 05:05:12 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 05:05:12 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 05:05:12 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/disk"/>
Aug 03 05:05:12 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 05:05:12 user nova-compute[72444]:     </disk>
Aug 03 05:05:12 user nova-compute[72444]:     <disk type="block" device="disk">
Aug 03 05:05:12 user nova-compute[72444]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:05:12 user nova-compute[72444]:       <source dev="/dev/sdd"/>
Aug 03 05:05:12 user nova-compute[72444]:       <target dev="vdc" bus="virtio"/>
Aug 03 05:05:12 user nova-compute[72444]:       <serial>728b2fc5-c145-4a19-ab00-e145e8c63ce9</serial>
Aug 03 05:05:12 user nova-compute[72444]:     </disk>
Aug 03 05:05:12 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 05:05:12 user nova-compute[72444]:       <mac address="fa:16:3e:a4:56:cc"/>
Aug 03 05:05:12 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:05:12 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 05:05:12 user nova-compute[72444]:       <target dev="tap06e85273-42"/>
Aug 03 05:05:12 user nova-compute[72444]:     </interface>
Aug 03 05:05:12 user nova-compute[72444]:     <serial type="pty">
Aug 03 05:05:12 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/console.log" append="off"/>
Aug 03 05:05:12 user nova-compute[72444]:     </serial>
Aug 03 05:05:12 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 05:05:12 user nova-compute[72444]:     <video>
Aug 03 05:05:12 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:05:12 user nova-compute[72444]:     </video>
Aug 03 05:05:12 user nova-compute[72444]:     <rng model="virtio">
Aug 03 05:05:12 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 05:05:12 user nova-compute[72444]:     </rng>
Aug 03 05:05:12 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 05:05:12 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 05:05:12 user nova-compute[72444]:       <stats period="10"/>
Aug 03 05:05:12 user nova-compute[72444]:     </memballoon>
Aug 03 05:05:12 user nova-compute[72444]:   </devices>
Aug 03 05:05:12 user nova-compute[72444]: </domain>
Aug 03 05:05:12 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 05:05:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-03T05:01:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1501682490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1501682490',id=37,image_ref='41a0f80e-c0ba-49d5-b000-079aafba018b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2139993245',keypairs=<?>,launch_index=0,launched_at=2023-08-03T05:01:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ccf62b9ebb5f487184e3b84bbe7e73ad',ramdisk_id='',reservation_id='r-0f6l9ob9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-941210092',owner_user_name='tempest-AttachVolumeShelveTestJSON-941210092-project-member',shelved_at='2023-08-03T05:03:08.449413',shelved_host='user',shelved_image_id='41a0f80e-c0ba-49d5-b000-079aafba018b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:04:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bff27e3d2ae04049b35afe1bfcc7352b',uuid=dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "address": "fa:16:3e:a4:56:cc", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e85273-42", "ovs_interfaceid": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 05:05:12 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Converting VIF {"id": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "address": "fa:16:3e:a4:56:cc", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e85273-42", "ovs_interfaceid": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:05:12 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:56:cc,bridge_name='br-int',has_traffic_filtering=True,id=06e85273-4218-48ad-b2d8-fa4a3875a57c,network=Network(3e3f34b4-1878-4a24-b0b2-ab0472fb62d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06e85273-42') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:05:12 user nova-compute[72444]: DEBUG os_vif [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:56:cc,bridge_name='br-int',has_traffic_filtering=True,id=06e85273-4218-48ad-b2d8-fa4a3875a57c,network=Network(3e3f34b4-1878-4a24-b0b2-ab0472fb62d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06e85273-42') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 05:05:12 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:12 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:05:12 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 05:05:12 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:12 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06e85273-42, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:05:12 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap06e85273-42, col_values=(('external_ids', {'iface-id': '06e85273-4218-48ad-b2d8-fa4a3875a57c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:56:cc', 'vm-uuid': 'dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:05:12 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:12 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:05:12 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:12 user nova-compute[72444]: INFO os_vif [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:56:cc,bridge_name='br-int',has_traffic_filtering=True,id=06e85273-4218-48ad-b2d8-fa4a3875a57c,network=Network(3e3f34b4-1878-4a24-b0b2-ab0472fb62d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06e85273-42')
Aug 03 05:05:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:05:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:05:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] No VIF found with MAC fa:16:3e:a4:56:cc, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 05:05:13 user nova-compute[72444]: DEBUG nova.compute.manager [req-b2d2e738-c8eb-4c45-a2df-65aedf1e8ee5 req-c2d08caf-12c0-4b43-82a0-2a4b004e7a1d service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Received event network-changed-70d97df3-9ab0-4619-83ed-bef86a0bfc6b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:05:13 user nova-compute[72444]: DEBUG nova.compute.manager [req-b2d2e738-c8eb-4c45-a2df-65aedf1e8ee5 req-c2d08caf-12c0-4b43-82a0-2a4b004e7a1d service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Refreshing instance network info cache due to event network-changed-70d97df3-9ab0-4619-83ed-bef86a0bfc6b. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:05:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b2d2e738-c8eb-4c45-a2df-65aedf1e8ee5 req-c2d08caf-12c0-4b43-82a0-2a4b004e7a1d service nova] Acquiring lock "refresh_cache-53f34c9b-a064-4de8-b278-4455be0b513a" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:05:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b2d2e738-c8eb-4c45-a2df-65aedf1e8ee5 req-c2d08caf-12c0-4b43-82a0-2a4b004e7a1d service nova] Acquired lock "refresh_cache-53f34c9b-a064-4de8-b278-4455be0b513a" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:05:13 user nova-compute[72444]: DEBUG nova.network.neutron [req-b2d2e738-c8eb-4c45-a2df-65aedf1e8ee5 req-c2d08caf-12c0-4b43-82a0-2a4b004e7a1d service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Refreshing network info cache for port 70d97df3-9ab0-4619-83ed-bef86a0bfc6b {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:05:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:14 user nova-compute[72444]: DEBUG nova.compute.manager [req-d3f7d1d2-684e-45f6-af33-bc5c00bcf3cb req-6d2d7672-8447-4d93-adc2-f9afde49dade service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Received event network-vif-plugged-06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:05:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d3f7d1d2-684e-45f6-af33-bc5c00bcf3cb req-6d2d7672-8447-4d93-adc2-f9afde49dade service nova] Acquiring lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:05:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d3f7d1d2-684e-45f6-af33-bc5c00bcf3cb req-6d2d7672-8447-4d93-adc2-f9afde49dade service nova] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:05:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d3f7d1d2-684e-45f6-af33-bc5c00bcf3cb req-6d2d7672-8447-4d93-adc2-f9afde49dade service nova] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:05:14 user nova-compute[72444]: DEBUG nova.compute.manager [req-d3f7d1d2-684e-45f6-af33-bc5c00bcf3cb req-6d2d7672-8447-4d93-adc2-f9afde49dade service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] No waiting events found dispatching network-vif-plugged-06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:05:14 user nova-compute[72444]: WARNING nova.compute.manager [req-d3f7d1d2-684e-45f6-af33-bc5c00bcf3cb req-6d2d7672-8447-4d93-adc2-f9afde49dade service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Received unexpected event network-vif-plugged-06e85273-4218-48ad-b2d8-fa4a3875a57c for instance with vm_state shelved_offloaded and task_state spawning.
Aug 03 05:05:14 user nova-compute[72444]: DEBUG nova.network.neutron [req-b2d2e738-c8eb-4c45-a2df-65aedf1e8ee5 req-c2d08caf-12c0-4b43-82a0-2a4b004e7a1d service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Updated VIF entry in instance network info cache for port 70d97df3-9ab0-4619-83ed-bef86a0bfc6b. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:05:14 user nova-compute[72444]: DEBUG nova.network.neutron [req-b2d2e738-c8eb-4c45-a2df-65aedf1e8ee5 req-c2d08caf-12c0-4b43-82a0-2a4b004e7a1d service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Updating instance_info_cache with network_info: [{"id": "70d97df3-9ab0-4619-83ed-bef86a0bfc6b", "address": "fa:16:3e:49:df:1f", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d97df3-9a", "ovs_interfaceid": "70d97df3-9ab0-4619-83ed-bef86a0bfc6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:05:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b2d2e738-c8eb-4c45-a2df-65aedf1e8ee5 req-c2d08caf-12c0-4b43-82a0-2a4b004e7a1d service nova] Releasing lock "refresh_cache-53f34c9b-a064-4de8-b278-4455be0b513a" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:05:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:16 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691039116.4895108, dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:05:16 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] VM Resumed (Lifecycle Event)
Aug 03 05:05:16 user nova-compute[72444]: DEBUG nova.compute.manager [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 05:05:16 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 05:05:16 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Instance spawned successfully.
Aug 03 05:05:16 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:05:16 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:05:16 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 05:05:16 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691039116.4908335, dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:05:16 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] VM Started (Lifecycle Event)
Aug 03 05:05:16 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:05:16 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:05:16 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 05:05:16 user nova-compute[72444]: DEBUG nova.compute.manager [req-1fc3b15c-3953-424a-8579-775a90ede898 req-799fa136-0f69-4a61-88cb-16a769b5f36a service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Received event network-vif-plugged-06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:05:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-1fc3b15c-3953-424a-8579-775a90ede898 req-799fa136-0f69-4a61-88cb-16a769b5f36a service nova] Acquiring lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:05:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-1fc3b15c-3953-424a-8579-775a90ede898 req-799fa136-0f69-4a61-88cb-16a769b5f36a service nova] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:05:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-1fc3b15c-3953-424a-8579-775a90ede898 req-799fa136-0f69-4a61-88cb-16a769b5f36a service nova] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:05:16 user nova-compute[72444]: DEBUG nova.compute.manager [req-1fc3b15c-3953-424a-8579-775a90ede898 req-799fa136-0f69-4a61-88cb-16a769b5f36a service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] No waiting events found dispatching network-vif-plugged-06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:05:16 user nova-compute[72444]: WARNING nova.compute.manager [req-1fc3b15c-3953-424a-8579-775a90ede898 req-799fa136-0f69-4a61-88cb-16a769b5f36a service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Received unexpected event network-vif-plugged-06e85273-4218-48ad-b2d8-fa4a3875a57c for instance with vm_state shelved_offloaded and task_state spawning.
Aug 03 05:05:16 user nova-compute[72444]: DEBUG nova.compute.manager [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:05:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f8267b5b-8cda-4a6f-9109-ba1a1f9c6238 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 21.088s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:05:16 user nova-compute[72444]: DEBUG nova.compute.manager [req-90e4e7ae-a63e-493e-b589-56f1621b38b4 req-282d3ba9-baba-4618-a9c5-5a10aa1be87c service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Received event network-changed-70d97df3-9ab0-4619-83ed-bef86a0bfc6b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:05:16 user nova-compute[72444]: DEBUG nova.compute.manager [req-90e4e7ae-a63e-493e-b589-56f1621b38b4 req-282d3ba9-baba-4618-a9c5-5a10aa1be87c service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Refreshing instance network info cache due to event network-changed-70d97df3-9ab0-4619-83ed-bef86a0bfc6b. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:05:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-90e4e7ae-a63e-493e-b589-56f1621b38b4 req-282d3ba9-baba-4618-a9c5-5a10aa1be87c service nova] Acquiring lock "refresh_cache-53f34c9b-a064-4de8-b278-4455be0b513a" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:05:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-90e4e7ae-a63e-493e-b589-56f1621b38b4 req-282d3ba9-baba-4618-a9c5-5a10aa1be87c service nova] Acquired lock "refresh_cache-53f34c9b-a064-4de8-b278-4455be0b513a" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:05:16 user nova-compute[72444]: DEBUG nova.network.neutron [req-90e4e7ae-a63e-493e-b589-56f1621b38b4 req-282d3ba9-baba-4618-a9c5-5a10aa1be87c service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Refreshing network info cache for port 70d97df3-9ab0-4619-83ed-bef86a0bfc6b {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:05:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-db96fa1f-6e34-4aae-a280-8ed8d95bd781 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquiring lock "53f34c9b-a064-4de8-b278-4455be0b513a" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:05:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-db96fa1f-6e34-4aae-a280-8ed8d95bd781 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "53f34c9b-a064-4de8-b278-4455be0b513a" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:05:17 user nova-compute[72444]: INFO nova.compute.manager [None req-db96fa1f-6e34-4aae-a280-8ed8d95bd781 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Rebooting instance
Aug 03 05:05:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-db96fa1f-6e34-4aae-a280-8ed8d95bd781 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquiring lock "refresh_cache-53f34c9b-a064-4de8-b278-4455be0b513a" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:05:17 user nova-compute[72444]: DEBUG nova.network.neutron [req-90e4e7ae-a63e-493e-b589-56f1621b38b4 req-282d3ba9-baba-4618-a9c5-5a10aa1be87c service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Updated VIF entry in instance network info cache for port 70d97df3-9ab0-4619-83ed-bef86a0bfc6b. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:05:17 user nova-compute[72444]: DEBUG nova.network.neutron [req-90e4e7ae-a63e-493e-b589-56f1621b38b4 req-282d3ba9-baba-4618-a9c5-5a10aa1be87c service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Updating instance_info_cache with network_info: [{"id": "70d97df3-9ab0-4619-83ed-bef86a0bfc6b", "address": "fa:16:3e:49:df:1f", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d97df3-9a", "ovs_interfaceid": "70d97df3-9ab0-4619-83ed-bef86a0bfc6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:05:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-90e4e7ae-a63e-493e-b589-56f1621b38b4 req-282d3ba9-baba-4618-a9c5-5a10aa1be87c service nova] Releasing lock "refresh_cache-53f34c9b-a064-4de8-b278-4455be0b513a" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:05:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-db96fa1f-6e34-4aae-a280-8ed8d95bd781 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquired lock "refresh_cache-53f34c9b-a064-4de8-b278-4455be0b513a" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:05:17 user nova-compute[72444]: DEBUG nova.network.neutron [None req-db96fa1f-6e34-4aae-a280-8ed8d95bd781 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 05:05:17 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:18 user nova-compute[72444]: DEBUG nova.network.neutron [None req-db96fa1f-6e34-4aae-a280-8ed8d95bd781 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Updating instance_info_cache with network_info: [{"id": "70d97df3-9ab0-4619-83ed-bef86a0bfc6b", "address": "fa:16:3e:49:df:1f", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d97df3-9a", "ovs_interfaceid": "70d97df3-9ab0-4619-83ed-bef86a0bfc6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:05:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-db96fa1f-6e34-4aae-a280-8ed8d95bd781 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Releasing lock "refresh_cache-53f34c9b-a064-4de8-b278-4455be0b513a" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:05:18 user nova-compute[72444]: DEBUG nova.compute.manager [None req-db96fa1f-6e34-4aae-a280-8ed8d95bd781 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:05:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:20 user nova-compute[72444]: DEBUG nova.compute.manager [req-503b92ea-eaa2-4967-99ee-84d6ce8e0d7e req-7119e0e2-b04c-410f-81a3-d79316951528 service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Received event network-vif-unplugged-70d97df3-9ab0-4619-83ed-bef86a0bfc6b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:05:20 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-503b92ea-eaa2-4967-99ee-84d6ce8e0d7e req-7119e0e2-b04c-410f-81a3-d79316951528 service nova] Acquiring lock "53f34c9b-a064-4de8-b278-4455be0b513a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:05:20 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-503b92ea-eaa2-4967-99ee-84d6ce8e0d7e req-7119e0e2-b04c-410f-81a3-d79316951528 service nova] Lock "53f34c9b-a064-4de8-b278-4455be0b513a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:05:20 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-503b92ea-eaa2-4967-99ee-84d6ce8e0d7e req-7119e0e2-b04c-410f-81a3-d79316951528 service nova] Lock "53f34c9b-a064-4de8-b278-4455be0b513a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:05:20 user nova-compute[72444]: DEBUG nova.compute.manager [req-503b92ea-eaa2-4967-99ee-84d6ce8e0d7e req-7119e0e2-b04c-410f-81a3-d79316951528 service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] No waiting events found dispatching network-vif-unplugged-70d97df3-9ab0-4619-83ed-bef86a0bfc6b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:05:20 user nova-compute[72444]: WARNING nova.compute.manager [req-503b92ea-eaa2-4967-99ee-84d6ce8e0d7e req-7119e0e2-b04c-410f-81a3-d79316951528 service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Received unexpected event network-vif-unplugged-70d97df3-9ab0-4619-83ed-bef86a0bfc6b for instance with vm_state active and task_state reboot_started.
Aug 03 05:05:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:21 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-db96fa1f-6e34-4aae-a280-8ed8d95bd781 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Instance shutdown successfully.
Aug 03 05:05:22 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:22 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:22 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:22 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:22 user nova-compute[72444]: DEBUG nova.compute.manager [req-92150bb6-45f2-4a43-bd53-67bb8f8d655e req-9afd3344-2595-403d-8374-3afe984196d1 service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Received event network-vif-plugged-70d97df3-9ab0-4619-83ed-bef86a0bfc6b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:05:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-92150bb6-45f2-4a43-bd53-67bb8f8d655e req-9afd3344-2595-403d-8374-3afe984196d1 service nova] Acquiring lock "53f34c9b-a064-4de8-b278-4455be0b513a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:05:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-92150bb6-45f2-4a43-bd53-67bb8f8d655e req-9afd3344-2595-403d-8374-3afe984196d1 service nova] Lock "53f34c9b-a064-4de8-b278-4455be0b513a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:05:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-92150bb6-45f2-4a43-bd53-67bb8f8d655e req-9afd3344-2595-403d-8374-3afe984196d1 service nova] Lock "53f34c9b-a064-4de8-b278-4455be0b513a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:05:22 user nova-compute[72444]: DEBUG nova.compute.manager [req-92150bb6-45f2-4a43-bd53-67bb8f8d655e req-9afd3344-2595-403d-8374-3afe984196d1 service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] No waiting events found dispatching network-vif-plugged-70d97df3-9ab0-4619-83ed-bef86a0bfc6b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:05:22 user nova-compute[72444]: WARNING nova.compute.manager [req-92150bb6-45f2-4a43-bd53-67bb8f8d655e req-9afd3344-2595-403d-8374-3afe984196d1 service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Received unexpected event network-vif-plugged-70d97df3-9ab0-4619-83ed-bef86a0bfc6b for instance with vm_state active and task_state reboot_started.
Aug 03 05:05:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:24 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Removed pending event for 53f34c9b-a064-4de8-b278-4455be0b513a due to event {{(pid=72444) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 03 05:05:24 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691039124.8876321, 53f34c9b-a064-4de8-b278-4455be0b513a => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:05:24 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] VM Resumed (Lifecycle Event)
Aug 03 05:05:24 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Instance running successfully.
Aug 03 05:05:24 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-db96fa1f-6e34-4aae-a280-8ed8d95bd781 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Instance soft rebooted successfully.
Aug 03 05:05:24 user nova-compute[72444]: DEBUG nova.compute.manager [None req-db96fa1f-6e34-4aae-a280-8ed8d95bd781 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:05:24 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:05:24 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:05:24 user nova-compute[72444]: DEBUG nova.compute.manager [req-ca15db47-eddf-42bb-a102-8633e237a19e req-a0c2c05a-3558-4049-8065-8fab92d4d625 service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Received event network-vif-plugged-70d97df3-9ab0-4619-83ed-bef86a0bfc6b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:05:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ca15db47-eddf-42bb-a102-8633e237a19e req-a0c2c05a-3558-4049-8065-8fab92d4d625 service nova] Acquiring lock "53f34c9b-a064-4de8-b278-4455be0b513a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:05:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ca15db47-eddf-42bb-a102-8633e237a19e req-a0c2c05a-3558-4049-8065-8fab92d4d625 service nova] Lock "53f34c9b-a064-4de8-b278-4455be0b513a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:05:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ca15db47-eddf-42bb-a102-8633e237a19e req-a0c2c05a-3558-4049-8065-8fab92d4d625 service nova] Lock "53f34c9b-a064-4de8-b278-4455be0b513a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:05:24 user nova-compute[72444]: DEBUG nova.compute.manager [req-ca15db47-eddf-42bb-a102-8633e237a19e req-a0c2c05a-3558-4049-8065-8fab92d4d625 service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] No waiting events found dispatching network-vif-plugged-70d97df3-9ab0-4619-83ed-bef86a0bfc6b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:05:24 user nova-compute[72444]: WARNING nova.compute.manager [req-ca15db47-eddf-42bb-a102-8633e237a19e req-a0c2c05a-3558-4049-8065-8fab92d4d625 service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Received unexpected event network-vif-plugged-70d97df3-9ab0-4619-83ed-bef86a0bfc6b for instance with vm_state active and task_state reboot_started.
Aug 03 05:05:24 user nova-compute[72444]: DEBUG nova.compute.manager [req-ca15db47-eddf-42bb-a102-8633e237a19e req-a0c2c05a-3558-4049-8065-8fab92d4d625 service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Received event network-vif-plugged-70d97df3-9ab0-4619-83ed-bef86a0bfc6b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:05:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ca15db47-eddf-42bb-a102-8633e237a19e req-a0c2c05a-3558-4049-8065-8fab92d4d625 service nova] Acquiring lock "53f34c9b-a064-4de8-b278-4455be0b513a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:05:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ca15db47-eddf-42bb-a102-8633e237a19e req-a0c2c05a-3558-4049-8065-8fab92d4d625 service nova] Lock "53f34c9b-a064-4de8-b278-4455be0b513a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:05:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ca15db47-eddf-42bb-a102-8633e237a19e req-a0c2c05a-3558-4049-8065-8fab92d4d625 service nova] Lock "53f34c9b-a064-4de8-b278-4455be0b513a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:05:24 user nova-compute[72444]: DEBUG nova.compute.manager [req-ca15db47-eddf-42bb-a102-8633e237a19e req-a0c2c05a-3558-4049-8065-8fab92d4d625 service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] No waiting events found dispatching network-vif-plugged-70d97df3-9ab0-4619-83ed-bef86a0bfc6b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:05:24 user nova-compute[72444]: WARNING nova.compute.manager [req-ca15db47-eddf-42bb-a102-8633e237a19e req-a0c2c05a-3558-4049-8065-8fab92d4d625 service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Received unexpected event network-vif-plugged-70d97df3-9ab0-4619-83ed-bef86a0bfc6b for instance with vm_state active and task_state reboot_started.
Aug 03 05:05:24 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 03 05:05:24 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691039124.8941147, 53f34c9b-a064-4de8-b278-4455be0b513a => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:05:24 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] VM Started (Lifecycle Event)
Aug 03 05:05:24 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:05:24 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:05:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-db96fa1f-6e34-4aae-a280-8ed8d95bd781 tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "53f34c9b-a064-4de8-b278-4455be0b513a" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.570s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:05:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:32 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c5dcf22b-d921-4067-9f51-5e6bfd0782be tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Acquiring lock "c10deaa3-d425-40b6-9b3f-d953164eadb8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:05:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c5dcf22b-d921-4067-9f51-5e6bfd0782be tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Lock "c10deaa3-d425-40b6-9b3f-d953164eadb8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:05:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c5dcf22b-d921-4067-9f51-5e6bfd0782be tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Acquiring lock "c10deaa3-d425-40b6-9b3f-d953164eadb8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:05:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c5dcf22b-d921-4067-9f51-5e6bfd0782be tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Lock "c10deaa3-d425-40b6-9b3f-d953164eadb8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:05:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c5dcf22b-d921-4067-9f51-5e6bfd0782be tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Lock "c10deaa3-d425-40b6-9b3f-d953164eadb8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:05:38 user nova-compute[72444]: INFO nova.compute.manager [None req-c5dcf22b-d921-4067-9f51-5e6bfd0782be tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Terminating instance
Aug 03 05:05:38 user nova-compute[72444]: DEBUG nova.compute.manager [None req-c5dcf22b-d921-4067-9f51-5e6bfd0782be tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 05:05:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:38 user nova-compute[72444]: DEBUG nova.compute.manager [req-2a3abea0-4583-4ec9-a400-4ba3f2fd2e61 req-a81a2974-4419-4123-94e8-e0a6d60078fc service nova] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Received event network-vif-unplugged-ef8f695a-323f-430d-88ac-7e83cdfa8b51 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:05:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2a3abea0-4583-4ec9-a400-4ba3f2fd2e61 req-a81a2974-4419-4123-94e8-e0a6d60078fc service nova] Acquiring lock "c10deaa3-d425-40b6-9b3f-d953164eadb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:05:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2a3abea0-4583-4ec9-a400-4ba3f2fd2e61 req-a81a2974-4419-4123-94e8-e0a6d60078fc service nova] Lock "c10deaa3-d425-40b6-9b3f-d953164eadb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:05:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-2a3abea0-4583-4ec9-a400-4ba3f2fd2e61 req-a81a2974-4419-4123-94e8-e0a6d60078fc service nova] Lock "c10deaa3-d425-40b6-9b3f-d953164eadb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:05:38 user nova-compute[72444]: DEBUG nova.compute.manager [req-2a3abea0-4583-4ec9-a400-4ba3f2fd2e61 req-a81a2974-4419-4123-94e8-e0a6d60078fc service nova] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] No waiting events found dispatching network-vif-unplugged-ef8f695a-323f-430d-88ac-7e83cdfa8b51 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:05:38 user nova-compute[72444]: DEBUG nova.compute.manager [req-2a3abea0-4583-4ec9-a400-4ba3f2fd2e61 req-a81a2974-4419-4123-94e8-e0a6d60078fc service nova] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Received event network-vif-unplugged-ef8f695a-323f-430d-88ac-7e83cdfa8b51 for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 05:05:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:38 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Instance destroyed successfully.
Aug 03 05:05:38 user nova-compute[72444]: DEBUG nova.objects.instance [None req-c5dcf22b-d921-4067-9f51-5e6bfd0782be tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Lazy-loading 'resources' on Instance uuid c10deaa3-d425-40b6-9b3f-d953164eadb8 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:05:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-c5dcf22b-d921-4067-9f51-5e6bfd0782be tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:02:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1595956275',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1595956275',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1595956',id=38,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJbsDF0MXdl32wOVoQK8HYheqnX83O99URXb1PZazUvgEGsnjgWDY6ZSF9OnXr6b9cGbtHi26kb4s9OGSmPzl6RD/qGS9qJ4Q5HBieIaWJu3RKjh3TdxL+gXFs+xayZ+w==',key_name='tempest-keypair-1116077515',keypairs=<?>,launch_index=0,launched_at=2023-08-03T05:02:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd9faa4713af40faab9d6f37da3e9562',ramdisk_id='',reservation_id='r-2f904z42',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-685172074',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T05:02:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47e6135e606e4f59b712680b76dc4c35',uuid=c10deaa3-d425-40b6-9b3f-d953164eadb8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef8f695a-323f-430d-88ac-7e83cdfa8b51", "address": "fa:16:3e:29:7b:75", "network": {"id": "bc45559b-dcbf-41d7-82b5-72a479e25ae6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-620825918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd9faa4713af40faab9d6f37da3e9562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8f695a-32", "ovs_interfaceid": "ef8f695a-323f-430d-88ac-7e83cdfa8b51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 05:05:38 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-c5dcf22b-d921-4067-9f51-5e6bfd0782be tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Converting VIF {"id": "ef8f695a-323f-430d-88ac-7e83cdfa8b51", "address": "fa:16:3e:29:7b:75", "network": {"id": "bc45559b-dcbf-41d7-82b5-72a479e25ae6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-620825918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd9faa4713af40faab9d6f37da3e9562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8f695a-32", "ovs_interfaceid": "ef8f695a-323f-430d-88ac-7e83cdfa8b51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:05:38 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-c5dcf22b-d921-4067-9f51-5e6bfd0782be tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:7b:75,bridge_name='br-int',has_traffic_filtering=True,id=ef8f695a-323f-430d-88ac-7e83cdfa8b51,network=Network(bc45559b-dcbf-41d7-82b5-72a479e25ae6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8f695a-32') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:05:38 user nova-compute[72444]: DEBUG os_vif [None req-c5dcf22b-d921-4067-9f51-5e6bfd0782be tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:7b:75,bridge_name='br-int',has_traffic_filtering=True,id=ef8f695a-323f-430d-88ac-7e83cdfa8b51,network=Network(bc45559b-dcbf-41d7-82b5-72a479e25ae6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8f695a-32') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 05:05:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef8f695a-32, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:05:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:39 user nova-compute[72444]: INFO os_vif [None req-c5dcf22b-d921-4067-9f51-5e6bfd0782be tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:7b:75,bridge_name='br-int',has_traffic_filtering=True,id=ef8f695a-323f-430d-88ac-7e83cdfa8b51,network=Network(bc45559b-dcbf-41d7-82b5-72a479e25ae6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8f695a-32')
Aug 03 05:05:39 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-c5dcf22b-d921-4067-9f51-5e6bfd0782be tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Deleting instance files /opt/stack/data/nova/instances/c10deaa3-d425-40b6-9b3f-d953164eadb8_del
Aug 03 05:05:39 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-c5dcf22b-d921-4067-9f51-5e6bfd0782be tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Deletion of /opt/stack/data/nova/instances/c10deaa3-d425-40b6-9b3f-d953164eadb8_del complete
Aug 03 05:05:39 user nova-compute[72444]: INFO nova.compute.manager [None req-c5dcf22b-d921-4067-9f51-5e6bfd0782be tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 03 05:05:39 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-c5dcf22b-d921-4067-9f51-5e6bfd0782be tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 05:05:39 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 05:05:39 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 05:05:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:40 user nova-compute[72444]: DEBUG nova.compute.manager [req-5ce1e150-64ea-4aef-996a-194a7912f159 req-778e919e-d592-4e5e-9899-af314f6c524c service nova] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Received event network-vif-plugged-ef8f695a-323f-430d-88ac-7e83cdfa8b51 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:05:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5ce1e150-64ea-4aef-996a-194a7912f159 req-778e919e-d592-4e5e-9899-af314f6c524c service nova] Acquiring lock "c10deaa3-d425-40b6-9b3f-d953164eadb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:05:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5ce1e150-64ea-4aef-996a-194a7912f159 req-778e919e-d592-4e5e-9899-af314f6c524c service nova] Lock "c10deaa3-d425-40b6-9b3f-d953164eadb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:05:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5ce1e150-64ea-4aef-996a-194a7912f159 req-778e919e-d592-4e5e-9899-af314f6c524c service nova] Lock "c10deaa3-d425-40b6-9b3f-d953164eadb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:05:40 user nova-compute[72444]: DEBUG nova.compute.manager [req-5ce1e150-64ea-4aef-996a-194a7912f159 req-778e919e-d592-4e5e-9899-af314f6c524c service nova] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] No waiting events found dispatching network-vif-plugged-ef8f695a-323f-430d-88ac-7e83cdfa8b51 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:05:40 user nova-compute[72444]: WARNING nova.compute.manager [req-5ce1e150-64ea-4aef-996a-194a7912f159 req-778e919e-d592-4e5e-9899-af314f6c524c service nova] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Received unexpected event network-vif-plugged-ef8f695a-323f-430d-88ac-7e83cdfa8b51 for instance with vm_state active and task_state deleting.
Aug 03 05:05:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:41 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:05:41 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Took 2.18 seconds to deallocate network for instance.
Aug 03 05:05:41 user nova-compute[72444]: DEBUG nova.compute.manager [req-a05502c1-6996-4eda-b786-ef73eab6c163 req-7629c204-b0a9-49ac-97c3-bb0b60024140 service nova] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Received event network-vif-deleted-ef8f695a-323f-430d-88ac-7e83cdfa8b51 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:05:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c5dcf22b-d921-4067-9f51-5e6bfd0782be tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:05:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c5dcf22b-d921-4067-9f51-5e6bfd0782be tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:05:41 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-c5dcf22b-d921-4067-9f51-5e6bfd0782be tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:05:41 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-c5dcf22b-d921-4067-9f51-5e6bfd0782be tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:05:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c5dcf22b-d921-4067-9f51-5e6bfd0782be tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.204s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:05:41 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-c5dcf22b-d921-4067-9f51-5e6bfd0782be tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Deleted allocations for instance c10deaa3-d425-40b6-9b3f-d953164eadb8
Aug 03 05:05:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-c5dcf22b-d921-4067-9f51-5e6bfd0782be tempest-TestServerVolumeAttachScenarioOldVersion-685172074 tempest-TestServerVolumeAttachScenarioOldVersion-685172074-project-member] Lock "c10deaa3-d425-40b6-9b3f-d953164eadb8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.649s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:05:44 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:44 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:46 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:53 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691039138.9671938, c10deaa3-d425-40b6-9b3f-d953164eadb8 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:05:53 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] VM Stopped (Lifecycle Event)
Aug 03 05:05:53 user nova-compute[72444]: DEBUG nova.compute.manager [None req-5747c6fd-dccd-435b-b949-438ede1d1d17 None None] [instance: c10deaa3-d425-40b6-9b3f-d953164eadb8] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:05:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:57 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:05:58 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:05:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:05:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:05:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:05:59 user nova-compute[72444]: DEBUG nova.compute.manager [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 05:05:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:05:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:05:59 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 05:05:59 user nova-compute[72444]: INFO nova.compute.claims [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Claim successful on node user
Aug 03 05:05:59 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:05:59 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:05:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.273s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:05:59 user nova-compute[72444]: DEBUG nova.compute.manager [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 05:05:59 user nova-compute[72444]: DEBUG nova.compute.manager [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 05:05:59 user nova-compute[72444]: DEBUG nova.network.neutron [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 05:05:59 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 05:05:59 user nova-compute[72444]: DEBUG nova.compute.manager [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 05:05:59 user nova-compute[72444]: INFO nova.virt.block_device [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Booting with volume snapshot 03e47621-fecc-46b6-9dc9-244e6e51f725 at /dev/vda
Aug 03 05:06:00 user nova-compute[72444]: DEBUG nova.policy [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ef4d8130e33c4d9ea44c29be12f18234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae931112fcda4e2f8dfd4f540d905139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 05:06:00 user nova-compute[72444]: DEBUG nova.network.neutron [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Successfully created port: 6d6c03ff-9d72-4e7e-bce6-b380477e5529 {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 05:06:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:06:01 user nova-compute[72444]: DEBUG nova.network.neutron [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Successfully updated port: 6d6c03ff-9d72-4e7e-bce6-b380477e5529 {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 05:06:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "refresh_cache-1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:06:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquired lock "refresh_cache-1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:06:01 user nova-compute[72444]: DEBUG nova.network.neutron [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 05:06:01 user nova-compute[72444]: DEBUG nova.compute.manager [req-0404dc43-5c7e-4e2d-97e3-0685ae3e77ee req-d4cf8fc5-518d-4fca-bf50-eb1e73ab3bc0 service nova] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Received event network-changed-6d6c03ff-9d72-4e7e-bce6-b380477e5529 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:06:01 user nova-compute[72444]: DEBUG nova.compute.manager [req-0404dc43-5c7e-4e2d-97e3-0685ae3e77ee req-d4cf8fc5-518d-4fca-bf50-eb1e73ab3bc0 service nova] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Refreshing instance network info cache due to event network-changed-6d6c03ff-9d72-4e7e-bce6-b380477e5529. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:06:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0404dc43-5c7e-4e2d-97e3-0685ae3e77ee req-d4cf8fc5-518d-4fca-bf50-eb1e73ab3bc0 service nova] Acquiring lock "refresh_cache-1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:06:01 user nova-compute[72444]: DEBUG nova.network.neutron [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 05:06:01 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:06:01 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 05:06:02 user nova-compute[72444]: DEBUG nova.network.neutron [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Updating instance_info_cache with network_info: [{"id": "6d6c03ff-9d72-4e7e-bce6-b380477e5529", "address": "fa:16:3e:a7:d8:37", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d6c03ff-9d", "ovs_interfaceid": "6d6c03ff-9d72-4e7e-bce6-b380477e5529", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:06:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Releasing lock "refresh_cache-1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:06:02 user nova-compute[72444]: DEBUG nova.compute.manager [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Instance network_info: |[{"id": "6d6c03ff-9d72-4e7e-bce6-b380477e5529", "address": "fa:16:3e:a7:d8:37", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d6c03ff-9d", "ovs_interfaceid": "6d6c03ff-9d72-4e7e-bce6-b380477e5529", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 05:06:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0404dc43-5c7e-4e2d-97e3-0685ae3e77ee req-d4cf8fc5-518d-4fca-bf50-eb1e73ab3bc0 service nova] Acquired lock "refresh_cache-1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:06:02 user nova-compute[72444]: DEBUG nova.network.neutron [req-0404dc43-5c7e-4e2d-97e3-0685ae3e77ee req-d4cf8fc5-518d-4fca-bf50-eb1e73ab3bc0 service nova] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Refreshing network info cache for port 6d6c03ff-9d72-4e7e-bce6-b380477e5529 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:06:02 user nova-compute[72444]: DEBUG nova.network.neutron [req-0404dc43-5c7e-4e2d-97e3-0685ae3e77ee req-d4cf8fc5-518d-4fca-bf50-eb1e73ab3bc0 service nova] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Updated VIF entry in instance network info cache for port 6d6c03ff-9d72-4e7e-bce6-b380477e5529. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:06:02 user nova-compute[72444]: DEBUG nova.network.neutron [req-0404dc43-5c7e-4e2d-97e3-0685ae3e77ee req-d4cf8fc5-518d-4fca-bf50-eb1e73ab3bc0 service nova] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Updating instance_info_cache with network_info: [{"id": "6d6c03ff-9d72-4e7e-bce6-b380477e5529", "address": "fa:16:3e:a7:d8:37", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d6c03ff-9d", "ovs_interfaceid": "6d6c03ff-9d72-4e7e-bce6-b380477e5529", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:06:02 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0404dc43-5c7e-4e2d-97e3-0685ae3e77ee req-d4cf8fc5-518d-4fca-bf50-eb1e73ab3bc0 service nova] Releasing lock "refresh_cache-1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:06:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:06:04 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:06:04 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:06:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-53f34c9b-a064-4de8-b278-4455be0b513a" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:06:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-53f34c9b-a064-4de8-b278-4455be0b513a" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:06:05 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 05:06:05 user nova-compute[72444]: DEBUG os_brick.utils [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:06:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:06:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:06:05 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9422286-d759-4e96-a8b5-81092802fb96]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:06:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:06:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:06:05 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f277e9-ba3f-4a6f-a04b-4065947072ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:06:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:06:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:06:05 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[806ad142-41e7-4445-929f-a7fd4b5a0f7f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:06:05 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad01098-37d1-4912-92d2-f1d59a1c7de2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:06:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:06:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:06:05 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 05:06:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:06:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:06:05 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 05:06:05 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8081644-7e41-4498-88d2-adfe492d4c2c]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:06:05 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 05:06:05 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 05:06:05 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 05:06:05 user nova-compute[72444]: DEBUG os_brick.utils [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:06:05 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Updating existing volume attachment record: 8519517b-59ff-4e8c-b3e8-de3635ebf343 {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 05:06:06 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Updating instance_info_cache with network_info: [{"id": "70d97df3-9ab0-4619-83ed-bef86a0bfc6b", "address": "fa:16:3e:49:df:1f", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d97df3-9a", "ovs_interfaceid": "70d97df3-9ab0-4619-83ed-bef86a0bfc6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:06:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-53f34c9b-a064-4de8-b278-4455be0b513a" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:06:06 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 05:06:06 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:06:06 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:06:06 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:06:08 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:06:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:06:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:06:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:06:08 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:06:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:06:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:06:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:06:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:06:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:06:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 05:06:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f34c9b-a064-4de8-b278-4455be0b513a/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:06:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f34c9b-a064-4de8-b278-4455be0b513a/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:06:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f34c9b-a064-4de8-b278-4455be0b513a/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:06:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f34c9b-a064-4de8-b278-4455be0b513a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:06:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 05:06:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:06:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:06:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:06:09 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:06:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 05:06:10 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:06:10 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:06:10 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=8317MB free_disk=25.37868881225586GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:06:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:06:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:06:10 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 4f225dc2-3011-4c15-bb8e-1ebb079a3b50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:06:10 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 53f34c9b-a064-4de8-b278-4455be0b513a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:06:10 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:06:10 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:06:10 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:06:10 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:06:10 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:06:10 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:06:10 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:06:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.306s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:06:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:06:12 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG nova.compute.manager [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 05:06:13 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Creating image(s)
Aug 03 05:06:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Did not create local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Ensure instance console log exists: /opt/stack/data/nova/instances/1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Start _get_guest_xml network_info=[{"id": "6d6c03ff-9d72-4e7e-bce6-b380477e5529", "address": "fa:16:3e:a7:d8:37", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d6c03ff-9d", "ovs_interfaceid": "6d6c03ff-9d72-4e7e-bce6-b380477e5529", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RoFxVIcr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a', 'attached_at': '', 'detached_at': '', 'volume_id': 'e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba', 'serial': 'e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba'}, 'disk_bus': 'virtio', 'attachment_id': '8519517b-59ff-4e8c-b3e8-de3635ebf343', 'guest_format': None, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 05:06:13 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:06:13 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:06:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RoFxVIcr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:06:13 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:06:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:06:13 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:06:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:06:13 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 05:06:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3345adf-9240-47a0-acd6-2a11ede986e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 05:06:13 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c78b0e-1559-4b1f-aa34-d42749687fca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba] added
Aug 03 05:06:13 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1eed4d-e582-4dbb-b611-57726a5cff87]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d649f45-f408-4b0f-84f9-f31ffd93f17a]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RoFxVIcr {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RoFxVIcr" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[de095bbf-df08-40f5-929c-d5d1ee85ef6c]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RoFxVIcr'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f666da9c-7c4f-43c1-8aec-5e6c919f935f]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5b26a1-3b1a-447e-b17a-3dd9a286b20f]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)
Aug 03 05:06:13 user nova-compute[72444]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a (non-flash)
Aug 03 05:06:13 user nova-compute[72444]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9 (non-flash)
Aug 03 05:06:13 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)
Aug 03 05:06:13 user nova-compute[72444]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a (non-flash)
Aug 03 05:06:13 user nova-compute[72444]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9 (non-flash)
Aug 03 05:06:13 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f084511-de6f-4bcb-8e85-e2385e1eaedd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba, portal: 172.16.0.220,3260]
Aug 03 05:06:13 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba, portal: 172.16.0.220,3260] successful.
Aug 03 05:06:13 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d89460f-3d41-492d-a3ea-d46b6f3c1c34]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f52796-1c7a-47f6-a17f-3086ff4f1d6a]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)
Aug 03 05:06:13 user nova-compute[72444]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a (non-flash)
Aug 03 05:06:13 user nova-compute[72444]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9 (non-flash)
Aug 03 05:06:13 user nova-compute[72444]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba (non-flash)
Aug 03 05:06:13 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)
Aug 03 05:06:13 user nova-compute[72444]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a (non-flash)
Aug 03 05:06:13 user nova-compute[72444]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9 (non-flash)
Aug 03 05:06:13 user nova-compute[72444]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba (non-flash)
Aug 03 05:06:13 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] HCTL ('36', '-', '-', 0) found on session 49 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca914c8-4591-4c74-a2b5-2da2b921c662]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Searching for a device in session 49 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 05:06:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RoFxVIcr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 05:06:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:06:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:06:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26363323166353633', 'path': '/dev/sde'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:06:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363323166353633', 'path': '/dev/sde'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 05:06:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:05:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-253847572',display_name='tempest-TestVolumeBootPattern-server-253847572',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-253847572',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae931112fcda4e2f8dfd4f540d905139',ramdisk_id='',reservation_id='r-3hk0pw9n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1788747136',owner_user_name='tempest-TestVolumeBootPattern-1788747136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:06:00Z,user_data=None,user_id='ef4d8130e33c4d9ea44c29be12f18234',uuid=1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d6c03ff-9d72-4e7e-bce6-b380477e5529", "address": "fa:16:3e:a7:d8:37", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d6c03ff-9d", "ovs_interfaceid": "6d6c03ff-9d72-4e7e-bce6-b380477e5529", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 05:06:14 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Converting VIF {"id": "6d6c03ff-9d72-4e7e-bce6-b380477e5529", "address": "fa:16:3e:a7:d8:37", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d6c03ff-9d", "ovs_interfaceid": "6d6c03ff-9d72-4e7e-bce6-b380477e5529", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:06:14 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:d8:37,bridge_name='br-int',has_traffic_filtering=True,id=6d6c03ff-9d72-4e7e-bce6-b380477e5529,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d6c03ff-9d') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:06:14 user nova-compute[72444]: DEBUG nova.objects.instance [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:06:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] End _get_guest_xml xml=<domain type="kvm">
Aug 03 05:06:14 user nova-compute[72444]:   <uuid>1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a</uuid>
Aug 03 05:06:14 user nova-compute[72444]:   <name>instance-00000028</name>
Aug 03 05:06:14 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 05:06:14 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 05:06:14 user nova-compute[72444]:   <metadata>
Aug 03 05:06:14 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 05:06:14 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 05:06:14 user nova-compute[72444]:       <nova:name>tempest-TestVolumeBootPattern-server-253847572</nova:name>
Aug 03 05:06:14 user nova-compute[72444]:       <nova:creationTime>2023-08-03 05:06:13</nova:creationTime>
Aug 03 05:06:14 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 05:06:14 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 05:06:14 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 05:06:14 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 05:06:14 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 05:06:14 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 05:06:14 user nova-compute[72444]:       </nova:flavor>
Aug 03 05:06:14 user nova-compute[72444]:       <nova:owner>
Aug 03 05:06:14 user nova-compute[72444]:         <nova:user uuid="ef4d8130e33c4d9ea44c29be12f18234">tempest-TestVolumeBootPattern-1788747136-project-member</nova:user>
Aug 03 05:06:14 user nova-compute[72444]:         <nova:project uuid="ae931112fcda4e2f8dfd4f540d905139">tempest-TestVolumeBootPattern-1788747136</nova:project>
Aug 03 05:06:14 user nova-compute[72444]:       </nova:owner>
Aug 03 05:06:14 user nova-compute[72444]:       <nova:ports>
Aug 03 05:06:14 user nova-compute[72444]:         <nova:port uuid="6d6c03ff-9d72-4e7e-bce6-b380477e5529">
Aug 03 05:06:14 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 03 05:06:14 user nova-compute[72444]:         </nova:port>
Aug 03 05:06:14 user nova-compute[72444]:       </nova:ports>
Aug 03 05:06:14 user nova-compute[72444]:     </nova:instance>
Aug 03 05:06:14 user nova-compute[72444]:   </metadata>
Aug 03 05:06:14 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 05:06:14 user nova-compute[72444]:     <system>
Aug 03 05:06:14 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 05:06:14 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 05:06:14 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 05:06:14 user nova-compute[72444]:       <entry name="serial">1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a</entry>
Aug 03 05:06:14 user nova-compute[72444]:       <entry name="uuid">1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a</entry>
Aug 03 05:06:14 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 05:06:14 user nova-compute[72444]:     </system>
Aug 03 05:06:14 user nova-compute[72444]:   </sysinfo>
Aug 03 05:06:14 user nova-compute[72444]:   <os>
Aug 03 05:06:14 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 05:06:14 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 05:06:14 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 05:06:14 user nova-compute[72444]:   </os>
Aug 03 05:06:14 user nova-compute[72444]:   <features>
Aug 03 05:06:14 user nova-compute[72444]:     <acpi/>
Aug 03 05:06:14 user nova-compute[72444]:     <apic/>
Aug 03 05:06:14 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 05:06:14 user nova-compute[72444]:   </features>
Aug 03 05:06:14 user nova-compute[72444]:   <clock offset="utc">
Aug 03 05:06:14 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 05:06:14 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 05:06:14 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 05:06:14 user nova-compute[72444]:   </clock>
Aug 03 05:06:14 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 05:06:14 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 05:06:14 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 05:06:14 user nova-compute[72444]:   </cpu>
Aug 03 05:06:14 user nova-compute[72444]:   <devices>
Aug 03 05:06:14 user nova-compute[72444]:     <disk type="block" device="disk">
Aug 03 05:06:14 user nova-compute[72444]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:06:14 user nova-compute[72444]:       <source dev="/dev/sde"/>
Aug 03 05:06:14 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 05:06:14 user nova-compute[72444]:       <serial>e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba</serial>
Aug 03 05:06:14 user nova-compute[72444]:     </disk>
Aug 03 05:06:14 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 05:06:14 user nova-compute[72444]:       <mac address="fa:16:3e:a7:d8:37"/>
Aug 03 05:06:14 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:06:14 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 05:06:14 user nova-compute[72444]:       <target dev="tap6d6c03ff-9d"/>
Aug 03 05:06:14 user nova-compute[72444]:     </interface>
Aug 03 05:06:14 user nova-compute[72444]:     <serial type="pty">
Aug 03 05:06:14 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a/console.log" append="off"/>
Aug 03 05:06:14 user nova-compute[72444]:     </serial>
Aug 03 05:06:14 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 05:06:14 user nova-compute[72444]:     <video>
Aug 03 05:06:14 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:06:14 user nova-compute[72444]:     </video>
Aug 03 05:06:14 user nova-compute[72444]:     <rng model="virtio">
Aug 03 05:06:14 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 05:06:14 user nova-compute[72444]:     </rng>
Aug 03 05:06:14 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 05:06:14 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 05:06:14 user nova-compute[72444]:       <stats period="10"/>
Aug 03 05:06:14 user nova-compute[72444]:     </memballoon>
Aug 03 05:06:14 user nova-compute[72444]:   </devices>
Aug 03 05:06:14 user nova-compute[72444]: </domain>
Aug 03 05:06:14 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 05:06:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:05:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-253847572',display_name='tempest-TestVolumeBootPattern-server-253847572',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-253847572',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae931112fcda4e2f8dfd4f540d905139',ramdisk_id='',reservation_id='r-3hk0pw9n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1788747136',owner_user_name='tempest-TestVolumeBootPattern-1788747136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:06:00Z,user_data=None,user_id='ef4d8130e33c4d9ea44c29be12f18234',uuid=1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d6c03ff-9d72-4e7e-bce6-b380477e5529", "address": "fa:16:3e:a7:d8:37", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d6c03ff-9d", "ovs_interfaceid": "6d6c03ff-9d72-4e7e-bce6-b380477e5529", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 05:06:14 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Converting VIF {"id": "6d6c03ff-9d72-4e7e-bce6-b380477e5529", "address": "fa:16:3e:a7:d8:37", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d6c03ff-9d", "ovs_interfaceid": "6d6c03ff-9d72-4e7e-bce6-b380477e5529", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:06:14 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:d8:37,bridge_name='br-int',has_traffic_filtering=True,id=6d6c03ff-9d72-4e7e-bce6-b380477e5529,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d6c03ff-9d') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:06:14 user nova-compute[72444]: DEBUG os_vif [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:d8:37,bridge_name='br-int',has_traffic_filtering=True,id=6d6c03ff-9d72-4e7e-bce6-b380477e5529,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d6c03ff-9d') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 05:06:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:06:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:06:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 05:06:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:06:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d6c03ff-9d, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:06:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6d6c03ff-9d, col_values=(('external_ids', {'iface-id': '6d6c03ff-9d72-4e7e-bce6-b380477e5529', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:d8:37', 'vm-uuid': '1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:06:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:06:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:06:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:06:14 user nova-compute[72444]: INFO os_vif [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:d8:37,bridge_name='br-int',has_traffic_filtering=True,id=6d6c03ff-9d72-4e7e-bce6-b380477e5529,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d6c03ff-9d')
Aug 03 05:06:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:06:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] No VIF found with MAC fa:16:3e:a7:d8:37, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 05:06:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:06:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:06:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:06:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:06:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:06:16 user nova-compute[72444]: DEBUG nova.compute.manager [req-5b3f3cdf-69e8-4389-b1e7-493fc8d63e2e req-ab29e9e3-6cc2-4a66-bff0-cb217257d06f service nova] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Received event network-vif-plugged-6d6c03ff-9d72-4e7e-bce6-b380477e5529 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:06:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5b3f3cdf-69e8-4389-b1e7-493fc8d63e2e req-ab29e9e3-6cc2-4a66-bff0-cb217257d06f service nova] Acquiring lock "1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:06:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5b3f3cdf-69e8-4389-b1e7-493fc8d63e2e req-ab29e9e3-6cc2-4a66-bff0-cb217257d06f service nova] Lock "1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:06:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5b3f3cdf-69e8-4389-b1e7-493fc8d63e2e req-ab29e9e3-6cc2-4a66-bff0-cb217257d06f service nova] Lock "1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:06:16 user nova-compute[72444]: DEBUG nova.compute.manager [req-5b3f3cdf-69e8-4389-b1e7-493fc8d63e2e req-ab29e9e3-6cc2-4a66-bff0-cb217257d06f service nova] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] No waiting events found dispatching network-vif-plugged-6d6c03ff-9d72-4e7e-bce6-b380477e5529 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:06:16 user nova-compute[72444]: WARNING nova.compute.manager [req-5b3f3cdf-69e8-4389-b1e7-493fc8d63e2e req-ab29e9e3-6cc2-4a66-bff0-cb217257d06f service nova] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Received unexpected event network-vif-plugged-6d6c03ff-9d72-4e7e-bce6-b380477e5529 for instance with vm_state building and task_state spawning.
Aug 03 05:06:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:06:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:06:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:06:18 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691039178.2033598, 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:06:18 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] VM Resumed (Lifecycle Event)
Aug 03 05:06:18 user nova-compute[72444]: DEBUG nova.compute.manager [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 05:06:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 05:06:18 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Instance spawned successfully.
Aug 03 05:06:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 05:06:18 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:06:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:06:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:06:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:06:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:06:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:06:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:06:18 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:06:18 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 05:06:18 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691039178.2047677, 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:06:18 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] VM Started (Lifecycle Event)
Aug 03 05:06:18 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:06:18 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:06:18 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 05:06:18 user nova-compute[72444]: INFO nova.compute.manager [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Took 4.86 seconds to spawn the instance on the hypervisor.
Aug 03 05:06:18 user nova-compute[72444]: DEBUG nova.compute.manager [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:06:18 user nova-compute[72444]: INFO nova.compute.manager [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Took 18.87 seconds to build instance.
Aug 03 05:06:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e31602e8-731a-41a4-a7f1-e6348b93078c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.962s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:06:18 user nova-compute[72444]: DEBUG nova.compute.manager [req-4b225672-2b30-410f-87b8-63de36934904 req-d4b58e4f-15d2-44ec-a7cb-f9617f399632 service nova] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Received event network-vif-plugged-6d6c03ff-9d72-4e7e-bce6-b380477e5529 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:06:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4b225672-2b30-410f-87b8-63de36934904 req-d4b58e4f-15d2-44ec-a7cb-f9617f399632 service nova] Acquiring lock "1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:06:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4b225672-2b30-410f-87b8-63de36934904 req-d4b58e4f-15d2-44ec-a7cb-f9617f399632 service nova] Lock "1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:06:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4b225672-2b30-410f-87b8-63de36934904 req-d4b58e4f-15d2-44ec-a7cb-f9617f399632 service nova] Lock "1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:06:18 user nova-compute[72444]: DEBUG nova.compute.manager [req-4b225672-2b30-410f-87b8-63de36934904 req-d4b58e4f-15d2-44ec-a7cb-f9617f399632 service nova] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] No waiting events found dispatching network-vif-plugged-6d6c03ff-9d72-4e7e-bce6-b380477e5529 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:06:18 user nova-compute[72444]: WARNING nova.compute.manager [req-4b225672-2b30-410f-87b8-63de36934904 req-d4b58e4f-15d2-44ec-a7cb-f9617f399632 service nova] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Received unexpected event network-vif-plugged-6d6c03ff-9d72-4e7e-bce6-b380477e5529 for instance with vm_state active and task_state None.
Aug 03 05:06:19 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:06:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:06:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:06:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:06:29 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:06:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:06:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:06:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:06:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:06:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:06:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:06:44 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:06:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:06:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-11fad45e-10a0-4172-9ad6-bdcf6389b882 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:06:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-11fad45e-10a0-4172-9ad6-bdcf6389b882 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:06:46 user nova-compute[72444]: INFO nova.compute.manager [None req-11fad45e-10a0-4172-9ad6-bdcf6389b882 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Detaching volume 728b2fc5-c145-4a19-ab00-e145e8c63ce9
Aug 03 05:06:46 user nova-compute[72444]: INFO nova.virt.block_device [None req-11fad45e-10a0-4172-9ad6-bdcf6389b882 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Attempting to driver detach volume 728b2fc5-c145-4a19-ab00-e145e8c63ce9 from mountpoint /dev/vdc
Aug 03 05:06:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-11fad45e-10a0-4172-9ad6-bdcf6389b882 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Attempting to detach device vdc from instance dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8 from the persistent domain config. {{(pid=72444) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 05:06:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-11fad45e-10a0-4172-9ad6-bdcf6389b882 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 05:06:46 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:06:46 user nova-compute[72444]:   <source dev="/dev/sdd"/>
Aug 03 05:06:46 user nova-compute[72444]:   <target dev="vdc" bus="virtio"/>
Aug 03 05:06:46 user nova-compute[72444]:   <serial>728b2fc5-c145-4a19-ab00-e145e8c63ce9</serial>
Aug 03 05:06:46 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 03 05:06:46 user nova-compute[72444]: </disk>
Aug 03 05:06:46 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 05:06:46 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-11fad45e-10a0-4172-9ad6-bdcf6389b882 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Successfully detached device vdc from instance dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8 from the persistent domain config.
Aug 03 05:06:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-11fad45e-10a0-4172-9ad6-bdcf6389b882 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8 from the live domain config. {{(pid=72444) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 05:06:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-11fad45e-10a0-4172-9ad6-bdcf6389b882 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 05:06:46 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:06:46 user nova-compute[72444]:   <source dev="/dev/sdd"/>
Aug 03 05:06:46 user nova-compute[72444]:   <target dev="vdc" bus="virtio"/>
Aug 03 05:06:46 user nova-compute[72444]:   <serial>728b2fc5-c145-4a19-ab00-e145e8c63ce9</serial>
Aug 03 05:06:46 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 03 05:06:46 user nova-compute[72444]: </disk>
Aug 03 05:06:46 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 05:06:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Received event <DeviceRemovedEvent: 1691039206.807495, dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72444) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 05:06:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-11fad45e-10a0-4172-9ad6-bdcf6389b882 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8 {{(pid=72444) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 05:06:46 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-11fad45e-10a0-4172-9ad6-bdcf6389b882 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Successfully detached device vdc from instance dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8 from the live domain config.
Aug 03 05:06:46 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11fad45e-10a0-4172-9ad6-bdcf6389b882 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 05:06:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fad45e-10a0-4172-9ad6-bdcf6389b882 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tsGMTQVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:06:46 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-11fad45e-10a0-4172-9ad6-bdcf6389b882 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:06:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-11fad45e-10a0-4172-9ad6-bdcf6389b882 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:06:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-11fad45e-10a0-4172-9ad6-bdcf6389b882 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:06:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fad45e-10a0-4172-9ad6-bdcf6389b882 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 05:06:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:06:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:06:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[783c5884-6c4b-4866-a197-34f82ccb4e9b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:06:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:06:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:06:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[add59ddc-2a72-43fe-83d6-fcbf7cf25788]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:06:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fad45e-10a0-4172-9ad6-bdcf6389b882 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)
Aug 03 05:06:46 user nova-compute[72444]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a (non-flash)
Aug 03 05:06:46 user nova-compute[72444]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9 (non-flash)
Aug 03 05:06:46 user nova-compute[72444]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba (non-flash)
Aug 03 05:06:46 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:06:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fad45e-10a0-4172-9ad6-bdcf6389b882 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)
Aug 03 05:06:46 user nova-compute[72444]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a (non-flash)
Aug 03 05:06:46 user nova-compute[72444]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9 (non-flash)
Aug 03 05:06:46 user nova-compute[72444]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba (non-flash)
Aug 03 05:06:46 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:06:46 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fad45e-10a0-4172-9ad6-bdcf6389b882 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f309e77ca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9'): ({'sdd'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 05:06:46 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-11fad45e-10a0-4172-9ad6-bdcf6389b882 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Removing single pathed devices sdd {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 05:06:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:06:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:06:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[49923fc8-2cde-485f-ab30-a55ae8bd36ec]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:06:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:06:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:06:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[90416326-cfbe-4e2d-859a-44a4a195e393]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:06:46 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-11fad45e-10a0-4172-9ad6-bdcf6389b882 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Flushing IO for device /dev/sdd {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 05:06:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:06:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:06:46 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c957ae-d852-413f-a885-efcce09ca36e]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:06:46 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-11fad45e-10a0-4172-9ad6-bdcf6389b882 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 05:06:46 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:06:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.064s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:06:47 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9a5d78-3096-40eb-90f1-60bc84b671ac]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:06:47 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-11fad45e-10a0-4172-9ad6-bdcf6389b882 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 05:06:47 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-11fad45e-10a0-4172-9ad6-bdcf6389b882 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] SCSI volumes sdd have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 05:06:47 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fad45e-10a0-4172-9ad6-bdcf6389b882 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 05:06:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:06:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:06:47 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b7343d-bf52-4fc2-82ae-f6741b4c1ba7]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:06:47 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fad45e-10a0-4172-9ad6-bdcf6389b882 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:06:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9 -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:06:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:06:47 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4647300e-ecb3-485e-9e9c-a45acbf7de83]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:06:47 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fad45e-10a0-4172-9ad6-bdcf6389b882 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9, portal: 172.16.0.220,3260]
Aug 03 05:06:47 user nova-compute[72444]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9, portal: 172.16.0.220,3260] successful.
Aug 03 05:06:47 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:06:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9 -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:06:47 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:728b2fc5-c145-4a19-ab00-e145e8c63ce9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:06:47 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcea4148-14f0-4e98-9f08-481a94e0eaa4]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:06:47 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fad45e-10a0-4172-9ad6-bdcf6389b882 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:06:47 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-11fad45e-10a0-4172-9ad6-bdcf6389b882 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:06:47 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fad45e-10a0-4172-9ad6-bdcf6389b882 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] <== disconnect_volume: return (308ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:06:47 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11fad45e-10a0-4172-9ad6-bdcf6389b882 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 05:06:47 user nova-compute[72444]: DEBUG nova.objects.instance [None req-11fad45e-10a0-4172-9ad6-bdcf6389b882 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lazy-loading 'flavor' on Instance uuid dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:06:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-11fad45e-10a0-4172-9ad6-bdcf6389b882 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.751s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:06:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:06:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:06:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:06:58 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:06:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:06:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:06:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:06:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:06:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:06:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:07:00 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:07:02 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:07:02 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 05:07:02 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:07:02 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Cleaning up deleted instances {{(pid=72444) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 03 05:07:02 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] There are 0 instances to clean {{(pid=72444) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 03 05:07:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:07:04 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:07:04 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:07:04 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Rebuilding the list of instances to heal {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 05:07:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-4f225dc2-3011-4c15-bb8e-1ebb079a3b50" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:07:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-4f225dc2-3011-4c15-bb8e-1ebb079a3b50" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:07:05 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 05:07:05 user nova-compute[72444]: DEBUG nova.objects.instance [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lazy-loading 'info_cache' on Instance uuid 4f225dc2-3011-4c15-bb8e-1ebb079a3b50 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:07:05 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Updating instance_info_cache with network_info: [{"id": "775b17bb-97a7-4a00-9368-198abafa4f8b", "address": "fa:16:3e:65:c2:ad", "network": {"id": "dd246ddd-6ffb-4516-b262-ef339c3f195c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2067592626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac3f775464f48d88f05efdf3aeb4fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b17bb-97", "ovs_interfaceid": "775b17bb-97a7-4a00-9368-198abafa4f8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:07:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-4f225dc2-3011-4c15-bb8e-1ebb079a3b50" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:07:05 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 05:07:05 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:07:06 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:07:07 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:07:07 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:07:07 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72444) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 03 05:07:08 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:07:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:07:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:07:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:07:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:07:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:07:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:07:10 user nova-compute[72444]: DEBUG nova.compute.manager [req-927f79bd-e13e-44a2-b99c-0cf16d9fe5bf req-113d16fc-2300-4392-964e-cc3710db27e3 service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Received event network-changed-70d97df3-9ab0-4619-83ed-bef86a0bfc6b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:07:10 user nova-compute[72444]: DEBUG nova.compute.manager [req-927f79bd-e13e-44a2-b99c-0cf16d9fe5bf req-113d16fc-2300-4392-964e-cc3710db27e3 service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Refreshing instance network info cache due to event network-changed-70d97df3-9ab0-4619-83ed-bef86a0bfc6b. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:07:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-927f79bd-e13e-44a2-b99c-0cf16d9fe5bf req-113d16fc-2300-4392-964e-cc3710db27e3 service nova] Acquiring lock "refresh_cache-53f34c9b-a064-4de8-b278-4455be0b513a" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:07:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-927f79bd-e13e-44a2-b99c-0cf16d9fe5bf req-113d16fc-2300-4392-964e-cc3710db27e3 service nova] Acquired lock "refresh_cache-53f34c9b-a064-4de8-b278-4455be0b513a" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:07:10 user nova-compute[72444]: DEBUG nova.network.neutron [req-927f79bd-e13e-44a2-b99c-0cf16d9fe5bf req-113d16fc-2300-4392-964e-cc3710db27e3 service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Refreshing network info cache for port 70d97df3-9ab0-4619-83ed-bef86a0bfc6b {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:07:10 user nova-compute[72444]: DEBUG nova.network.neutron [req-927f79bd-e13e-44a2-b99c-0cf16d9fe5bf req-113d16fc-2300-4392-964e-cc3710db27e3 service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Updated VIF entry in instance network info cache for port 70d97df3-9ab0-4619-83ed-bef86a0bfc6b. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:07:10 user nova-compute[72444]: DEBUG nova.network.neutron [req-927f79bd-e13e-44a2-b99c-0cf16d9fe5bf req-113d16fc-2300-4392-964e-cc3710db27e3 service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Updating instance_info_cache with network_info: [{"id": "70d97df3-9ab0-4619-83ed-bef86a0bfc6b", "address": "fa:16:3e:49:df:1f", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d97df3-9a", "ovs_interfaceid": "70d97df3-9ab0-4619-83ed-bef86a0bfc6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:07:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-927f79bd-e13e-44a2-b99c-0cf16d9fe5bf req-113d16fc-2300-4392-964e-cc3710db27e3 service nova] Releasing lock "refresh_cache-53f34c9b-a064-4de8-b278-4455be0b513a" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:07:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:07:10 user nova-compute[72444]: DEBUG nova.compute.manager [req-0d46023c-6e5e-4149-8a28-a46e8b9767df req-bcc88caf-7120-4e92-9421-7c0d2e984b9a service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Received event network-changed-70d97df3-9ab0-4619-83ed-bef86a0bfc6b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:07:10 user nova-compute[72444]: DEBUG nova.compute.manager [req-0d46023c-6e5e-4149-8a28-a46e8b9767df req-bcc88caf-7120-4e92-9421-7c0d2e984b9a service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Refreshing instance network info cache due to event network-changed-70d97df3-9ab0-4619-83ed-bef86a0bfc6b. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:07:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0d46023c-6e5e-4149-8a28-a46e8b9767df req-bcc88caf-7120-4e92-9421-7c0d2e984b9a service nova] Acquiring lock "refresh_cache-53f34c9b-a064-4de8-b278-4455be0b513a" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:07:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0d46023c-6e5e-4149-8a28-a46e8b9767df req-bcc88caf-7120-4e92-9421-7c0d2e984b9a service nova] Acquired lock "refresh_cache-53f34c9b-a064-4de8-b278-4455be0b513a" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:07:10 user nova-compute[72444]: DEBUG nova.network.neutron [req-0d46023c-6e5e-4149-8a28-a46e8b9767df req-bcc88caf-7120-4e92-9421-7c0d2e984b9a service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Refreshing network info cache for port 70d97df3-9ab0-4619-83ed-bef86a0bfc6b {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:07:10 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:07:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:07:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:07:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:07:10 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-970e140f-7324-4ac6-a97d-ad739993d88b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquiring lock "53f34c9b-a064-4de8-b278-4455be0b513a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-970e140f-7324-4ac6-a97d-ad739993d88b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "53f34c9b-a064-4de8-b278-4455be0b513a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:07:11 user nova-compute[72444]: INFO nova.compute.manager [None req-970e140f-7324-4ac6-a97d-ad739993d88b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Detaching volume eb2795ec-187c-4dea-a784-f4728300b46a
Aug 03 05:07:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:07:11 user nova-compute[72444]: INFO nova.virt.block_device [None req-970e140f-7324-4ac6-a97d-ad739993d88b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Attempting to driver detach volume eb2795ec-187c-4dea-a784-f4728300b46a from mountpoint /dev/vdb
Aug 03 05:07:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-970e140f-7324-4ac6-a97d-ad739993d88b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Attempting to detach device vdb from instance 53f34c9b-a064-4de8-b278-4455be0b513a from the persistent domain config. {{(pid=72444) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-970e140f-7324-4ac6-a97d-ad739993d88b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 05:07:11 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:07:11 user nova-compute[72444]:   <source dev="/dev/sdc"/>
Aug 03 05:07:11 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 05:07:11 user nova-compute[72444]:   <serial>eb2795ec-187c-4dea-a784-f4728300b46a</serial>
Aug 03 05:07:11 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 05:07:11 user nova-compute[72444]: </disk>
Aug 03 05:07:11 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 05:07:11 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-970e140f-7324-4ac6-a97d-ad739993d88b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Successfully detached device vdb from instance 53f34c9b-a064-4de8-b278-4455be0b513a from the persistent domain config.
Aug 03 05:07:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-970e140f-7324-4ac6-a97d-ad739993d88b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 53f34c9b-a064-4de8-b278-4455be0b513a from the live domain config. {{(pid=72444) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-970e140f-7324-4ac6-a97d-ad739993d88b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 05:07:11 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:07:11 user nova-compute[72444]:   <source dev="/dev/sdc"/>
Aug 03 05:07:11 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 05:07:11 user nova-compute[72444]:   <serial>eb2795ec-187c-4dea-a784-f4728300b46a</serial>
Aug 03 05:07:11 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 05:07:11 user nova-compute[72444]: </disk>
Aug 03 05:07:11 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG nova.network.neutron [req-0d46023c-6e5e-4149-8a28-a46e8b9767df req-bcc88caf-7120-4e92-9421-7c0d2e984b9a service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Updated VIF entry in instance network info cache for port 70d97df3-9ab0-4619-83ed-bef86a0bfc6b. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG nova.network.neutron [req-0d46023c-6e5e-4149-8a28-a46e8b9767df req-bcc88caf-7120-4e92-9421-7c0d2e984b9a service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Updating instance_info_cache with network_info: [{"id": "70d97df3-9ab0-4619-83ed-bef86a0bfc6b", "address": "fa:16:3e:49:df:1f", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d97df3-9a", "ovs_interfaceid": "70d97df3-9ab0-4619-83ed-bef86a0bfc6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0d46023c-6e5e-4149-8a28-a46e8b9767df req-bcc88caf-7120-4e92-9421-7c0d2e984b9a service nova] Releasing lock "refresh_cache-53f34c9b-a064-4de8-b278-4455be0b513a" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Received event <DeviceRemovedEvent: 1691039231.5903206, 53f34c9b-a064-4de8-b278-4455be0b513a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72444) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-970e140f-7324-4ac6-a97d-ad739993d88b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 53f34c9b-a064-4de8-b278-4455be0b513a {{(pid=72444) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f34c9b-a064-4de8-b278-4455be0b513a/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:07:11 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-970e140f-7324-4ac6-a97d-ad739993d88b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Successfully detached device vdb from instance 53f34c9b-a064-4de8-b278-4455be0b513a from the live domain config.
Aug 03 05:07:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-970e140f-7324-4ac6-a97d-ad739993d88b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-970e140f-7324-4ac6-a97d-ad739993d88b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ajuVNogF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:07:11 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-970e140f-7324-4ac6-a97d-ad739993d88b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:07:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-970e140f-7324-4ac6-a97d-ad739993d88b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-970e140f-7324-4ac6-a97d-ad739993d88b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-970e140f-7324-4ac6-a97d-ad739993d88b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e20157-f7d5-4697-993b-45871e5f6273]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ae1cbd-1fd4-4ca7-a30e-69764f8f1206]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-970e140f-7324-4ac6-a97d-ad739993d88b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)
Aug 03 05:07:11 user nova-compute[72444]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a (non-flash)
Aug 03 05:07:11 user nova-compute[72444]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba (non-flash)
Aug 03 05:07:11 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-970e140f-7324-4ac6-a97d-ad739993d88b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)
Aug 03 05:07:11 user nova-compute[72444]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a (non-flash)
Aug 03 05:07:11 user nova-compute[72444]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba (non-flash)
Aug 03 05:07:11 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-970e140f-7324-4ac6-a97d-ad739993d88b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30943311b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a'): ({'sdc'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-970e140f-7324-4ac6-a97d-ad739993d88b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Removing single pathed devices sdc {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee9b0d5-2572-4016-ab1c-fe66d75b4b36]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f34c9b-a064-4de8-b278-4455be0b513a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f34c9b-a064-4de8-b278-4455be0b513a/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[30947fa0-1c51-4a33-8a0d-e96ffe40640c]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-970e140f-7324-4ac6-a97d-ad739993d88b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Flushing IO for device /dev/sdc {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbafed3e-e015-4ed4-bfbf-a774412e544c]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-970e140f-7324-4ac6-a97d-ad739993d88b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebce2175-12c9-48bb-b749-24489ecee49b]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-970e140f-7324-4ac6-a97d-ad739993d88b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-970e140f-7324-4ac6-a97d-ad739993d88b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] SCSI volumes sdc have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-970e140f-7324-4ac6-a97d-ad739993d88b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d656b1e9-4519-41e8-96c1-bead3fe9fb6c]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-970e140f-7324-4ac6-a97d-ad739993d88b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f34c9b-a064-4de8-b278-4455be0b513a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b17728d-b3ed-43fc-9e62-1ff7fe7a918f]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-970e140f-7324-4ac6-a97d-ad739993d88b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a, portal: 172.16.0.220,3260]
Aug 03 05:07:11 user nova-compute[72444]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a, portal: 172.16.0.220,3260] successful.
Aug 03 05:07:11 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2795ec-187c-4dea-a784-f4728300b46a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7483e323-c329-4f73-b269-f6919a1eecc3]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-970e140f-7324-4ac6-a97d-ad739993d88b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-970e140f-7324-4ac6-a97d-ad739993d88b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-970e140f-7324-4ac6-a97d-ad739993d88b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] <== disconnect_volume: return (310ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:07:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-970e140f-7324-4ac6-a97d-ad739993d88b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 05:07:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:07:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:07:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:07:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 05:07:12 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:07:12 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:07:12 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=8360MB free_disk=25.36080551147461GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:07:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:07:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:07:12 user nova-compute[72444]: DEBUG nova.objects.instance [None req-970e140f-7324-4ac6-a97d-ad739993d88b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lazy-loading 'flavor' on Instance uuid 53f34c9b-a064-4de8-b278-4455be0b513a {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:07:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-970e140f-7324-4ac6-a97d-ad739993d88b tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "53f34c9b-a064-4de8-b278-4455be0b513a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.714s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:07:12 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 4f225dc2-3011-4c15-bb8e-1ebb079a3b50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:07:12 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 53f34c9b-a064-4de8-b278-4455be0b513a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:07:12 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:07:12 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:07:12 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:07:12 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:07:12 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Refreshing inventories for resource provider b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 03 05:07:12 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Updating ProviderTree inventory for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 03 05:07:12 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Updating inventory in ProviderTree for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 03 05:07:12 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Refreshing aggregate associations for resource provider b624a913-bb6b-4a17-8cd7-7b0950cff161, aggregates: None {{(pid=72444) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 03 05:07:13 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Refreshing trait associations for resource provider b624a913-bb6b-4a17-8cd7-7b0950cff161, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=72444) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 03 05:07:13 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:07:13 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:07:13 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:07:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.623s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:07:13 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:07:14 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:07:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:07:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Acquiring lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:07:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:07:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Acquiring lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:07:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:07:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:07:15 user nova-compute[72444]: INFO nova.compute.manager [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Terminating instance
Aug 03 05:07:15 user nova-compute[72444]: DEBUG nova.compute.manager [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 05:07:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:07:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:07:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:07:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:07:15 user nova-compute[72444]: DEBUG nova.compute.manager [req-50494875-2aba-4cfb-9bec-84f8c4affefd req-bf741d7c-11f2-475b-958d-87bb7feb9ee0 service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Received event network-vif-unplugged-775b17bb-97a7-4a00-9368-198abafa4f8b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:07:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-50494875-2aba-4cfb-9bec-84f8c4affefd req-bf741d7c-11f2-475b-958d-87bb7feb9ee0 service nova] Acquiring lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:07:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-50494875-2aba-4cfb-9bec-84f8c4affefd req-bf741d7c-11f2-475b-958d-87bb7feb9ee0 service nova] Lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:07:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-50494875-2aba-4cfb-9bec-84f8c4affefd req-bf741d7c-11f2-475b-958d-87bb7feb9ee0 service nova] Lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:07:15 user nova-compute[72444]: DEBUG nova.compute.manager [req-50494875-2aba-4cfb-9bec-84f8c4affefd req-bf741d7c-11f2-475b-958d-87bb7feb9ee0 service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] No waiting events found dispatching network-vif-unplugged-775b17bb-97a7-4a00-9368-198abafa4f8b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:07:15 user nova-compute[72444]: DEBUG nova.compute.manager [req-50494875-2aba-4cfb-9bec-84f8c4affefd req-bf741d7c-11f2-475b-958d-87bb7feb9ee0 service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Received event network-vif-unplugged-775b17bb-97a7-4a00-9368-198abafa4f8b for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 05:07:16 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Instance destroyed successfully.
Aug 03 05:07:16 user nova-compute[72444]: DEBUG nova.objects.instance [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lazy-loading 'resources' on Instance uuid 4f225dc2-3011-4c15-bb8e-1ebb079a3b50 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T04:58:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1296432438',display_name='tempest-ServerActionsTestOtherB-server-1296432438',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1296432438',id=35,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJ2xwGpHSyejfRET9nle34ymsQ3JqEh+tuKb2KyDC9LlCqAQDSefnEuOykG9x3OwiAXCAIlmzscOwuKKHQpDe3RMRIrjD9v6y95AwIln0JKokDq03KE9SlxC2ULq7kCag==',key_name='tempest-keypair-1872408921',keypairs=<?>,launch_index=0,launched_at=2023-08-03T05:04:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ac3f775464f48d88f05efdf3aeb4fb8',ramdisk_id='',reservation_id='r-0ygb2937',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1191335247',owner_user_name='tempest-ServerActionsTestOtherB-1191335247-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T05:04:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32aef58e87044e47b99cd37e300393aa',uuid=4f225dc2-3011-4c15-bb8e-1ebb079a3b50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "775b17bb-97a7-4a00-9368-198abafa4f8b", "address": "fa:16:3e:65:c2:ad", "network": {"id": "dd246ddd-6ffb-4516-b262-ef339c3f195c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2067592626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac3f775464f48d88f05efdf3aeb4fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b17bb-97", "ovs_interfaceid": "775b17bb-97a7-4a00-9368-198abafa4f8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Converting VIF {"id": "775b17bb-97a7-4a00-9368-198abafa4f8b", "address": "fa:16:3e:65:c2:ad", "network": {"id": "dd246ddd-6ffb-4516-b262-ef339c3f195c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2067592626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac3f775464f48d88f05efdf3aeb4fb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b17bb-97", "ovs_interfaceid": "775b17bb-97a7-4a00-9368-198abafa4f8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:c2:ad,bridge_name='br-int',has_traffic_filtering=True,id=775b17bb-97a7-4a00-9368-198abafa4f8b,network=Network(dd246ddd-6ffb-4516-b262-ef339c3f195c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775b17bb-97') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG os_vif [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:c2:ad,bridge_name='br-int',has_traffic_filtering=True,id=775b17bb-97a7-4a00-9368-198abafa4f8b,network=Network(dd246ddd-6ffb-4516-b262-ef339c3f195c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775b17bb-97') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap775b17bb-97, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:07:16 user nova-compute[72444]: INFO os_vif [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:c2:ad,bridge_name='br-int',has_traffic_filtering=True,id=775b17bb-97a7-4a00-9368-198abafa4f8b,network=Network(dd246ddd-6ffb-4516-b262-ef339c3f195c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775b17bb-97')
Aug 03 05:07:16 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VvBMfthQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:07:16 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:07:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[715e203f-058e-4d67-8f0b-cac24121ba6a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5cec0e-afa7-4bbe-850a-11af8c1886a2]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)
Aug 03 05:07:16 user nova-compute[72444]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba (non-flash)
Aug 03 05:07:16 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 (non-flash)
Aug 03 05:07:16 user nova-compute[72444]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba (non-flash)
Aug 03 05:07:16 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308c5e5e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1'): ({'sdb'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Removing single pathed devices sdb {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7cfbde-8af0-47a6-a411-49a10e5939b4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0b00f1-1a29-4710-8bc2-c025e41df605]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Flushing IO for device /dev/sdb {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5edeb9-27fd-40e0-b6e6-ae8a53f70196]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c51343b-9a06-4421-b306-7439140f4584]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfcc1f7-177f-48ea-8ad0-28cfb3d2cad3]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[598ae2c7-7e8e-4fd0-a0d2-57185e0b88a8]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1, portal: 172.16.0.220,3260]
Aug 03 05:07:16 user nova-compute[72444]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1, portal: 172.16.0.220,3260] successful.
Aug 03 05:07:16 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b52b731-02ae-4042-b0c7-41734eabc3b1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3569f2-99bb-45cd-aad5-3aa385de1908]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] <== disconnect_volume: return (287ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 05:07:16 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Deleting instance files /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50_del
Aug 03 05:07:16 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Deletion of /opt/stack/data/nova/instances/4f225dc2-3011-4c15-bb8e-1ebb079a3b50_del complete
Aug 03 05:07:16 user nova-compute[72444]: INFO nova.compute.manager [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 03 05:07:16 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 05:07:16 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 05:07:17 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:07:17 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Took 0.94 seconds to deallocate network for instance.
Aug 03 05:07:17 user nova-compute[72444]: DEBUG nova.compute.manager [req-0c148fbd-c1f5-425a-865e-559983b3300c req-02070533-351c-4434-9334-66fda421cdac service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Received event network-vif-deleted-775b17bb-97a7-4a00-9368-198abafa4f8b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:07:17 user nova-compute[72444]: DEBUG nova.compute.manager [req-d0048083-f276-4abf-ae3a-1569f15159eb req-34e985f3-dc0b-4682-b64d-4397bb0d699f service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Received event network-vif-plugged-775b17bb-97a7-4a00-9368-198abafa4f8b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:07:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d0048083-f276-4abf-ae3a-1569f15159eb req-34e985f3-dc0b-4682-b64d-4397bb0d699f service nova] Acquiring lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:07:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d0048083-f276-4abf-ae3a-1569f15159eb req-34e985f3-dc0b-4682-b64d-4397bb0d699f service nova] Lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:07:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d0048083-f276-4abf-ae3a-1569f15159eb req-34e985f3-dc0b-4682-b64d-4397bb0d699f service nova] Lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:07:17 user nova-compute[72444]: DEBUG nova.compute.manager [req-d0048083-f276-4abf-ae3a-1569f15159eb req-34e985f3-dc0b-4682-b64d-4397bb0d699f service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] No waiting events found dispatching network-vif-plugged-775b17bb-97a7-4a00-9368-198abafa4f8b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:07:17 user nova-compute[72444]: WARNING nova.compute.manager [req-d0048083-f276-4abf-ae3a-1569f15159eb req-34e985f3-dc0b-4682-b64d-4397bb0d699f service nova] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Received unexpected event network-vif-plugged-775b17bb-97a7-4a00-9368-198abafa4f8b for instance with vm_state active and task_state deleting.
Aug 03 05:07:18 user nova-compute[72444]: INFO nova.compute.manager [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Took 0.71 seconds to detach 1 volumes for instance.
Aug 03 05:07:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:07:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:07:18 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:07:18 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:07:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.161s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:07:18 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Deleted allocations for instance 4f225dc2-3011-4c15-bb8e-1ebb079a3b50
Aug 03 05:07:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ed8a2d11-925d-4327-989e-029315495b25 tempest-ServerActionsTestOtherB-1191335247 tempest-ServerActionsTestOtherB-1191335247-project-member] Lock "4f225dc2-3011-4c15-bb8e-1ebb079a3b50" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.155s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:07:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:07:25 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:07:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:07:31 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691039236.1904411, 4f225dc2-3011-4c15-bb8e-1ebb079a3b50 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:07:31 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] VM Stopped (Lifecycle Event)
Aug 03 05:07:31 user nova-compute[72444]: DEBUG nova.compute.manager [None req-f8e2d3d7-d350-4c4c-acef-098865a0473f None None] [instance: 4f225dc2-3011-4c15-bb8e-1ebb079a3b50] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:07:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:07:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:07:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-03665ea7-735e-4551-ac81-5ef48a21b3fe tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:07:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-03665ea7-735e-4551-ac81-5ef48a21b3fe tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:07:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-03665ea7-735e-4551-ac81-5ef48a21b3fe tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:07:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-03665ea7-735e-4551-ac81-5ef48a21b3fe tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:07:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-03665ea7-735e-4551-ac81-5ef48a21b3fe tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:07:36 user nova-compute[72444]: INFO nova.compute.manager [None req-03665ea7-735e-4551-ac81-5ef48a21b3fe tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Terminating instance
Aug 03 05:07:36 user nova-compute[72444]: DEBUG nova.compute.manager [None req-03665ea7-735e-4551-ac81-5ef48a21b3fe tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 05:07:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:07:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:07:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:07:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:07:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:07:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:07:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:07:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:07:37 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Instance destroyed successfully.
Aug 03 05:07:37 user nova-compute[72444]: DEBUG nova.objects.instance [None req-03665ea7-735e-4551-ac81-5ef48a21b3fe tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lazy-loading 'resources' on Instance uuid dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:07:37 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-03665ea7-735e-4551-ac81-5ef48a21b3fe tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-03T05:01:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1501682490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1501682490',id=37,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrIKQNieskQ5HIAC8bQPEDKoCrerktuCSqbnOrkAEuAh6cCBuPVrlD3Z1OOSXPqY/Ndp7grTBVvg9CJlEgBhUnbbt61T0LtdVmOEXUXEZ86SUTqwjbbnzXye2pofWqM9w==',key_name='tempest-keypair-2139993245',keypairs=<?>,launch_index=0,launched_at=2023-08-03T05:05:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ccf62b9ebb5f487184e3b84bbe7e73ad',ramdisk_id='',reservation_id='r-0f6l9ob9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-941210092',owner_user_name='tempest-AttachVolumeShelveTestJSON-941210092-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T05:05:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bff27e3d2ae04049b35afe1bfcc7352b',uuid=dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "address": "fa:16:3e:a4:56:cc", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e85273-42", "ovs_interfaceid": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 05:07:37 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-03665ea7-735e-4551-ac81-5ef48a21b3fe tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Converting VIF {"id": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "address": "fa:16:3e:a4:56:cc", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06e85273-42", "ovs_interfaceid": "06e85273-4218-48ad-b2d8-fa4a3875a57c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:07:37 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-03665ea7-735e-4551-ac81-5ef48a21b3fe tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:56:cc,bridge_name='br-int',has_traffic_filtering=True,id=06e85273-4218-48ad-b2d8-fa4a3875a57c,network=Network(3e3f34b4-1878-4a24-b0b2-ab0472fb62d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06e85273-42') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:07:37 user nova-compute[72444]: DEBUG os_vif [None req-03665ea7-735e-4551-ac81-5ef48a21b3fe tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:56:cc,bridge_name='br-int',has_traffic_filtering=True,id=06e85273-4218-48ad-b2d8-fa4a3875a57c,network=Network(3e3f34b4-1878-4a24-b0b2-ab0472fb62d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06e85273-42') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 05:07:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:07:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06e85273-42, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:07:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:07:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:07:37 user nova-compute[72444]: INFO os_vif [None req-03665ea7-735e-4551-ac81-5ef48a21b3fe tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:56:cc,bridge_name='br-int',has_traffic_filtering=True,id=06e85273-4218-48ad-b2d8-fa4a3875a57c,network=Network(3e3f34b4-1878-4a24-b0b2-ab0472fb62d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06e85273-42')
Aug 03 05:07:37 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-03665ea7-735e-4551-ac81-5ef48a21b3fe tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Deleting instance files /opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8_del
Aug 03 05:07:37 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-03665ea7-735e-4551-ac81-5ef48a21b3fe tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Deletion of /opt/stack/data/nova/instances/dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8_del complete
Aug 03 05:07:37 user nova-compute[72444]: DEBUG nova.compute.manager [req-88348e9d-363b-497d-8e50-358172943dda req-dc1a0665-fe02-4c32-ae90-2decaa1f2847 service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Received event network-vif-unplugged-06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:07:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-88348e9d-363b-497d-8e50-358172943dda req-dc1a0665-fe02-4c32-ae90-2decaa1f2847 service nova] Acquiring lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:07:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-88348e9d-363b-497d-8e50-358172943dda req-dc1a0665-fe02-4c32-ae90-2decaa1f2847 service nova] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:07:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-88348e9d-363b-497d-8e50-358172943dda req-dc1a0665-fe02-4c32-ae90-2decaa1f2847 service nova] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:07:37 user nova-compute[72444]: DEBUG nova.compute.manager [req-88348e9d-363b-497d-8e50-358172943dda req-dc1a0665-fe02-4c32-ae90-2decaa1f2847 service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] No waiting events found dispatching network-vif-unplugged-06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:07:37 user nova-compute[72444]: DEBUG nova.compute.manager [req-88348e9d-363b-497d-8e50-358172943dda req-dc1a0665-fe02-4c32-ae90-2decaa1f2847 service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Received event network-vif-unplugged-06e85273-4218-48ad-b2d8-fa4a3875a57c for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 05:07:37 user nova-compute[72444]: INFO nova.compute.manager [None req-03665ea7-735e-4551-ac81-5ef48a21b3fe tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 03 05:07:37 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-03665ea7-735e-4551-ac81-5ef48a21b3fe tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 05:07:37 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 05:07:37 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 05:07:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:07:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:07:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:07:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:07:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:07:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:07:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:07:38 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:07:38 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Took 1.13 seconds to deallocate network for instance.
Aug 03 05:07:38 user nova-compute[72444]: DEBUG nova.compute.manager [req-cbabd2b1-0065-48d8-bd0a-a7184b866fd1 req-2a231bc6-2278-4f22-86bb-9ae9d616cc27 service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Received event network-vif-deleted-06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:07:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-03665ea7-735e-4551-ac81-5ef48a21b3fe tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:07:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-03665ea7-735e-4551-ac81-5ef48a21b3fe tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:07:38 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-03665ea7-735e-4551-ac81-5ef48a21b3fe tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:07:38 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-03665ea7-735e-4551-ac81-5ef48a21b3fe tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:07:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-03665ea7-735e-4551-ac81-5ef48a21b3fe tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:07:38 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-03665ea7-735e-4551-ac81-5ef48a21b3fe tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Deleted allocations for instance dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8
Aug 03 05:07:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-03665ea7-735e-4551-ac81-5ef48a21b3fe tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.372s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:07:39 user nova-compute[72444]: DEBUG nova.compute.manager [req-a2397d85-2c07-4050-b747-2c191a050a91 req-fe7c21c6-9ec0-4ab1-a08e-4cecffc9f2ef service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Received event network-vif-plugged-06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:07:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a2397d85-2c07-4050-b747-2c191a050a91 req-fe7c21c6-9ec0-4ab1-a08e-4cecffc9f2ef service nova] Acquiring lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:07:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a2397d85-2c07-4050-b747-2c191a050a91 req-fe7c21c6-9ec0-4ab1-a08e-4cecffc9f2ef service nova] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:07:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a2397d85-2c07-4050-b747-2c191a050a91 req-fe7c21c6-9ec0-4ab1-a08e-4cecffc9f2ef service nova] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:07:39 user nova-compute[72444]: DEBUG nova.compute.manager [req-a2397d85-2c07-4050-b747-2c191a050a91 req-fe7c21c6-9ec0-4ab1-a08e-4cecffc9f2ef service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] No waiting events found dispatching network-vif-plugged-06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:07:39 user nova-compute[72444]: WARNING nova.compute.manager [req-a2397d85-2c07-4050-b747-2c191a050a91 req-fe7c21c6-9ec0-4ab1-a08e-4cecffc9f2ef service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Received unexpected event network-vif-plugged-06e85273-4218-48ad-b2d8-fa4a3875a57c for instance with vm_state deleted and task_state None.
Aug 03 05:07:39 user nova-compute[72444]: DEBUG nova.compute.manager [req-a2397d85-2c07-4050-b747-2c191a050a91 req-fe7c21c6-9ec0-4ab1-a08e-4cecffc9f2ef service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Received event network-vif-plugged-06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:07:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a2397d85-2c07-4050-b747-2c191a050a91 req-fe7c21c6-9ec0-4ab1-a08e-4cecffc9f2ef service nova] Acquiring lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:07:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a2397d85-2c07-4050-b747-2c191a050a91 req-fe7c21c6-9ec0-4ab1-a08e-4cecffc9f2ef service nova] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:07:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a2397d85-2c07-4050-b747-2c191a050a91 req-fe7c21c6-9ec0-4ab1-a08e-4cecffc9f2ef service nova] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:07:39 user nova-compute[72444]: DEBUG nova.compute.manager [req-a2397d85-2c07-4050-b747-2c191a050a91 req-fe7c21c6-9ec0-4ab1-a08e-4cecffc9f2ef service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] No waiting events found dispatching network-vif-plugged-06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:07:39 user nova-compute[72444]: WARNING nova.compute.manager [req-a2397d85-2c07-4050-b747-2c191a050a91 req-fe7c21c6-9ec0-4ab1-a08e-4cecffc9f2ef service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Received unexpected event network-vif-plugged-06e85273-4218-48ad-b2d8-fa4a3875a57c for instance with vm_state deleted and task_state None.
Aug 03 05:07:39 user nova-compute[72444]: DEBUG nova.compute.manager [req-a2397d85-2c07-4050-b747-2c191a050a91 req-fe7c21c6-9ec0-4ab1-a08e-4cecffc9f2ef service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Received event network-vif-plugged-06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:07:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a2397d85-2c07-4050-b747-2c191a050a91 req-fe7c21c6-9ec0-4ab1-a08e-4cecffc9f2ef service nova] Acquiring lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:07:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a2397d85-2c07-4050-b747-2c191a050a91 req-fe7c21c6-9ec0-4ab1-a08e-4cecffc9f2ef service nova] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:07:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a2397d85-2c07-4050-b747-2c191a050a91 req-fe7c21c6-9ec0-4ab1-a08e-4cecffc9f2ef service nova] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:07:39 user nova-compute[72444]: DEBUG nova.compute.manager [req-a2397d85-2c07-4050-b747-2c191a050a91 req-fe7c21c6-9ec0-4ab1-a08e-4cecffc9f2ef service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] No waiting events found dispatching network-vif-plugged-06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:07:39 user nova-compute[72444]: WARNING nova.compute.manager [req-a2397d85-2c07-4050-b747-2c191a050a91 req-fe7c21c6-9ec0-4ab1-a08e-4cecffc9f2ef service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Received unexpected event network-vif-plugged-06e85273-4218-48ad-b2d8-fa4a3875a57c for instance with vm_state deleted and task_state None.
Aug 03 05:07:39 user nova-compute[72444]: DEBUG nova.compute.manager [req-a2397d85-2c07-4050-b747-2c191a050a91 req-fe7c21c6-9ec0-4ab1-a08e-4cecffc9f2ef service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Received event network-vif-unplugged-06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:07:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a2397d85-2c07-4050-b747-2c191a050a91 req-fe7c21c6-9ec0-4ab1-a08e-4cecffc9f2ef service nova] Acquiring lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:07:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a2397d85-2c07-4050-b747-2c191a050a91 req-fe7c21c6-9ec0-4ab1-a08e-4cecffc9f2ef service nova] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:07:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a2397d85-2c07-4050-b747-2c191a050a91 req-fe7c21c6-9ec0-4ab1-a08e-4cecffc9f2ef service nova] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:07:39 user nova-compute[72444]: DEBUG nova.compute.manager [req-a2397d85-2c07-4050-b747-2c191a050a91 req-fe7c21c6-9ec0-4ab1-a08e-4cecffc9f2ef service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] No waiting events found dispatching network-vif-unplugged-06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:07:39 user nova-compute[72444]: WARNING nova.compute.manager [req-a2397d85-2c07-4050-b747-2c191a050a91 req-fe7c21c6-9ec0-4ab1-a08e-4cecffc9f2ef service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Received unexpected event network-vif-unplugged-06e85273-4218-48ad-b2d8-fa4a3875a57c for instance with vm_state deleted and task_state None.
Aug 03 05:07:39 user nova-compute[72444]: DEBUG nova.compute.manager [req-a2397d85-2c07-4050-b747-2c191a050a91 req-fe7c21c6-9ec0-4ab1-a08e-4cecffc9f2ef service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Received event network-vif-plugged-06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:07:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a2397d85-2c07-4050-b747-2c191a050a91 req-fe7c21c6-9ec0-4ab1-a08e-4cecffc9f2ef service nova] Acquiring lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:07:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a2397d85-2c07-4050-b747-2c191a050a91 req-fe7c21c6-9ec0-4ab1-a08e-4cecffc9f2ef service nova] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:07:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a2397d85-2c07-4050-b747-2c191a050a91 req-fe7c21c6-9ec0-4ab1-a08e-4cecffc9f2ef service nova] Lock "dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:07:39 user nova-compute[72444]: DEBUG nova.compute.manager [req-a2397d85-2c07-4050-b747-2c191a050a91 req-fe7c21c6-9ec0-4ab1-a08e-4cecffc9f2ef service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] No waiting events found dispatching network-vif-plugged-06e85273-4218-48ad-b2d8-fa4a3875a57c {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:07:39 user nova-compute[72444]: WARNING nova.compute.manager [req-a2397d85-2c07-4050-b747-2c191a050a91 req-fe7c21c6-9ec0-4ab1-a08e-4cecffc9f2ef service nova] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Received unexpected event network-vif-plugged-06e85273-4218-48ad-b2d8-fa4a3875a57c for instance with vm_state deleted and task_state None.
Aug 03 05:07:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:07:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:07:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:07:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:07:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:07:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:07:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:07:50 user nova-compute[72444]: INFO nova.compute.manager [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Terminating instance
Aug 03 05:07:50 user nova-compute[72444]: DEBUG nova.compute.manager [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 05:07:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:07:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:07:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:07:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:07:50 user nova-compute[72444]: DEBUG nova.compute.manager [req-004efea2-d446-4c67-8c1c-8615c4039293 req-6709e0e8-ae63-4292-af2e-3afcdf8e2bdc service nova] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Received event network-vif-unplugged-6d6c03ff-9d72-4e7e-bce6-b380477e5529 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:07:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-004efea2-d446-4c67-8c1c-8615c4039293 req-6709e0e8-ae63-4292-af2e-3afcdf8e2bdc service nova] Acquiring lock "1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:07:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-004efea2-d446-4c67-8c1c-8615c4039293 req-6709e0e8-ae63-4292-af2e-3afcdf8e2bdc service nova] Lock "1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:07:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-004efea2-d446-4c67-8c1c-8615c4039293 req-6709e0e8-ae63-4292-af2e-3afcdf8e2bdc service nova] Lock "1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:07:50 user nova-compute[72444]: DEBUG nova.compute.manager [req-004efea2-d446-4c67-8c1c-8615c4039293 req-6709e0e8-ae63-4292-af2e-3afcdf8e2bdc service nova] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] No waiting events found dispatching network-vif-unplugged-6d6c03ff-9d72-4e7e-bce6-b380477e5529 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:07:50 user nova-compute[72444]: DEBUG nova.compute.manager [req-004efea2-d446-4c67-8c1c-8615c4039293 req-6709e0e8-ae63-4292-af2e-3afcdf8e2bdc service nova] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Received event network-vif-unplugged-6d6c03ff-9d72-4e7e-bce6-b380477e5529 for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 05:07:51 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Instance destroyed successfully.
Aug 03 05:07:51 user nova-compute[72444]: DEBUG nova.objects.instance [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lazy-loading 'resources' on Instance uuid 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:05:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-253847572',display_name='tempest-TestVolumeBootPattern-server-253847572',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-253847572',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-03T05:06:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae931112fcda4e2f8dfd4f540d905139',ramdisk_id='',reservation_id='r-3hk0pw9n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1788747136',owner_user_name='tempest-TestVolumeBootPattern-1788747136-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T05:06:18Z,user_data=None,user_id='ef4d8130e33c4d9ea44c29be12f18234',uuid=1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d6c03ff-9d72-4e7e-bce6-b380477e5529", "address": "fa:16:3e:a7:d8:37", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d6c03ff-9d", "ovs_interfaceid": "6d6c03ff-9d72-4e7e-bce6-b380477e5529", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Converting VIF {"id": "6d6c03ff-9d72-4e7e-bce6-b380477e5529", "address": "fa:16:3e:a7:d8:37", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d6c03ff-9d", "ovs_interfaceid": "6d6c03ff-9d72-4e7e-bce6-b380477e5529", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:d8:37,bridge_name='br-int',has_traffic_filtering=True,id=6d6c03ff-9d72-4e7e-bce6-b380477e5529,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d6c03ff-9d') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG os_vif [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:d8:37,bridge_name='br-int',has_traffic_filtering=True,id=6d6c03ff-9d72-4e7e-bce6-b380477e5529,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d6c03ff-9d') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d6c03ff-9d, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:07:51 user nova-compute[72444]: INFO os_vif [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:d8:37,bridge_name='br-int',has_traffic_filtering=True,id=6d6c03ff-9d72-4e7e-bce6-b380477e5529,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d6c03ff-9d')
Aug 03 05:07:51 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RoFxVIcr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:07:51 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:07:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb17298a-a8a4-40c0-ad8c-8de6a47b3f13]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f569ff7-db8b-4a89-91db-e9a9db6b3df3]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba (non-flash)
Aug 03 05:07:51 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba (non-flash)
Aug 03 05:07:51 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30a0dcbf40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba'): ({'sde'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Removing single pathed devices sde {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e636e09-ba15-418a-8671-9d062a85360c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c26fd1-e761-4aa9-8c6e-4e1473eaaaac]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Flushing IO for device /dev/sde {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4d7e93-feba-4f96-bb3b-959b7544fae4]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bf0988-1446-4820-b572-fac584d7df40]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] SCSI volumes sde have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO349a1e70-cc21f56362ec7837', '/dev/disk/by-id/scsi-26363323166353633', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_349a1e70') {{(pid=84280) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[decf265a-fb38-4486-878a-6c12d824196a]: (4, None) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c83465-0f42-4030-92d1-26a1dc96b19e]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf14109-56ed-4614-b4b7-ed15a1ae6213]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba, portal: 172.16.0.220,3260]
Aug 03 05:07:51 user nova-compute[72444]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba, portal: 172.16.0.220,3260] successful.
Aug 03 05:07:51 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3bf1bf-bc1b-46ae-a9ce-8b7feb61cb28]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] <== disconnect_volume: return (275ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 05:07:51 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Deleting instance files /opt/stack/data/nova/instances/1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a_del
Aug 03 05:07:51 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Deletion of /opt/stack/data/nova/instances/1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a_del complete
Aug 03 05:07:51 user nova-compute[72444]: INFO nova.compute.manager [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Took 1.10 seconds to destroy the instance on the hypervisor.
Aug 03 05:07:51 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 05:07:51 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 05:07:52 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:07:52 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Took 0.61 seconds to deallocate network for instance.
Aug 03 05:07:52 user nova-compute[72444]: DEBUG nova.compute.manager [req-98d1facb-e9d3-40a4-b30c-ea9e0bf0c9f1 req-dfb7401a-39f0-4922-8b0c-94a03536e31b service nova] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Received event network-vif-deleted-6d6c03ff-9d72-4e7e-bce6-b380477e5529 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:07:52 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691039257.3351357, dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:07:52 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] VM Stopped (Lifecycle Event)
Aug 03 05:07:52 user nova-compute[72444]: DEBUG nova.compute.manager [None req-969d2110-72ef-4a6a-acf8-7e1b877c6a21 None None] [instance: dd8f3cc7-cdad-4cfe-a50c-75cc7a7a15a8] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:07:52 user nova-compute[72444]: DEBUG nova.compute.manager [req-bf880f36-cfbc-41f1-9da7-b0e352de43f2 req-d9fc5d6a-a7ad-4470-a6f0-75ff6a9d506b service nova] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Received event network-vif-plugged-6d6c03ff-9d72-4e7e-bce6-b380477e5529 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:07:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-bf880f36-cfbc-41f1-9da7-b0e352de43f2 req-d9fc5d6a-a7ad-4470-a6f0-75ff6a9d506b service nova] Acquiring lock "1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:07:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-bf880f36-cfbc-41f1-9da7-b0e352de43f2 req-d9fc5d6a-a7ad-4470-a6f0-75ff6a9d506b service nova] Lock "1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:07:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-bf880f36-cfbc-41f1-9da7-b0e352de43f2 req-d9fc5d6a-a7ad-4470-a6f0-75ff6a9d506b service nova] Lock "1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:07:52 user nova-compute[72444]: DEBUG nova.compute.manager [req-bf880f36-cfbc-41f1-9da7-b0e352de43f2 req-d9fc5d6a-a7ad-4470-a6f0-75ff6a9d506b service nova] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] No waiting events found dispatching network-vif-plugged-6d6c03ff-9d72-4e7e-bce6-b380477e5529 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:07:52 user nova-compute[72444]: WARNING nova.compute.manager [req-bf880f36-cfbc-41f1-9da7-b0e352de43f2 req-d9fc5d6a-a7ad-4470-a6f0-75ff6a9d506b service nova] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Received unexpected event network-vif-plugged-6d6c03ff-9d72-4e7e-bce6-b380477e5529 for instance with vm_state active and task_state deleting.
Aug 03 05:07:52 user nova-compute[72444]: INFO nova.compute.manager [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Took 0.71 seconds to detach 1 volumes for instance.
Aug 03 05:07:52 user nova-compute[72444]: DEBUG nova.compute.manager [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Deleting volume: e2c65d34-9e8d-4f9c-9a97-a9fdd7d7f9ba {{(pid=72444) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 03 05:07:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:07:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:07:53 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:07:53 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:07:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.158s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:07:53 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Deleted allocations for instance 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a
Aug 03 05:07:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e1d75d46-b8c8-47b9-94a8-a05d4d3d01a0 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.815s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:07:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:08:00 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:08:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:08:02 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:08:03 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:08:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 05:08:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-91e97bed-2807-481a-8945-61606b97c4da tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquiring lock "53f34c9b-a064-4de8-b278-4455be0b513a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:08:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-91e97bed-2807-481a-8945-61606b97c4da tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "53f34c9b-a064-4de8-b278-4455be0b513a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:08:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-91e97bed-2807-481a-8945-61606b97c4da tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquiring lock "53f34c9b-a064-4de8-b278-4455be0b513a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:08:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-91e97bed-2807-481a-8945-61606b97c4da tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "53f34c9b-a064-4de8-b278-4455be0b513a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:08:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-91e97bed-2807-481a-8945-61606b97c4da tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "53f34c9b-a064-4de8-b278-4455be0b513a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:08:05 user nova-compute[72444]: INFO nova.compute.manager [None req-91e97bed-2807-481a-8945-61606b97c4da tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Terminating instance
Aug 03 05:08:05 user nova-compute[72444]: DEBUG nova.compute.manager [None req-91e97bed-2807-481a-8945-61606b97c4da tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 05:08:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:08:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:08:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:08:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:08:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:08:05 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:08:06 user nova-compute[72444]: DEBUG nova.compute.manager [req-aaa76a43-952b-43d5-a08f-e295176db1ae req-31d9cc81-71a4-4a63-b7b6-ff422fa35d62 service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Received event network-vif-unplugged-70d97df3-9ab0-4619-83ed-bef86a0bfc6b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:08:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-aaa76a43-952b-43d5-a08f-e295176db1ae req-31d9cc81-71a4-4a63-b7b6-ff422fa35d62 service nova] Acquiring lock "53f34c9b-a064-4de8-b278-4455be0b513a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:08:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-aaa76a43-952b-43d5-a08f-e295176db1ae req-31d9cc81-71a4-4a63-b7b6-ff422fa35d62 service nova] Lock "53f34c9b-a064-4de8-b278-4455be0b513a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:08:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-aaa76a43-952b-43d5-a08f-e295176db1ae req-31d9cc81-71a4-4a63-b7b6-ff422fa35d62 service nova] Lock "53f34c9b-a064-4de8-b278-4455be0b513a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:08:06 user nova-compute[72444]: DEBUG nova.compute.manager [req-aaa76a43-952b-43d5-a08f-e295176db1ae req-31d9cc81-71a4-4a63-b7b6-ff422fa35d62 service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] No waiting events found dispatching network-vif-unplugged-70d97df3-9ab0-4619-83ed-bef86a0bfc6b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:08:06 user nova-compute[72444]: DEBUG nova.compute.manager [req-aaa76a43-952b-43d5-a08f-e295176db1ae req-31d9cc81-71a4-4a63-b7b6-ff422fa35d62 service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Received event network-vif-unplugged-70d97df3-9ab0-4619-83ed-bef86a0bfc6b for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 05:08:06 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691039271.0883577, 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:08:06 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] VM Stopped (Lifecycle Event)
Aug 03 05:08:06 user nova-compute[72444]: DEBUG nova.compute.manager [None req-61e86320-5004-4a39-82d2-3622431b6279 None None] [instance: 1c9a7832-ec29-4b02-ab4c-6826bcbf9e7a] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:08:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:08:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:08:06 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Instance destroyed successfully.
Aug 03 05:08:06 user nova-compute[72444]: DEBUG nova.objects.instance [None req-91e97bed-2807-481a-8945-61606b97c4da tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lazy-loading 'resources' on Instance uuid 53f34c9b-a064-4de8-b278-4455be0b513a {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:08:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-91e97bed-2807-481a-8945-61606b97c4da tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:02:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-907495048',display_name='tempest-TestMinimumBasicScenario-server-907495048',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-907495048',id=39,image_ref='739b74ca-ca60-4e72-8ac5-51ce4b3d8b9e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7eGkcx7Tl4DNy3XzBpxm0grWydaYgJZM6hsL9CIXMxsSAH0x2E/xx/wxGBkTlBSzVpnmTQ5QCLwYeJxGO7nVisdXF/SyHOSNF21rajQ8oh13kCyZIgGQbUqotqomtR9g==',key_name='tempest-TestMinimumBasicScenario-837536290',keypairs=<?>,launch_index=0,launched_at=2023-08-03T05:03:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d787b7db6a684a008a03c55e292b0d5c',ramdisk_id='',reservation_id='r-8dy5rlxh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='739b74ca-ca60-4e72-8ac5-51ce4b3d8b9e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1132477023',owner_user_name='tempest-TestMinimumBasicScenario-1132477023-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T05:05:25Z,user_data=None,user_id='9458c7bd532e4451904ca404bf35427b',uuid=53f34c9b-a064-4de8-b278-4455be0b513a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70d97df3-9ab0-4619-83ed-bef86a0bfc6b", "address": "fa:16:3e:49:df:1f", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d97df3-9a", "ovs_interfaceid": "70d97df3-9ab0-4619-83ed-bef86a0bfc6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 05:08:06 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-91e97bed-2807-481a-8945-61606b97c4da tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Converting VIF {"id": "70d97df3-9ab0-4619-83ed-bef86a0bfc6b", "address": "fa:16:3e:49:df:1f", "network": {"id": "87c23a2e-233d-487e-9789-d4eb24a63856", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1172165010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d787b7db6a684a008a03c55e292b0d5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d97df3-9a", "ovs_interfaceid": "70d97df3-9ab0-4619-83ed-bef86a0bfc6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:08:06 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-91e97bed-2807-481a-8945-61606b97c4da tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:df:1f,bridge_name='br-int',has_traffic_filtering=True,id=70d97df3-9ab0-4619-83ed-bef86a0bfc6b,network=Network(87c23a2e-233d-487e-9789-d4eb24a63856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d97df3-9a') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:08:06 user nova-compute[72444]: DEBUG os_vif [None req-91e97bed-2807-481a-8945-61606b97c4da tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:df:1f,bridge_name='br-int',has_traffic_filtering=True,id=70d97df3-9ab0-4619-83ed-bef86a0bfc6b,network=Network(87c23a2e-233d-487e-9789-d4eb24a63856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d97df3-9a') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 05:08:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:08:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70d97df3-9a, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:08:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:08:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:08:06 user nova-compute[72444]: INFO os_vif [None req-91e97bed-2807-481a-8945-61606b97c4da tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:df:1f,bridge_name='br-int',has_traffic_filtering=True,id=70d97df3-9ab0-4619-83ed-bef86a0bfc6b,network=Network(87c23a2e-233d-487e-9789-d4eb24a63856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d97df3-9a')
Aug 03 05:08:06 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-91e97bed-2807-481a-8945-61606b97c4da tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Deleting instance files /opt/stack/data/nova/instances/53f34c9b-a064-4de8-b278-4455be0b513a_del
Aug 03 05:08:06 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-91e97bed-2807-481a-8945-61606b97c4da tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Deletion of /opt/stack/data/nova/instances/53f34c9b-a064-4de8-b278-4455be0b513a_del complete
Aug 03 05:08:06 user nova-compute[72444]: INFO nova.compute.manager [None req-91e97bed-2807-481a-8945-61606b97c4da tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 03 05:08:06 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-91e97bed-2807-481a-8945-61606b97c4da tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 05:08:06 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 05:08:06 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 05:08:06 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:08:06 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:08:06 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Skipping network cache update for instance because it is being deleted. {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9891}}
Aug 03 05:08:06 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Didn't find any instances for network info cache update. {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 03 05:08:07 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:08:07 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Took 0.52 seconds to deallocate network for instance.
Aug 03 05:08:07 user nova-compute[72444]: DEBUG nova.compute.manager [req-5bad62b8-4d7f-4807-a333-48c1727e3794 req-e1790573-3cb6-4980-8693-8ccb31de0b68 service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Received event network-vif-deleted-70d97df3-9ab0-4619-83ed-bef86a0bfc6b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:08:07 user nova-compute[72444]: INFO nova.compute.manager [req-5bad62b8-4d7f-4807-a333-48c1727e3794 req-e1790573-3cb6-4980-8693-8ccb31de0b68 service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Neutron deleted interface 70d97df3-9ab0-4619-83ed-bef86a0bfc6b; detaching it from the instance and deleting it from the info cache
Aug 03 05:08:07 user nova-compute[72444]: DEBUG nova.network.neutron [req-5bad62b8-4d7f-4807-a333-48c1727e3794 req-e1790573-3cb6-4980-8693-8ccb31de0b68 service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:08:07 user nova-compute[72444]: DEBUG nova.compute.manager [req-5bad62b8-4d7f-4807-a333-48c1727e3794 req-e1790573-3cb6-4980-8693-8ccb31de0b68 service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Detach interface failed, port_id=70d97df3-9ab0-4619-83ed-bef86a0bfc6b, reason: Instance 53f34c9b-a064-4de8-b278-4455be0b513a could not be found. {{(pid=72444) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 03 05:08:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-91e97bed-2807-481a-8945-61606b97c4da tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:08:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-91e97bed-2807-481a-8945-61606b97c4da tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:08:07 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-91e97bed-2807-481a-8945-61606b97c4da tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:08:07 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-91e97bed-2807-481a-8945-61606b97c4da tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:08:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-91e97bed-2807-481a-8945-61606b97c4da tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.123s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:08:07 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-91e97bed-2807-481a-8945-61606b97c4da tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Deleted allocations for instance 53f34c9b-a064-4de8-b278-4455be0b513a
Aug 03 05:08:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-91e97bed-2807-481a-8945-61606b97c4da tempest-TestMinimumBasicScenario-1132477023 tempest-TestMinimumBasicScenario-1132477023-project-member] Lock "53f34c9b-a064-4de8-b278-4455be0b513a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.736s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:08:08 user nova-compute[72444]: DEBUG nova.compute.manager [req-4eaf72f7-4c19-43ae-8a7d-58d4d594a776 req-754282de-23be-499b-9711-5e19ede5d868 service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Received event network-vif-plugged-70d97df3-9ab0-4619-83ed-bef86a0bfc6b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:08:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4eaf72f7-4c19-43ae-8a7d-58d4d594a776 req-754282de-23be-499b-9711-5e19ede5d868 service nova] Acquiring lock "53f34c9b-a064-4de8-b278-4455be0b513a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:08:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4eaf72f7-4c19-43ae-8a7d-58d4d594a776 req-754282de-23be-499b-9711-5e19ede5d868 service nova] Lock "53f34c9b-a064-4de8-b278-4455be0b513a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:08:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4eaf72f7-4c19-43ae-8a7d-58d4d594a776 req-754282de-23be-499b-9711-5e19ede5d868 service nova] Lock "53f34c9b-a064-4de8-b278-4455be0b513a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:08:08 user nova-compute[72444]: DEBUG nova.compute.manager [req-4eaf72f7-4c19-43ae-8a7d-58d4d594a776 req-754282de-23be-499b-9711-5e19ede5d868 service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] No waiting events found dispatching network-vif-plugged-70d97df3-9ab0-4619-83ed-bef86a0bfc6b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:08:08 user nova-compute[72444]: WARNING nova.compute.manager [req-4eaf72f7-4c19-43ae-8a7d-58d4d594a776 req-754282de-23be-499b-9711-5e19ede5d868 service nova] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Received unexpected event network-vif-plugged-70d97df3-9ab0-4619-83ed-bef86a0bfc6b for instance with vm_state deleted and task_state None.
Aug 03 05:08:08 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:08:08 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:08:09 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:08:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:08:12 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:08:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:08:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:08:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:08:12 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:08:13 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:08:13 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:08:13 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=8765MB free_disk=25.443130493164062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:08:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:08:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:08:13 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:08:13 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:08:13 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:08:13 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:08:13 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:08:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.134s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:08:14 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:08:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:08:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:08:21 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691039286.4565663, 53f34c9b-a064-4de8-b278-4455be0b513a => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:08:21 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] VM Stopped (Lifecycle Event)
Aug 03 05:08:21 user nova-compute[72444]: DEBUG nova.compute.manager [None req-9117bc68-fa8a-4186-b476-601fcf8e0e1d None None] [instance: 53f34c9b-a064-4de8-b278-4455be0b513a] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:08:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:08:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:08:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:08:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:08:30 user nova-compute[72444]: DEBUG nova.compute.manager [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 05:08:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:08:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:08:30 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 05:08:30 user nova-compute[72444]: INFO nova.compute.claims [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Claim successful on node user
Aug 03 05:08:31 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:08:31 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:08:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.178s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:08:31 user nova-compute[72444]: DEBUG nova.compute.manager [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 05:08:31 user nova-compute[72444]: DEBUG nova.compute.manager [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 05:08:31 user nova-compute[72444]: DEBUG nova.network.neutron [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 05:08:31 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 05:08:31 user nova-compute[72444]: DEBUG nova.compute.manager [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 05:08:31 user nova-compute[72444]: DEBUG nova.policy [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bff27e3d2ae04049b35afe1bfcc7352b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf62b9ebb5f487184e3b84bbe7e73ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 05:08:31 user nova-compute[72444]: DEBUG nova.compute.manager [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 05:08:31 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 05:08:31 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Creating image(s)
Aug 03 05:08:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "/opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:08:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "/opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:08:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "/opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:08:31 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:08:31 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.136s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:08:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:08:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:08:31 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:08:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:08:31 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.142s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:08:31 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:08:31 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3/disk 1073741824" returned: 0 in 0.069s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:08:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:08:31 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:08:31 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.134s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:08:31 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 05:08:31 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:08:31 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:08:31 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Cannot resize image /opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 05:08:31 user nova-compute[72444]: DEBUG nova.objects.instance [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lazy-loading 'migration_context' on Instance uuid f58f50ed-c8f1-4468-b919-0a5aa3d630b3 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:08:31 user nova-compute[72444]: DEBUG nova.network.neutron [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Successfully created port: 13b70ab9-69cc-4d4f-9a8a-a100d1401730 {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 05:08:31 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 05:08:31 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Ensure instance console log exists: /opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 05:08:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:08:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:08:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:08:32 user nova-compute[72444]: DEBUG nova.network.neutron [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Successfully updated port: 13b70ab9-69cc-4d4f-9a8a-a100d1401730 {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 05:08:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "refresh_cache-f58f50ed-c8f1-4468-b919-0a5aa3d630b3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:08:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquired lock "refresh_cache-f58f50ed-c8f1-4468-b919-0a5aa3d630b3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:08:32 user nova-compute[72444]: DEBUG nova.network.neutron [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG nova.compute.manager [req-cf65bffe-0aef-428d-ad93-b36fef3b6f44 req-292d012d-4a8a-4356-983a-2923ad740f40 service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Received event network-changed-13b70ab9-69cc-4d4f-9a8a-a100d1401730 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG nova.compute.manager [req-cf65bffe-0aef-428d-ad93-b36fef3b6f44 req-292d012d-4a8a-4356-983a-2923ad740f40 service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Refreshing instance network info cache due to event network-changed-13b70ab9-69cc-4d4f-9a8a-a100d1401730. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-cf65bffe-0aef-428d-ad93-b36fef3b6f44 req-292d012d-4a8a-4356-983a-2923ad740f40 service nova] Acquiring lock "refresh_cache-f58f50ed-c8f1-4468-b919-0a5aa3d630b3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG nova.network.neutron [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG nova.network.neutron [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Updating instance_info_cache with network_info: [{"id": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "address": "fa:16:3e:c7:96:a3", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b70ab9-69", "ovs_interfaceid": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Releasing lock "refresh_cache-f58f50ed-c8f1-4468-b919-0a5aa3d630b3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG nova.compute.manager [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Instance network_info: |[{"id": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "address": "fa:16:3e:c7:96:a3", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b70ab9-69", "ovs_interfaceid": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-cf65bffe-0aef-428d-ad93-b36fef3b6f44 req-292d012d-4a8a-4356-983a-2923ad740f40 service nova] Acquired lock "refresh_cache-f58f50ed-c8f1-4468-b919-0a5aa3d630b3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG nova.network.neutron [req-cf65bffe-0aef-428d-ad93-b36fef3b6f44 req-292d012d-4a8a-4356-983a-2923ad740f40 service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Refreshing network info cache for port 13b70ab9-69cc-4d4f-9a8a-a100d1401730 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Start _get_guest_xml network_info=[{"id": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "address": "fa:16:3e:c7:96:a3", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b70ab9-69", "ovs_interfaceid": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 05:08:33 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:08:33 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:08:33 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:08:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1386279515',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1386279515',id=41,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKwBS6VH+8+Zjncxxqwf6lSCfoolZ+1flhdWAiismKhDCjeyiT0KQv/moXMgsKxRKPdMD0euVaGQEkYvPQrRbgz0gJ7DoHqkcatTOpkTGrAK8fUAMB4od9QWxCJoMWRgg==',key_name='tempest-keypair-592139302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ccf62b9ebb5f487184e3b84bbe7e73ad',ramdisk_id='',reservation_id='r-38brd54j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-941210092',owner_user_name='tempest-AttachVolumeShelveTestJSON-941210092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:08:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bff27e3d2ae04049b35afe1bfcc7352b',uuid=f58f50ed-c8f1-4468-b919-0a5aa3d630b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "address": "fa:16:3e:c7:96:a3", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b70ab9-69", "ovs_interfaceid": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Converting VIF {"id": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "address": "fa:16:3e:c7:96:a3", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b70ab9-69", "ovs_interfaceid": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:96:a3,bridge_name='br-int',has_traffic_filtering=True,id=13b70ab9-69cc-4d4f-9a8a-a100d1401730,network=Network(3e3f34b4-1878-4a24-b0b2-ab0472fb62d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b70ab9-69') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG nova.objects.instance [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lazy-loading 'pci_devices' on Instance uuid f58f50ed-c8f1-4468-b919-0a5aa3d630b3 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] End _get_guest_xml xml=<domain type="kvm">
Aug 03 05:08:33 user nova-compute[72444]:   <uuid>f58f50ed-c8f1-4468-b919-0a5aa3d630b3</uuid>
Aug 03 05:08:33 user nova-compute[72444]:   <name>instance-00000029</name>
Aug 03 05:08:33 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 05:08:33 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 05:08:33 user nova-compute[72444]:   <metadata>
Aug 03 05:08:33 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 05:08:33 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 05:08:33 user nova-compute[72444]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1386279515</nova:name>
Aug 03 05:08:33 user nova-compute[72444]:       <nova:creationTime>2023-08-03 05:08:33</nova:creationTime>
Aug 03 05:08:33 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 05:08:33 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 05:08:33 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 05:08:33 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 05:08:33 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 05:08:33 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 05:08:33 user nova-compute[72444]:       </nova:flavor>
Aug 03 05:08:33 user nova-compute[72444]:       <nova:owner>
Aug 03 05:08:33 user nova-compute[72444]:         <nova:user uuid="bff27e3d2ae04049b35afe1bfcc7352b">tempest-AttachVolumeShelveTestJSON-941210092-project-member</nova:user>
Aug 03 05:08:33 user nova-compute[72444]:         <nova:project uuid="ccf62b9ebb5f487184e3b84bbe7e73ad">tempest-AttachVolumeShelveTestJSON-941210092</nova:project>
Aug 03 05:08:33 user nova-compute[72444]:       </nova:owner>
Aug 03 05:08:33 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 05:08:33 user nova-compute[72444]:       <nova:ports>
Aug 03 05:08:33 user nova-compute[72444]:         <nova:port uuid="13b70ab9-69cc-4d4f-9a8a-a100d1401730">
Aug 03 05:08:33 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 03 05:08:33 user nova-compute[72444]:         </nova:port>
Aug 03 05:08:33 user nova-compute[72444]:       </nova:ports>
Aug 03 05:08:33 user nova-compute[72444]:     </nova:instance>
Aug 03 05:08:33 user nova-compute[72444]:   </metadata>
Aug 03 05:08:33 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 05:08:33 user nova-compute[72444]:     <system>
Aug 03 05:08:33 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 05:08:33 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 05:08:33 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 05:08:33 user nova-compute[72444]:       <entry name="serial">f58f50ed-c8f1-4468-b919-0a5aa3d630b3</entry>
Aug 03 05:08:33 user nova-compute[72444]:       <entry name="uuid">f58f50ed-c8f1-4468-b919-0a5aa3d630b3</entry>
Aug 03 05:08:33 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 05:08:33 user nova-compute[72444]:     </system>
Aug 03 05:08:33 user nova-compute[72444]:   </sysinfo>
Aug 03 05:08:33 user nova-compute[72444]:   <os>
Aug 03 05:08:33 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 05:08:33 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 05:08:33 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 05:08:33 user nova-compute[72444]:   </os>
Aug 03 05:08:33 user nova-compute[72444]:   <features>
Aug 03 05:08:33 user nova-compute[72444]:     <acpi/>
Aug 03 05:08:33 user nova-compute[72444]:     <apic/>
Aug 03 05:08:33 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 05:08:33 user nova-compute[72444]:   </features>
Aug 03 05:08:33 user nova-compute[72444]:   <clock offset="utc">
Aug 03 05:08:33 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 05:08:33 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 05:08:33 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 05:08:33 user nova-compute[72444]:   </clock>
Aug 03 05:08:33 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 05:08:33 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 05:08:33 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 05:08:33 user nova-compute[72444]:   </cpu>
Aug 03 05:08:33 user nova-compute[72444]:   <devices>
Aug 03 05:08:33 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 05:08:33 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 05:08:33 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3/disk"/>
Aug 03 05:08:33 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 05:08:33 user nova-compute[72444]:     </disk>
Aug 03 05:08:33 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 05:08:33 user nova-compute[72444]:       <mac address="fa:16:3e:c7:96:a3"/>
Aug 03 05:08:33 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:08:33 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 05:08:33 user nova-compute[72444]:       <target dev="tap13b70ab9-69"/>
Aug 03 05:08:33 user nova-compute[72444]:     </interface>
Aug 03 05:08:33 user nova-compute[72444]:     <serial type="pty">
Aug 03 05:08:33 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3/console.log" append="off"/>
Aug 03 05:08:33 user nova-compute[72444]:     </serial>
Aug 03 05:08:33 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 05:08:33 user nova-compute[72444]:     <video>
Aug 03 05:08:33 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:08:33 user nova-compute[72444]:     </video>
Aug 03 05:08:33 user nova-compute[72444]:     <rng model="virtio">
Aug 03 05:08:33 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 05:08:33 user nova-compute[72444]:     </rng>
Aug 03 05:08:33 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 05:08:33 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 05:08:33 user nova-compute[72444]:       <stats period="10"/>
Aug 03 05:08:33 user nova-compute[72444]:     </memballoon>
Aug 03 05:08:33 user nova-compute[72444]:   </devices>
Aug 03 05:08:33 user nova-compute[72444]: </domain>
Aug 03 05:08:33 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:08:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1386279515',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1386279515',id=41,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKwBS6VH+8+Zjncxxqwf6lSCfoolZ+1flhdWAiismKhDCjeyiT0KQv/moXMgsKxRKPdMD0euVaGQEkYvPQrRbgz0gJ7DoHqkcatTOpkTGrAK8fUAMB4od9QWxCJoMWRgg==',key_name='tempest-keypair-592139302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ccf62b9ebb5f487184e3b84bbe7e73ad',ramdisk_id='',reservation_id='r-38brd54j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-941210092',owner_user_name='tempest-AttachVolumeShelveTestJSON-941210092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:08:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bff27e3d2ae04049b35afe1bfcc7352b',uuid=f58f50ed-c8f1-4468-b919-0a5aa3d630b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "address": "fa:16:3e:c7:96:a3", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b70ab9-69", "ovs_interfaceid": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Converting VIF {"id": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "address": "fa:16:3e:c7:96:a3", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b70ab9-69", "ovs_interfaceid": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:96:a3,bridge_name='br-int',has_traffic_filtering=True,id=13b70ab9-69cc-4d4f-9a8a-a100d1401730,network=Network(3e3f34b4-1878-4a24-b0b2-ab0472fb62d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b70ab9-69') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG os_vif [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:96:a3,bridge_name='br-int',has_traffic_filtering=True,id=13b70ab9-69cc-4d4f-9a8a-a100d1401730,network=Network(3e3f34b4-1878-4a24-b0b2-ab0472fb62d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b70ab9-69') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13b70ab9-69, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap13b70ab9-69, col_values=(('external_ids', {'iface-id': '13b70ab9-69cc-4d4f-9a8a-a100d1401730', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:96:a3', 'vm-uuid': 'f58f50ed-c8f1-4468-b919-0a5aa3d630b3'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:08:33 user nova-compute[72444]: INFO os_vif [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:96:a3,bridge_name='br-int',has_traffic_filtering=True,id=13b70ab9-69cc-4d4f-9a8a-a100d1401730,network=Network(3e3f34b4-1878-4a24-b0b2-ab0472fb62d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b70ab9-69')
Aug 03 05:08:33 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:08:33 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] No VIF found with MAC fa:16:3e:c7:96:a3, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 05:08:34 user nova-compute[72444]: DEBUG nova.network.neutron [req-cf65bffe-0aef-428d-ad93-b36fef3b6f44 req-292d012d-4a8a-4356-983a-2923ad740f40 service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Updated VIF entry in instance network info cache for port 13b70ab9-69cc-4d4f-9a8a-a100d1401730. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:08:34 user nova-compute[72444]: DEBUG nova.network.neutron [req-cf65bffe-0aef-428d-ad93-b36fef3b6f44 req-292d012d-4a8a-4356-983a-2923ad740f40 service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Updating instance_info_cache with network_info: [{"id": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "address": "fa:16:3e:c7:96:a3", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b70ab9-69", "ovs_interfaceid": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:08:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-cf65bffe-0aef-428d-ad93-b36fef3b6f44 req-292d012d-4a8a-4356-983a-2923ad740f40 service nova] Releasing lock "refresh_cache-f58f50ed-c8f1-4468-b919-0a5aa3d630b3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:08:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:08:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:08:34 user nova-compute[72444]: DEBUG nova.compute.manager [req-133ba219-94c9-4d90-b910-1ed937a38405 req-096e584a-4dc1-4899-87e7-14f23385a234 service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Received event network-vif-plugged-13b70ab9-69cc-4d4f-9a8a-a100d1401730 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:08:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-133ba219-94c9-4d90-b910-1ed937a38405 req-096e584a-4dc1-4899-87e7-14f23385a234 service nova] Acquiring lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:08:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-133ba219-94c9-4d90-b910-1ed937a38405 req-096e584a-4dc1-4899-87e7-14f23385a234 service nova] Lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:08:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-133ba219-94c9-4d90-b910-1ed937a38405 req-096e584a-4dc1-4899-87e7-14f23385a234 service nova] Lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:08:34 user nova-compute[72444]: DEBUG nova.compute.manager [req-133ba219-94c9-4d90-b910-1ed937a38405 req-096e584a-4dc1-4899-87e7-14f23385a234 service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] No waiting events found dispatching network-vif-plugged-13b70ab9-69cc-4d4f-9a8a-a100d1401730 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:08:34 user nova-compute[72444]: WARNING nova.compute.manager [req-133ba219-94c9-4d90-b910-1ed937a38405 req-096e584a-4dc1-4899-87e7-14f23385a234 service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Received unexpected event network-vif-plugged-13b70ab9-69cc-4d4f-9a8a-a100d1401730 for instance with vm_state building and task_state spawning.
Aug 03 05:08:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:08:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:08:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:08:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:08:36 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691039316.9330468, f58f50ed-c8f1-4468-b919-0a5aa3d630b3 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:08:36 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] VM Resumed (Lifecycle Event)
Aug 03 05:08:36 user nova-compute[72444]: DEBUG nova.compute.manager [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 05:08:36 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 05:08:36 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Instance spawned successfully.
Aug 03 05:08:36 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 05:08:36 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:08:36 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:08:36 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:08:36 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:08:36 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:08:36 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:08:36 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:08:36 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:08:36 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 05:08:36 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691039316.934372, f58f50ed-c8f1-4468-b919-0a5aa3d630b3 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:08:36 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] VM Started (Lifecycle Event)
Aug 03 05:08:37 user nova-compute[72444]: DEBUG nova.compute.manager [req-af9325d2-c4d9-4fc0-86ef-5fc47830faba req-d2eb1faf-95c5-44e1-8b7a-02a8c3fec9d7 service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Received event network-vif-plugged-13b70ab9-69cc-4d4f-9a8a-a100d1401730 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:08:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-af9325d2-c4d9-4fc0-86ef-5fc47830faba req-d2eb1faf-95c5-44e1-8b7a-02a8c3fec9d7 service nova] Acquiring lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:08:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-af9325d2-c4d9-4fc0-86ef-5fc47830faba req-d2eb1faf-95c5-44e1-8b7a-02a8c3fec9d7 service nova] Lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:08:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-af9325d2-c4d9-4fc0-86ef-5fc47830faba req-d2eb1faf-95c5-44e1-8b7a-02a8c3fec9d7 service nova] Lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:08:37 user nova-compute[72444]: DEBUG nova.compute.manager [req-af9325d2-c4d9-4fc0-86ef-5fc47830faba req-d2eb1faf-95c5-44e1-8b7a-02a8c3fec9d7 service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] No waiting events found dispatching network-vif-plugged-13b70ab9-69cc-4d4f-9a8a-a100d1401730 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:08:37 user nova-compute[72444]: WARNING nova.compute.manager [req-af9325d2-c4d9-4fc0-86ef-5fc47830faba req-d2eb1faf-95c5-44e1-8b7a-02a8c3fec9d7 service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Received unexpected event network-vif-plugged-13b70ab9-69cc-4d4f-9a8a-a100d1401730 for instance with vm_state building and task_state spawning.
Aug 03 05:08:37 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:08:37 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:08:37 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 05:08:37 user nova-compute[72444]: INFO nova.compute.manager [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Took 5.76 seconds to spawn the instance on the hypervisor.
Aug 03 05:08:37 user nova-compute[72444]: DEBUG nova.compute.manager [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:08:37 user nova-compute[72444]: INFO nova.compute.manager [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Took 6.26 seconds to build instance.
Aug 03 05:08:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-58b45d7e-6bd8-4846-b269-ec6806583952 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.351s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:08:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:08:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:08:43 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:08:48 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:08:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:08:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:08:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:08:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "bf8b022e-eb3d-4315-b2fe-aca113826b6b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:08:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "bf8b022e-eb3d-4315-b2fe-aca113826b6b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:08:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 05:08:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:08:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:08:58 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 05:08:58 user nova-compute[72444]: INFO nova.compute.claims [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Claim successful on node user
Aug 03 05:08:58 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:08:58 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:08:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.229s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:08:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 05:08:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:08:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 05:08:58 user nova-compute[72444]: DEBUG nova.network.neutron [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 05:08:58 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 05:08:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 05:08:58 user nova-compute[72444]: INFO nova.virt.block_device [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Booting with volume e06519da-1db3-47c6-966b-2d8608926ab9 at /dev/vda
Aug 03 05:08:58 user nova-compute[72444]: DEBUG nova.policy [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ef4d8130e33c4d9ea44c29be12f18234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae931112fcda4e2f8dfd4f540d905139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 05:08:58 user nova-compute[72444]: DEBUG os_brick.utils [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:08:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:08:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:08:58 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[add4e3ce-9119-4baa-82d8-8b7a58ed7169]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:08:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:08:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:08:58 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[36dd54ef-6202-47ca-adb5-dc1fed09f62c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:08:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:08:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:08:58 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cf90df-c258-48b7-bea8-9376c188279d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:08:58 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb0990f-30f0-45df-b188-f6547b032e79]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:08:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:08:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:08:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 05:08:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:08:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:08:58 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 05:08:58 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[37eca2dc-1fca-4d10-be6b-f92f04321ce1]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:08:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 05:08:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 05:08:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 05:08:58 user nova-compute[72444]: DEBUG os_brick.utils [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:08:58 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Updating existing volume attachment record: 8707c9f1-9336-451d-b64d-6b2c7cc21d55 {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 05:08:59 user nova-compute[72444]: DEBUG nova.network.neutron [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Successfully created port: d9c036ff-c273-42a7-9add-024d41a7b0be {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 05:08:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:09:00 user nova-compute[72444]: DEBUG nova.network.neutron [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Successfully updated port: d9c036ff-c273-42a7-9add-024d41a7b0be {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 05:09:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "refresh_cache-bf8b022e-eb3d-4315-b2fe-aca113826b6b" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:09:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquired lock "refresh_cache-bf8b022e-eb3d-4315-b2fe-aca113826b6b" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:09:00 user nova-compute[72444]: DEBUG nova.network.neutron [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 05:09:00 user nova-compute[72444]: DEBUG nova.compute.manager [req-79f5fa07-36ef-4036-88d8-16c41b8632de req-c8ab2459-5bf6-4e70-8328-f7c319adee03 service nova] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Received event network-changed-d9c036ff-c273-42a7-9add-024d41a7b0be {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:09:00 user nova-compute[72444]: DEBUG nova.compute.manager [req-79f5fa07-36ef-4036-88d8-16c41b8632de req-c8ab2459-5bf6-4e70-8328-f7c319adee03 service nova] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Refreshing instance network info cache due to event network-changed-d9c036ff-c273-42a7-9add-024d41a7b0be. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:09:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-79f5fa07-36ef-4036-88d8-16c41b8632de req-c8ab2459-5bf6-4e70-8328-f7c319adee03 service nova] Acquiring lock "refresh_cache-bf8b022e-eb3d-4315-b2fe-aca113826b6b" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:09:00 user nova-compute[72444]: DEBUG nova.network.neutron [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 05:09:00 user nova-compute[72444]: DEBUG nova.network.neutron [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Updating instance_info_cache with network_info: [{"id": "d9c036ff-c273-42a7-9add-024d41a7b0be", "address": "fa:16:3e:41:62:4d", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c036ff-c2", "ovs_interfaceid": "d9c036ff-c273-42a7-9add-024d41a7b0be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:09:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Releasing lock "refresh_cache-bf8b022e-eb3d-4315-b2fe-aca113826b6b" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:09:00 user nova-compute[72444]: DEBUG nova.compute.manager [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Instance network_info: |[{"id": "d9c036ff-c273-42a7-9add-024d41a7b0be", "address": "fa:16:3e:41:62:4d", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c036ff-c2", "ovs_interfaceid": "d9c036ff-c273-42a7-9add-024d41a7b0be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 05:09:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-79f5fa07-36ef-4036-88d8-16c41b8632de req-c8ab2459-5bf6-4e70-8328-f7c319adee03 service nova] Acquired lock "refresh_cache-bf8b022e-eb3d-4315-b2fe-aca113826b6b" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:09:00 user nova-compute[72444]: DEBUG nova.network.neutron [req-79f5fa07-36ef-4036-88d8-16c41b8632de req-c8ab2459-5bf6-4e70-8328-f7c319adee03 service nova] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Refreshing network info cache for port d9c036ff-c273-42a7-9add-024d41a7b0be {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:09:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:09:01 user nova-compute[72444]: DEBUG nova.network.neutron [req-79f5fa07-36ef-4036-88d8-16c41b8632de req-c8ab2459-5bf6-4e70-8328-f7c319adee03 service nova] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Updated VIF entry in instance network info cache for port d9c036ff-c273-42a7-9add-024d41a7b0be. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:09:01 user nova-compute[72444]: DEBUG nova.network.neutron [req-79f5fa07-36ef-4036-88d8-16c41b8632de req-c8ab2459-5bf6-4e70-8328-f7c319adee03 service nova] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Updating instance_info_cache with network_info: [{"id": "d9c036ff-c273-42a7-9add-024d41a7b0be", "address": "fa:16:3e:41:62:4d", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c036ff-c2", "ovs_interfaceid": "d9c036ff-c273-42a7-9add-024d41a7b0be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:09:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-79f5fa07-36ef-4036-88d8-16c41b8632de req-c8ab2459-5bf6-4e70-8328-f7c319adee03 service nova] Releasing lock "refresh_cache-bf8b022e-eb3d-4315-b2fe-aca113826b6b" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:09:02 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:09:02 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:09:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:09:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:09:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:09:05 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:09:05 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG nova.compute.manager [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 05:09:06 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Creating image(s)
Aug 03 05:09:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Did not create local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Ensure instance console log exists: /opt/stack/data/nova/instances/bf8b022e-eb3d-4315-b2fe-aca113826b6b/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Start _get_guest_xml network_info=[{"id": "d9c036ff-c273-42a7-9add-024d41a7b0be", "address": "fa:16:3e:41:62:4d", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c036ff-c2", "ovs_interfaceid": "d9c036ff-c273-42a7-9add-024d41a7b0be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kTMYBCba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bf8b022e-eb3d-4315-b2fe-aca113826b6b', 'attached_at': '', 'detached_at': '', 'volume_id': 'e06519da-1db3-47c6-966b-2d8608926ab9', 'serial': 'e06519da-1db3-47c6-966b-2d8608926ab9'}, 'disk_bus': 'virtio', 'attachment_id': '8707c9f1-9336-451d-b64d-6b2c7cc21d55', 'guest_format': None, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 05:09:06 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:09:06 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:09:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kTMYBCba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:09:06 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:09:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:09:06 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:09:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:09:06 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 05:09:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64e7807-84a0-48b6-964d-8d49f230cc68]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 05:09:06 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c317abb4-8b04-4a7a-8a99-2f60b004313d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9] added
Aug 03 05:09:06 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef00024-5cfc-4842-b749-17ef674ca673]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b2a8fd-8a8e-4889-8f6e-134b84505ff4]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kTMYBCba {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kTMYBCba" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21dcafb-7cae-4ec7-8e74-7ee0adaa668c]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kTMYBCba'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[399f73ff-0a9a-4781-abfb-d5a24add0133]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddab27c-6507-496f-a7bd-1b2748b782f3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 03 05:09:06 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:09:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 03 05:09:06 user nova-compute[72444]:  {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:09:06 user nova-compute[72444]: WARNING os_brick.initiator.connectors.iscsi [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 03 05:09:06 user nova-compute[72444]: 
Aug 03 05:09:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:09:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:09:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f6e9d9-8adc-47aa-8e33-a9f2df71c030]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:09:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9, portal: 172.16.0.220,3260]
Aug 03 05:09:07 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9, portal: 172.16.0.220,3260] successful.
Aug 03 05:09:07 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:09:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:09:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:09:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69bd470-c20f-422f-8540-a3b671b0fb2d]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:09:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:09:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:09:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:09:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7154726b-1f0f-49dd-b37c-9a37bc813209]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:09:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 (non-flash)
Aug 03 05:09:07 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:09:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 (non-flash)
Aug 03 05:09:07 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:09:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:09:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 05:09:07 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 05:09:07 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 05:09:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:09:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:09:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d91bc4-f2b3-4895-ba8e-616605839c19]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:09:07 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 05:09:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kTMYBCba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 05:09:07 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:09:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:09:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26630643663653137', 'path': '/dev/sdb'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:09:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630643663653137', 'path': '/dev/sdb'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 05:09:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:08:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1598415921',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1598415921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1598415921',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIT5Hl3gXjbHQicmXYbJG1uN306r+f5uwmgo0j8Wwc+0Tq8mZ8mw+ceSC04uhHrGDjRijAgRvwk+EZzyPx96HnwWGfWCmJQuGWsYsoB4lVL0EnJfnfTcHbtRaPEX3dFmFA==',key_name='tempest-keypair-140047733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae931112fcda4e2f8dfd4f540d905139',ramdisk_id='',reservation_id='r-cx0q5956',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1788747136',owner_user_name='tempest-TestVolumeBootPattern-1788747136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:08:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef4d8130e33c4d9ea44c29be12f18234',uuid=bf8b022e-eb3d-4315-b2fe-aca113826b6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9c036ff-c273-42a7-9add-024d41a7b0be", "address": "fa:16:3e:41:62:4d", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c036ff-c2", "ovs_interfaceid": "d9c036ff-c273-42a7-9add-024d41a7b0be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 05:09:08 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Converting VIF {"id": "d9c036ff-c273-42a7-9add-024d41a7b0be", "address": "fa:16:3e:41:62:4d", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c036ff-c2", "ovs_interfaceid": "d9c036ff-c273-42a7-9add-024d41a7b0be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:09:08 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:62:4d,bridge_name='br-int',has_traffic_filtering=True,id=d9c036ff-c273-42a7-9add-024d41a7b0be,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9c036ff-c2') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:09:08 user nova-compute[72444]: DEBUG nova.objects.instance [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lazy-loading 'pci_devices' on Instance uuid bf8b022e-eb3d-4315-b2fe-aca113826b6b {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:09:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] End _get_guest_xml xml=<domain type="kvm">
Aug 03 05:09:08 user nova-compute[72444]:   <uuid>bf8b022e-eb3d-4315-b2fe-aca113826b6b</uuid>
Aug 03 05:09:08 user nova-compute[72444]:   <name>instance-0000002a</name>
Aug 03 05:09:08 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 05:09:08 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 05:09:08 user nova-compute[72444]:   <metadata>
Aug 03 05:09:08 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 05:09:08 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 05:09:08 user nova-compute[72444]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1598415921</nova:name>
Aug 03 05:09:08 user nova-compute[72444]:       <nova:creationTime>2023-08-03 05:09:06</nova:creationTime>
Aug 03 05:09:08 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 05:09:08 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 05:09:08 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 05:09:08 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 05:09:08 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 05:09:08 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 05:09:08 user nova-compute[72444]:       </nova:flavor>
Aug 03 05:09:08 user nova-compute[72444]:       <nova:owner>
Aug 03 05:09:08 user nova-compute[72444]:         <nova:user uuid="ef4d8130e33c4d9ea44c29be12f18234">tempest-TestVolumeBootPattern-1788747136-project-member</nova:user>
Aug 03 05:09:08 user nova-compute[72444]:         <nova:project uuid="ae931112fcda4e2f8dfd4f540d905139">tempest-TestVolumeBootPattern-1788747136</nova:project>
Aug 03 05:09:08 user nova-compute[72444]:       </nova:owner>
Aug 03 05:09:08 user nova-compute[72444]:       <nova:ports>
Aug 03 05:09:08 user nova-compute[72444]:         <nova:port uuid="d9c036ff-c273-42a7-9add-024d41a7b0be">
Aug 03 05:09:08 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 03 05:09:08 user nova-compute[72444]:         </nova:port>
Aug 03 05:09:08 user nova-compute[72444]:       </nova:ports>
Aug 03 05:09:08 user nova-compute[72444]:     </nova:instance>
Aug 03 05:09:08 user nova-compute[72444]:   </metadata>
Aug 03 05:09:08 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 05:09:08 user nova-compute[72444]:     <system>
Aug 03 05:09:08 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 05:09:08 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 05:09:08 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 05:09:08 user nova-compute[72444]:       <entry name="serial">bf8b022e-eb3d-4315-b2fe-aca113826b6b</entry>
Aug 03 05:09:08 user nova-compute[72444]:       <entry name="uuid">bf8b022e-eb3d-4315-b2fe-aca113826b6b</entry>
Aug 03 05:09:08 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 05:09:08 user nova-compute[72444]:     </system>
Aug 03 05:09:08 user nova-compute[72444]:   </sysinfo>
Aug 03 05:09:08 user nova-compute[72444]:   <os>
Aug 03 05:09:08 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 05:09:08 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 05:09:08 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 05:09:08 user nova-compute[72444]:   </os>
Aug 03 05:09:08 user nova-compute[72444]:   <features>
Aug 03 05:09:08 user nova-compute[72444]:     <acpi/>
Aug 03 05:09:08 user nova-compute[72444]:     <apic/>
Aug 03 05:09:08 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 05:09:08 user nova-compute[72444]:   </features>
Aug 03 05:09:08 user nova-compute[72444]:   <clock offset="utc">
Aug 03 05:09:08 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 05:09:08 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 05:09:08 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 05:09:08 user nova-compute[72444]:   </clock>
Aug 03 05:09:08 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 05:09:08 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 05:09:08 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 05:09:08 user nova-compute[72444]:   </cpu>
Aug 03 05:09:08 user nova-compute[72444]:   <devices>
Aug 03 05:09:08 user nova-compute[72444]:     <disk type="block" device="disk">
Aug 03 05:09:08 user nova-compute[72444]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:09:08 user nova-compute[72444]:       <source dev="/dev/sdb"/>
Aug 03 05:09:08 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 05:09:08 user nova-compute[72444]:       <serial>e06519da-1db3-47c6-966b-2d8608926ab9</serial>
Aug 03 05:09:08 user nova-compute[72444]:     </disk>
Aug 03 05:09:08 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 05:09:08 user nova-compute[72444]:       <mac address="fa:16:3e:41:62:4d"/>
Aug 03 05:09:08 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:09:08 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 05:09:08 user nova-compute[72444]:       <target dev="tapd9c036ff-c2"/>
Aug 03 05:09:08 user nova-compute[72444]:     </interface>
Aug 03 05:09:08 user nova-compute[72444]:     <serial type="pty">
Aug 03 05:09:08 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/bf8b022e-eb3d-4315-b2fe-aca113826b6b/console.log" append="off"/>
Aug 03 05:09:08 user nova-compute[72444]:     </serial>
Aug 03 05:09:08 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 05:09:08 user nova-compute[72444]:     <video>
Aug 03 05:09:08 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:09:08 user nova-compute[72444]:     </video>
Aug 03 05:09:08 user nova-compute[72444]:     <rng model="virtio">
Aug 03 05:09:08 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 05:09:08 user nova-compute[72444]:     </rng>
Aug 03 05:09:08 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 05:09:08 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 05:09:08 user nova-compute[72444]:       <stats period="10"/>
Aug 03 05:09:08 user nova-compute[72444]:     </memballoon>
Aug 03 05:09:08 user nova-compute[72444]:   </devices>
Aug 03 05:09:08 user nova-compute[72444]: </domain>
Aug 03 05:09:08 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 05:09:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:08:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1598415921',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1598415921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1598415921',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIT5Hl3gXjbHQicmXYbJG1uN306r+f5uwmgo0j8Wwc+0Tq8mZ8mw+ceSC04uhHrGDjRijAgRvwk+EZzyPx96HnwWGfWCmJQuGWsYsoB4lVL0EnJfnfTcHbtRaPEX3dFmFA==',key_name='tempest-keypair-140047733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae931112fcda4e2f8dfd4f540d905139',ramdisk_id='',reservation_id='r-cx0q5956',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1788747136',owner_user_name='tempest-TestVolumeBootPattern-1788747136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:08:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef4d8130e33c4d9ea44c29be12f18234',uuid=bf8b022e-eb3d-4315-b2fe-aca113826b6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9c036ff-c273-42a7-9add-024d41a7b0be", "address": "fa:16:3e:41:62:4d", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c036ff-c2", "ovs_interfaceid": "d9c036ff-c273-42a7-9add-024d41a7b0be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 05:09:08 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Converting VIF {"id": "d9c036ff-c273-42a7-9add-024d41a7b0be", "address": "fa:16:3e:41:62:4d", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c036ff-c2", "ovs_interfaceid": "d9c036ff-c273-42a7-9add-024d41a7b0be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:09:08 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:62:4d,bridge_name='br-int',has_traffic_filtering=True,id=d9c036ff-c273-42a7-9add-024d41a7b0be,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9c036ff-c2') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:09:08 user nova-compute[72444]: DEBUG os_vif [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:62:4d,bridge_name='br-int',has_traffic_filtering=True,id=d9c036ff-c273-42a7-9add-024d41a7b0be,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9c036ff-c2') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 05:09:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:09:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:09:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 05:09:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:09:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9c036ff-c2, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:09:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd9c036ff-c2, col_values=(('external_ids', {'iface-id': 'd9c036ff-c273-42a7-9add-024d41a7b0be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:62:4d', 'vm-uuid': 'bf8b022e-eb3d-4315-b2fe-aca113826b6b'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:09:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:09:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:09:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:09:08 user nova-compute[72444]: INFO os_vif [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:62:4d,bridge_name='br-int',has_traffic_filtering=True,id=d9c036ff-c273-42a7-9add-024d41a7b0be,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9c036ff-c2')
Aug 03 05:09:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:09:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] No VIF found with MAC fa:16:3e:41:62:4d, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 05:09:08 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:09:08 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:09:08 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Rebuilding the list of instances to heal {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 05:09:08 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Skipping network cache update for instance because it is Building. {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 03 05:09:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-f58f50ed-c8f1-4468-b919-0a5aa3d630b3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:09:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-f58f50ed-c8f1-4468-b919-0a5aa3d630b3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:09:08 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 05:09:08 user nova-compute[72444]: DEBUG nova.objects.instance [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lazy-loading 'info_cache' on Instance uuid f58f50ed-c8f1-4468-b919-0a5aa3d630b3 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:09:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:09:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:09:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:09:09 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Updating instance_info_cache with network_info: [{"id": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "address": "fa:16:3e:c7:96:a3", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b70ab9-69", "ovs_interfaceid": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:09:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-f58f50ed-c8f1-4468-b919-0a5aa3d630b3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:09:09 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 05:09:09 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:09:09 user nova-compute[72444]: DEBUG nova.compute.manager [req-6ed14e9a-9c32-436e-942f-1c0b8c66d3e5 req-792d79ca-64d1-43ef-9f87-c1718be6f723 service nova] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Received event network-vif-plugged-d9c036ff-c273-42a7-9add-024d41a7b0be {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:09:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6ed14e9a-9c32-436e-942f-1c0b8c66d3e5 req-792d79ca-64d1-43ef-9f87-c1718be6f723 service nova] Acquiring lock "bf8b022e-eb3d-4315-b2fe-aca113826b6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:09:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6ed14e9a-9c32-436e-942f-1c0b8c66d3e5 req-792d79ca-64d1-43ef-9f87-c1718be6f723 service nova] Lock "bf8b022e-eb3d-4315-b2fe-aca113826b6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:09:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6ed14e9a-9c32-436e-942f-1c0b8c66d3e5 req-792d79ca-64d1-43ef-9f87-c1718be6f723 service nova] Lock "bf8b022e-eb3d-4315-b2fe-aca113826b6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:09:09 user nova-compute[72444]: DEBUG nova.compute.manager [req-6ed14e9a-9c32-436e-942f-1c0b8c66d3e5 req-792d79ca-64d1-43ef-9f87-c1718be6f723 service nova] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] No waiting events found dispatching network-vif-plugged-d9c036ff-c273-42a7-9add-024d41a7b0be {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:09:09 user nova-compute[72444]: WARNING nova.compute.manager [req-6ed14e9a-9c32-436e-942f-1c0b8c66d3e5 req-792d79ca-64d1-43ef-9f87-c1718be6f723 service nova] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Received unexpected event network-vif-plugged-d9c036ff-c273-42a7-9add-024d41a7b0be for instance with vm_state building and task_state spawning.
Aug 03 05:09:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:09:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:09:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:09:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:09:10 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:09:10 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:09:11 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691039351.6624389, bf8b022e-eb3d-4315-b2fe-aca113826b6b => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:09:11 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] VM Resumed (Lifecycle Event)
Aug 03 05:09:11 user nova-compute[72444]: DEBUG nova.compute.manager [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 05:09:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 05:09:11 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Instance spawned successfully.
Aug 03 05:09:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 05:09:11 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:09:11 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:09:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:09:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:09:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:09:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:09:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:09:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:09:11 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 05:09:11 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691039351.6638916, bf8b022e-eb3d-4315-b2fe-aca113826b6b => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:09:11 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] VM Started (Lifecycle Event)
Aug 03 05:09:11 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:09:11 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:09:11 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 05:09:11 user nova-compute[72444]: INFO nova.compute.manager [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Took 5.06 seconds to spawn the instance on the hypervisor.
Aug 03 05:09:11 user nova-compute[72444]: DEBUG nova.compute.manager [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:09:11 user nova-compute[72444]: INFO nova.compute.manager [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Took 13.72 seconds to build instance.
Aug 03 05:09:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-92a24704-48e2-4a8d-ad93-cb682419f8d3 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "bf8b022e-eb3d-4315-b2fe-aca113826b6b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.816s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:09:11 user nova-compute[72444]: DEBUG nova.compute.manager [req-e603c473-b23f-4d69-80e8-cea262fe5fe1 req-989e6dd5-74c6-45bc-a545-1ebca978767f service nova] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Received event network-vif-plugged-d9c036ff-c273-42a7-9add-024d41a7b0be {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:09:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e603c473-b23f-4d69-80e8-cea262fe5fe1 req-989e6dd5-74c6-45bc-a545-1ebca978767f service nova] Acquiring lock "bf8b022e-eb3d-4315-b2fe-aca113826b6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:09:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e603c473-b23f-4d69-80e8-cea262fe5fe1 req-989e6dd5-74c6-45bc-a545-1ebca978767f service nova] Lock "bf8b022e-eb3d-4315-b2fe-aca113826b6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:09:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e603c473-b23f-4d69-80e8-cea262fe5fe1 req-989e6dd5-74c6-45bc-a545-1ebca978767f service nova] Lock "bf8b022e-eb3d-4315-b2fe-aca113826b6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:09:11 user nova-compute[72444]: DEBUG nova.compute.manager [req-e603c473-b23f-4d69-80e8-cea262fe5fe1 req-989e6dd5-74c6-45bc-a545-1ebca978767f service nova] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] No waiting events found dispatching network-vif-plugged-d9c036ff-c273-42a7-9add-024d41a7b0be {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:09:11 user nova-compute[72444]: WARNING nova.compute.manager [req-e603c473-b23f-4d69-80e8-cea262fe5fe1 req-989e6dd5-74c6-45bc-a545-1ebca978767f service nova] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Received unexpected event network-vif-plugged-d9c036ff-c273-42a7-9add-024d41a7b0be for instance with vm_state active and task_state None.
Aug 03 05:09:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:09:13 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:09:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:09:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:09:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:09:13 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:09:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 05:09:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:09:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:09:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:09:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:09:14 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:09:14 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:09:14 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=8623MB free_disk=25.441997528076172GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:09:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:09:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:09:14 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance f58f50ed-c8f1-4468-b919-0a5aa3d630b3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:09:14 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance bf8b022e-eb3d-4315-b2fe-aca113826b6b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:09:14 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:09:14 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:09:14 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:09:15 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:09:15 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:09:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:09:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:09:16 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:09:18 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:09:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:09:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:09:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:09:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:09:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:09:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:09:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:09:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:09:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:09:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:09:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:09:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:09:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:09:43 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:09:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:09:48 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:09:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:09:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:09:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:09:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:09:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:09:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:09:57 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:09:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:02 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:10:02 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:10:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Acquiring lock "685818c7-b515-4118-a952-a52a5942c4e3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:10:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lock "685818c7-b515-4118-a952-a52a5942c4e3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:10:05 user nova-compute[72444]: DEBUG nova.compute.manager [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 05:10:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:10:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:10:05 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 05:10:05 user nova-compute[72444]: INFO nova.compute.claims [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Claim successful on node user
Aug 03 05:10:05 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:10:05 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:10:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.212s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:10:05 user nova-compute[72444]: DEBUG nova.compute.manager [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 05:10:05 user nova-compute[72444]: DEBUG nova.compute.manager [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 05:10:05 user nova-compute[72444]: DEBUG nova.network.neutron [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 05:10:05 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 05:10:05 user nova-compute[72444]: DEBUG nova.compute.manager [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 05:10:05 user nova-compute[72444]: DEBUG nova.policy [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '566ccf33576b48dd8efe2427e8410d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df9034b591f2496fbef89f59646a31cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 05:10:05 user nova-compute[72444]: INFO nova.virt.block_device [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Booting with volume 0297ed59-1a10-41d1-8550-7e7cdc0b471c at /dev/vda
Aug 03 05:10:05 user nova-compute[72444]: DEBUG os_brick.utils [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:10:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:10:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:10:05 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[202db7e8-bf0a-4719-a185-666da82ea620]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:10:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:10:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:10:05 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ecbf68-d6a8-49e9-86f8-4e68c43c6a0e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:10:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:10:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:10:05 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a062f0e3-356b-4dd4-97a4-17637e06aa8c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:10:05 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[078a78f6-8a53-44b5-a792-16885ac4b020]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:10:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:10:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:10:05 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 05:10:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:10:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:10:05 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 05:10:05 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a7232b-8f82-47bd-ad2c-7e36fc8bc5ec]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:10:05 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 05:10:05 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 05:10:05 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 05:10:05 user nova-compute[72444]: DEBUG os_brick.utils [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:10:05 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Updating existing volume attachment record: d8b4776d-0506-4516-8a0d-1caec7d4f8e3 {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 05:10:06 user nova-compute[72444]: DEBUG nova.network.neutron [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Successfully created port: 15762642-ded6-4ef6-90c7-46bf3a884904 {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 05:10:07 user nova-compute[72444]: DEBUG nova.network.neutron [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Successfully updated port: 15762642-ded6-4ef6-90c7-46bf3a884904 {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 05:10:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Acquiring lock "refresh_cache-685818c7-b515-4118-a952-a52a5942c4e3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:10:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Acquired lock "refresh_cache-685818c7-b515-4118-a952-a52a5942c4e3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:10:07 user nova-compute[72444]: DEBUG nova.network.neutron [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 05:10:07 user nova-compute[72444]: DEBUG nova.compute.manager [req-7711a17a-0b30-40a8-83f8-7f89e2c98c12 req-a26dce5c-7989-4b5e-b94c-6c1a6ccb1455 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Received event network-changed-15762642-ded6-4ef6-90c7-46bf3a884904 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:10:07 user nova-compute[72444]: DEBUG nova.compute.manager [req-7711a17a-0b30-40a8-83f8-7f89e2c98c12 req-a26dce5c-7989-4b5e-b94c-6c1a6ccb1455 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Refreshing instance network info cache due to event network-changed-15762642-ded6-4ef6-90c7-46bf3a884904. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:10:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7711a17a-0b30-40a8-83f8-7f89e2c98c12 req-a26dce5c-7989-4b5e-b94c-6c1a6ccb1455 service nova] Acquiring lock "refresh_cache-685818c7-b515-4118-a952-a52a5942c4e3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:10:07 user nova-compute[72444]: DEBUG nova.network.neutron [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 05:10:07 user nova-compute[72444]: DEBUG nova.network.neutron [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Updating instance_info_cache with network_info: [{"id": "15762642-ded6-4ef6-90c7-46bf3a884904", "address": "fa:16:3e:9b:fd:92", "network": {"id": "7057d5fc-5467-4681-8ed0-5243099b3df3", "bridge": "br-int", "label": "tempest-TestShelveInstance-5073894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df9034b591f2496fbef89f59646a31cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15762642-de", "ovs_interfaceid": "15762642-ded6-4ef6-90c7-46bf3a884904", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:10:07 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:10:07 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:10:07 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 05:10:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Releasing lock "refresh_cache-685818c7-b515-4118-a952-a52a5942c4e3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:10:07 user nova-compute[72444]: DEBUG nova.compute.manager [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Instance network_info: |[{"id": "15762642-ded6-4ef6-90c7-46bf3a884904", "address": "fa:16:3e:9b:fd:92", "network": {"id": "7057d5fc-5467-4681-8ed0-5243099b3df3", "bridge": "br-int", "label": "tempest-TestShelveInstance-5073894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df9034b591f2496fbef89f59646a31cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15762642-de", "ovs_interfaceid": "15762642-ded6-4ef6-90c7-46bf3a884904", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 05:10:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7711a17a-0b30-40a8-83f8-7f89e2c98c12 req-a26dce5c-7989-4b5e-b94c-6c1a6ccb1455 service nova] Acquired lock "refresh_cache-685818c7-b515-4118-a952-a52a5942c4e3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:10:07 user nova-compute[72444]: DEBUG nova.network.neutron [req-7711a17a-0b30-40a8-83f8-7f89e2c98c12 req-a26dce5c-7989-4b5e-b94c-6c1a6ccb1455 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Refreshing network info cache for port 15762642-ded6-4ef6-90c7-46bf3a884904 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:10:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:08 user nova-compute[72444]: DEBUG nova.network.neutron [req-7711a17a-0b30-40a8-83f8-7f89e2c98c12 req-a26dce5c-7989-4b5e-b94c-6c1a6ccb1455 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Updated VIF entry in instance network info cache for port 15762642-ded6-4ef6-90c7-46bf3a884904. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:10:08 user nova-compute[72444]: DEBUG nova.network.neutron [req-7711a17a-0b30-40a8-83f8-7f89e2c98c12 req-a26dce5c-7989-4b5e-b94c-6c1a6ccb1455 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Updating instance_info_cache with network_info: [{"id": "15762642-ded6-4ef6-90c7-46bf3a884904", "address": "fa:16:3e:9b:fd:92", "network": {"id": "7057d5fc-5467-4681-8ed0-5243099b3df3", "bridge": "br-int", "label": "tempest-TestShelveInstance-5073894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df9034b591f2496fbef89f59646a31cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15762642-de", "ovs_interfaceid": "15762642-ded6-4ef6-90c7-46bf3a884904", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:10:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-7711a17a-0b30-40a8-83f8-7f89e2c98c12 req-a26dce5c-7989-4b5e-b94c-6c1a6ccb1455 service nova] Releasing lock "refresh_cache-685818c7-b515-4118-a952-a52a5942c4e3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:10:08 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:10:09 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:10:09 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:10:09 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Rebuilding the list of instances to heal {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 05:10:09 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Skipping network cache update for instance because it is Building. {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 03 05:10:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-f58f50ed-c8f1-4468-b919-0a5aa3d630b3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:10:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-f58f50ed-c8f1-4468-b919-0a5aa3d630b3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:10:10 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 05:10:10 user nova-compute[72444]: DEBUG nova.objects.instance [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lazy-loading 'info_cache' on Instance uuid f58f50ed-c8f1-4468-b919-0a5aa3d630b3 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:10:10 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Updating instance_info_cache with network_info: [{"id": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "address": "fa:16:3e:c7:96:a3", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b70ab9-69", "ovs_interfaceid": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:10:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-f58f50ed-c8f1-4468-b919-0a5aa3d630b3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:10:10 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 05:10:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:11 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG nova.compute.manager [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 05:10:13 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Creating image(s)
Aug 03 05:10:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Did not create local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Ensure instance console log exists: /opt/stack/data/nova/instances/685818c7-b515-4118-a952-a52a5942c4e3/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Start _get_guest_xml network_info=[{"id": "15762642-ded6-4ef6-90c7-46bf3a884904", "address": "fa:16:3e:9b:fd:92", "network": {"id": "7057d5fc-5467-4681-8ed0-5243099b3df3", "bridge": "br-int", "label": "tempest-TestShelveInstance-5073894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df9034b591f2496fbef89f59646a31cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15762642-de", "ovs_interfaceid": "15762642-ded6-4ef6-90c7-46bf3a884904", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MGJqnglX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '685818c7-b515-4118-a952-a52a5942c4e3', 'attached_at': '', 'detached_at': '', 'volume_id': '0297ed59-1a10-41d1-8550-7e7cdc0b471c', 'serial': '0297ed59-1a10-41d1-8550-7e7cdc0b471c'}, 'disk_bus': 'virtio', 'attachment_id': 'd8b4776d-0506-4516-8a0d-1caec7d4f8e3', 'guest_format': None, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 05:10:13 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:10:13 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:10:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MGJqnglX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:10:13 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:10:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:10:13 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:10:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:10:13 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 05:10:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a431762-1384-48e2-82b7-58759b5e711e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 05:10:13 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2725e233-313b-41cd-9b19-1ff6b415b191]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c] added
Aug 03 05:10:13 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b1b1b9-c789-4a82-ae6a-32452b66ad91]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[388c4f10-84d0-4346-bb4a-aa7e4042ab06]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MGJqnglX {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MGJqnglX" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aebb193-d555-4e25-9240-73d0be9ec669]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MGJqnglX'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec026b9a-2e80-4174-93a8-39023f406f1e]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4fdc08-43b9-4a15-b8c7-10ce46228182]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 (non-flash)
Aug 03 05:10:13 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 (non-flash)
Aug 03 05:10:13 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0921b5c0-54d0-4812-be4f-5ae6fd86cca8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c, portal: 172.16.0.220,3260]
Aug 03 05:10:13 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c, portal: 172.16.0.220,3260] successful.
Aug 03 05:10:13 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebb3568-d36f-4e4a-a38f-efa012dbf59e]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[394e5dc0-37cf-4b5e-83f7-d6a366768585]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 (non-flash)
Aug 03 05:10:13 user nova-compute[72444]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c (non-flash)
Aug 03 05:10:13 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 (non-flash)
Aug 03 05:10:13 user nova-compute[72444]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c (non-flash)
Aug 03 05:10:13 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2757c6-6006-4404-91df-ae2644bd6768]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 05:10:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MGJqnglX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 05:10:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:10:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23030326332383864', 'path': '/dev/sdc'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:10:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030326332383864', 'path': '/dev/sdc'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 05:10:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:10:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1129121706',display_name='tempest-TestShelveInstance-server-1129121706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1129121706',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhnSFVSYyIoliFKyFB/B2Z+tXspOpFn6D6+zix3bZV/aAGwrmK7q42wnCb91aouVv1HXPq8ltR87nVyNr/0W7/IY0epB+HwKN3DG0chjc7bQOjfwdtSWQxRujXjqbiSPQ==',key_name='tempest-TestShelveInstance-18244009',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df9034b591f2496fbef89f59646a31cc',ramdisk_id='',reservation_id='r-cyiehe4p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-98284952',owner_user_name='tempest-TestShelveInstance-98284952-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:10:06Z,user_data=None,user_id='566ccf33576b48dd8efe2427e8410d62',uuid=685818c7-b515-4118-a952-a52a5942c4e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15762642-ded6-4ef6-90c7-46bf3a884904", "address": "fa:16:3e:9b:fd:92", "network": {"id": "7057d5fc-5467-4681-8ed0-5243099b3df3", "bridge": "br-int", "label": "tempest-TestShelveInstance-5073894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df9034b591f2496fbef89f59646a31cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15762642-de", "ovs_interfaceid": "15762642-ded6-4ef6-90c7-46bf3a884904", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 05:10:14 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Converting VIF {"id": "15762642-ded6-4ef6-90c7-46bf3a884904", "address": "fa:16:3e:9b:fd:92", "network": {"id": "7057d5fc-5467-4681-8ed0-5243099b3df3", "bridge": "br-int", "label": "tempest-TestShelveInstance-5073894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df9034b591f2496fbef89f59646a31cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15762642-de", "ovs_interfaceid": "15762642-ded6-4ef6-90c7-46bf3a884904", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:10:14 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:fd:92,bridge_name='br-int',has_traffic_filtering=True,id=15762642-ded6-4ef6-90c7-46bf3a884904,network=Network(7057d5fc-5467-4681-8ed0-5243099b3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15762642-de') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:10:14 user nova-compute[72444]: DEBUG nova.objects.instance [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lazy-loading 'pci_devices' on Instance uuid 685818c7-b515-4118-a952-a52a5942c4e3 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:10:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] End _get_guest_xml xml=<domain type="kvm">
Aug 03 05:10:14 user nova-compute[72444]:   <uuid>685818c7-b515-4118-a952-a52a5942c4e3</uuid>
Aug 03 05:10:14 user nova-compute[72444]:   <name>instance-0000002b</name>
Aug 03 05:10:14 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 05:10:14 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 05:10:14 user nova-compute[72444]:   <metadata>
Aug 03 05:10:14 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 05:10:14 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 05:10:14 user nova-compute[72444]:       <nova:name>tempest-TestShelveInstance-server-1129121706</nova:name>
Aug 03 05:10:14 user nova-compute[72444]:       <nova:creationTime>2023-08-03 05:10:13</nova:creationTime>
Aug 03 05:10:14 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 05:10:14 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 05:10:14 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 05:10:14 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 05:10:14 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 05:10:14 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 05:10:14 user nova-compute[72444]:       </nova:flavor>
Aug 03 05:10:14 user nova-compute[72444]:       <nova:owner>
Aug 03 05:10:14 user nova-compute[72444]:         <nova:user uuid="566ccf33576b48dd8efe2427e8410d62">tempest-TestShelveInstance-98284952-project-member</nova:user>
Aug 03 05:10:14 user nova-compute[72444]:         <nova:project uuid="df9034b591f2496fbef89f59646a31cc">tempest-TestShelveInstance-98284952</nova:project>
Aug 03 05:10:14 user nova-compute[72444]:       </nova:owner>
Aug 03 05:10:14 user nova-compute[72444]:       <nova:ports>
Aug 03 05:10:14 user nova-compute[72444]:         <nova:port uuid="15762642-ded6-4ef6-90c7-46bf3a884904">
Aug 03 05:10:14 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 03 05:10:14 user nova-compute[72444]:         </nova:port>
Aug 03 05:10:14 user nova-compute[72444]:       </nova:ports>
Aug 03 05:10:14 user nova-compute[72444]:     </nova:instance>
Aug 03 05:10:14 user nova-compute[72444]:   </metadata>
Aug 03 05:10:14 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 05:10:14 user nova-compute[72444]:     <system>
Aug 03 05:10:14 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 05:10:14 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 05:10:14 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 05:10:14 user nova-compute[72444]:       <entry name="serial">685818c7-b515-4118-a952-a52a5942c4e3</entry>
Aug 03 05:10:14 user nova-compute[72444]:       <entry name="uuid">685818c7-b515-4118-a952-a52a5942c4e3</entry>
Aug 03 05:10:14 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 05:10:14 user nova-compute[72444]:     </system>
Aug 03 05:10:14 user nova-compute[72444]:   </sysinfo>
Aug 03 05:10:14 user nova-compute[72444]:   <os>
Aug 03 05:10:14 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 05:10:14 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 05:10:14 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 05:10:14 user nova-compute[72444]:   </os>
Aug 03 05:10:14 user nova-compute[72444]:   <features>
Aug 03 05:10:14 user nova-compute[72444]:     <acpi/>
Aug 03 05:10:14 user nova-compute[72444]:     <apic/>
Aug 03 05:10:14 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 05:10:14 user nova-compute[72444]:   </features>
Aug 03 05:10:14 user nova-compute[72444]:   <clock offset="utc">
Aug 03 05:10:14 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 05:10:14 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 05:10:14 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 05:10:14 user nova-compute[72444]:   </clock>
Aug 03 05:10:14 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 05:10:14 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 05:10:14 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 05:10:14 user nova-compute[72444]:   </cpu>
Aug 03 05:10:14 user nova-compute[72444]:   <devices>
Aug 03 05:10:14 user nova-compute[72444]:     <disk type="block" device="disk">
Aug 03 05:10:14 user nova-compute[72444]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:10:14 user nova-compute[72444]:       <source dev="/dev/sdc"/>
Aug 03 05:10:14 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 05:10:14 user nova-compute[72444]:       <serial>0297ed59-1a10-41d1-8550-7e7cdc0b471c</serial>
Aug 03 05:10:14 user nova-compute[72444]:     </disk>
Aug 03 05:10:14 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 05:10:14 user nova-compute[72444]:       <mac address="fa:16:3e:9b:fd:92"/>
Aug 03 05:10:14 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:10:14 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 05:10:14 user nova-compute[72444]:       <target dev="tap15762642-de"/>
Aug 03 05:10:14 user nova-compute[72444]:     </interface>
Aug 03 05:10:14 user nova-compute[72444]:     <serial type="pty">
Aug 03 05:10:14 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/685818c7-b515-4118-a952-a52a5942c4e3/console.log" append="off"/>
Aug 03 05:10:14 user nova-compute[72444]:     </serial>
Aug 03 05:10:14 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 05:10:14 user nova-compute[72444]:     <video>
Aug 03 05:10:14 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:10:14 user nova-compute[72444]:     </video>
Aug 03 05:10:14 user nova-compute[72444]:     <rng model="virtio">
Aug 03 05:10:14 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 05:10:14 user nova-compute[72444]:     </rng>
Aug 03 05:10:14 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 05:10:14 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 05:10:14 user nova-compute[72444]:       <stats period="10"/>
Aug 03 05:10:14 user nova-compute[72444]:     </memballoon>
Aug 03 05:10:14 user nova-compute[72444]:   </devices>
Aug 03 05:10:14 user nova-compute[72444]: </domain>
Aug 03 05:10:14 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 05:10:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:10:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1129121706',display_name='tempest-TestShelveInstance-server-1129121706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1129121706',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhnSFVSYyIoliFKyFB/B2Z+tXspOpFn6D6+zix3bZV/aAGwrmK7q42wnCb91aouVv1HXPq8ltR87nVyNr/0W7/IY0epB+HwKN3DG0chjc7bQOjfwdtSWQxRujXjqbiSPQ==',key_name='tempest-TestShelveInstance-18244009',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df9034b591f2496fbef89f59646a31cc',ramdisk_id='',reservation_id='r-cyiehe4p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-98284952',owner_user_name='tempest-TestShelveInstance-98284952-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:10:06Z,user_data=None,user_id='566ccf33576b48dd8efe2427e8410d62',uuid=685818c7-b515-4118-a952-a52a5942c4e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15762642-ded6-4ef6-90c7-46bf3a884904", "address": "fa:16:3e:9b:fd:92", "network": {"id": "7057d5fc-5467-4681-8ed0-5243099b3df3", "bridge": "br-int", "label": "tempest-TestShelveInstance-5073894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df9034b591f2496fbef89f59646a31cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15762642-de", "ovs_interfaceid": "15762642-ded6-4ef6-90c7-46bf3a884904", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 05:10:14 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Converting VIF {"id": "15762642-ded6-4ef6-90c7-46bf3a884904", "address": "fa:16:3e:9b:fd:92", "network": {"id": "7057d5fc-5467-4681-8ed0-5243099b3df3", "bridge": "br-int", "label": "tempest-TestShelveInstance-5073894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df9034b591f2496fbef89f59646a31cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15762642-de", "ovs_interfaceid": "15762642-ded6-4ef6-90c7-46bf3a884904", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:10:14 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:fd:92,bridge_name='br-int',has_traffic_filtering=True,id=15762642-ded6-4ef6-90c7-46bf3a884904,network=Network(7057d5fc-5467-4681-8ed0-5243099b3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15762642-de') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:10:14 user nova-compute[72444]: DEBUG os_vif [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:fd:92,bridge_name='br-int',has_traffic_filtering=True,id=15762642-ded6-4ef6-90c7-46bf3a884904,network=Network(7057d5fc-5467-4681-8ed0-5243099b3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15762642-de') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 05:10:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:10:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 05:10:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15762642-de, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:10:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap15762642-de, col_values=(('external_ids', {'iface-id': '15762642-ded6-4ef6-90c7-46bf3a884904', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:fd:92', 'vm-uuid': '685818c7-b515-4118-a952-a52a5942c4e3'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:10:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:10:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:14 user nova-compute[72444]: INFO os_vif [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:fd:92,bridge_name='br-int',has_traffic_filtering=True,id=15762642-ded6-4ef6-90c7-46bf3a884904,network=Network(7057d5fc-5467-4681-8ed0-5243099b3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15762642-de')
Aug 03 05:10:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:10:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] No VIF found with MAC fa:16:3e:9b:fd:92, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 05:10:14 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:10:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:10:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:10:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:10:14 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:10:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:16 user nova-compute[72444]: DEBUG nova.compute.manager [req-9f78aa31-60c8-4ea1-be0c-52d8fbbd766e req-1d530fc1-cf58-47e7-88e1-c5201d0187d3 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Received event network-vif-plugged-15762642-ded6-4ef6-90c7-46bf3a884904 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:10:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9f78aa31-60c8-4ea1-be0c-52d8fbbd766e req-1d530fc1-cf58-47e7-88e1-c5201d0187d3 service nova] Acquiring lock "685818c7-b515-4118-a952-a52a5942c4e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:10:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9f78aa31-60c8-4ea1-be0c-52d8fbbd766e req-1d530fc1-cf58-47e7-88e1-c5201d0187d3 service nova] Lock "685818c7-b515-4118-a952-a52a5942c4e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:10:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9f78aa31-60c8-4ea1-be0c-52d8fbbd766e req-1d530fc1-cf58-47e7-88e1-c5201d0187d3 service nova] Lock "685818c7-b515-4118-a952-a52a5942c4e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:10:16 user nova-compute[72444]: DEBUG nova.compute.manager [req-9f78aa31-60c8-4ea1-be0c-52d8fbbd766e req-1d530fc1-cf58-47e7-88e1-c5201d0187d3 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] No waiting events found dispatching network-vif-plugged-15762642-ded6-4ef6-90c7-46bf3a884904 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:10:16 user nova-compute[72444]: WARNING nova.compute.manager [req-9f78aa31-60c8-4ea1-be0c-52d8fbbd766e req-1d530fc1-cf58-47e7-88e1-c5201d0187d3 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Received unexpected event network-vif-plugged-15762642-ded6-4ef6-90c7-46bf3a884904 for instance with vm_state building and task_state spawning.
Aug 03 05:10:16 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 05:10:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:10:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:10:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:10:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:10:16 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 05:10:18 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691039418.1859264, 685818c7-b515-4118-a952-a52a5942c4e3 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:10:18 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] VM Resumed (Lifecycle Event)
Aug 03 05:10:18 user nova-compute[72444]: DEBUG nova.compute.manager [req-07252c7b-4fe7-474d-b4c6-f0f055b91f82 req-bd7c8ee0-72e3-45cf-bcc5-290d091083e6 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Received event network-vif-plugged-15762642-ded6-4ef6-90c7-46bf3a884904 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:10:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-07252c7b-4fe7-474d-b4c6-f0f055b91f82 req-bd7c8ee0-72e3-45cf-bcc5-290d091083e6 service nova] Acquiring lock "685818c7-b515-4118-a952-a52a5942c4e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:10:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-07252c7b-4fe7-474d-b4c6-f0f055b91f82 req-bd7c8ee0-72e3-45cf-bcc5-290d091083e6 service nova] Lock "685818c7-b515-4118-a952-a52a5942c4e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:10:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-07252c7b-4fe7-474d-b4c6-f0f055b91f82 req-bd7c8ee0-72e3-45cf-bcc5-290d091083e6 service nova] Lock "685818c7-b515-4118-a952-a52a5942c4e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:10:18 user nova-compute[72444]: DEBUG nova.compute.manager [req-07252c7b-4fe7-474d-b4c6-f0f055b91f82 req-bd7c8ee0-72e3-45cf-bcc5-290d091083e6 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] No waiting events found dispatching network-vif-plugged-15762642-ded6-4ef6-90c7-46bf3a884904 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:10:18 user nova-compute[72444]: WARNING nova.compute.manager [req-07252c7b-4fe7-474d-b4c6-f0f055b91f82 req-bd7c8ee0-72e3-45cf-bcc5-290d091083e6 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Received unexpected event network-vif-plugged-15762642-ded6-4ef6-90c7-46bf3a884904 for instance with vm_state building and task_state spawning.
Aug 03 05:10:18 user nova-compute[72444]: DEBUG nova.compute.manager [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 05:10:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 05:10:18 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:10:18 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:10:18 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=8564MB free_disk=25.431209564208984GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:10:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:10:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:10:18 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Instance spawned successfully.
Aug 03 05:10:18 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:10:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 05:10:18 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:10:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:10:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:10:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:10:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:10:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:10:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:10:18 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 05:10:18 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691039418.1867907, 685818c7-b515-4118-a952-a52a5942c4e3 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:10:18 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] VM Started (Lifecycle Event)
Aug 03 05:10:18 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:10:18 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:10:18 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance f58f50ed-c8f1-4468-b919-0a5aa3d630b3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:10:18 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance bf8b022e-eb3d-4315-b2fe-aca113826b6b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:10:18 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 685818c7-b515-4118-a952-a52a5942c4e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:10:18 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:10:18 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:10:18 user nova-compute[72444]: INFO nova.compute.manager [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Took 5.20 seconds to spawn the instance on the hypervisor.
Aug 03 05:10:18 user nova-compute[72444]: DEBUG nova.compute.manager [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:10:18 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 05:10:18 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:10:18 user nova-compute[72444]: INFO nova.compute.manager [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Took 13.33 seconds to build instance.
Aug 03 05:10:18 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:10:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-e67e177d-9160-4366-b775-3a0f2cfb695f tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lock "685818c7-b515-4118-a952-a52a5942c4e3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.429s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:10:18 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:10:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:10:19 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:10:19 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:22 user nova-compute[72444]: DEBUG nova.compute.manager [req-50c2c399-0077-4c50-9ba7-b81b61c7f1ab req-7b4aa471-5f73-4663-b02c-57e363993269 service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Received event network-changed-13b70ab9-69cc-4d4f-9a8a-a100d1401730 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:10:22 user nova-compute[72444]: DEBUG nova.compute.manager [req-50c2c399-0077-4c50-9ba7-b81b61c7f1ab req-7b4aa471-5f73-4663-b02c-57e363993269 service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Refreshing instance network info cache due to event network-changed-13b70ab9-69cc-4d4f-9a8a-a100d1401730. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:10:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-50c2c399-0077-4c50-9ba7-b81b61c7f1ab req-7b4aa471-5f73-4663-b02c-57e363993269 service nova] Acquiring lock "refresh_cache-f58f50ed-c8f1-4468-b919-0a5aa3d630b3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:10:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-50c2c399-0077-4c50-9ba7-b81b61c7f1ab req-7b4aa471-5f73-4663-b02c-57e363993269 service nova] Acquired lock "refresh_cache-f58f50ed-c8f1-4468-b919-0a5aa3d630b3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:10:22 user nova-compute[72444]: DEBUG nova.network.neutron [req-50c2c399-0077-4c50-9ba7-b81b61c7f1ab req-7b4aa471-5f73-4663-b02c-57e363993269 service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Refreshing network info cache for port 13b70ab9-69cc-4d4f-9a8a-a100d1401730 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:10:22 user nova-compute[72444]: DEBUG nova.network.neutron [req-50c2c399-0077-4c50-9ba7-b81b61c7f1ab req-7b4aa471-5f73-4663-b02c-57e363993269 service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Updated VIF entry in instance network info cache for port 13b70ab9-69cc-4d4f-9a8a-a100d1401730. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:10:22 user nova-compute[72444]: DEBUG nova.network.neutron [req-50c2c399-0077-4c50-9ba7-b81b61c7f1ab req-7b4aa471-5f73-4663-b02c-57e363993269 service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Updating instance_info_cache with network_info: [{"id": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "address": "fa:16:3e:c7:96:a3", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b70ab9-69", "ovs_interfaceid": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:10:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-50c2c399-0077-4c50-9ba7-b81b61c7f1ab req-7b4aa471-5f73-4663-b02c-57e363993269 service nova] Releasing lock "refresh_cache-f58f50ed-c8f1-4468-b919-0a5aa3d630b3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:10:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-90ce48b8-49ec-4463-828b-577a4a7baa56 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:10:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-90ce48b8-49ec-4463-828b-577a4a7baa56 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:10:27 user nova-compute[72444]: INFO nova.compute.manager [None req-90ce48b8-49ec-4463-828b-577a4a7baa56 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Shelving
Aug 03 05:10:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:28 user nova-compute[72444]: DEBUG nova.compute.manager [req-8c818c1e-6edb-4dcc-bec2-0c40988b8dfc req-68315cf3-83ec-40d7-8ad9-7538ff2c0166 service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Received event network-vif-unplugged-13b70ab9-69cc-4d4f-9a8a-a100d1401730 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:10:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8c818c1e-6edb-4dcc-bec2-0c40988b8dfc req-68315cf3-83ec-40d7-8ad9-7538ff2c0166 service nova] Acquiring lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:10:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8c818c1e-6edb-4dcc-bec2-0c40988b8dfc req-68315cf3-83ec-40d7-8ad9-7538ff2c0166 service nova] Lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:10:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8c818c1e-6edb-4dcc-bec2-0c40988b8dfc req-68315cf3-83ec-40d7-8ad9-7538ff2c0166 service nova] Lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:10:28 user nova-compute[72444]: DEBUG nova.compute.manager [req-8c818c1e-6edb-4dcc-bec2-0c40988b8dfc req-68315cf3-83ec-40d7-8ad9-7538ff2c0166 service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] No waiting events found dispatching network-vif-unplugged-13b70ab9-69cc-4d4f-9a8a-a100d1401730 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:10:28 user nova-compute[72444]: WARNING nova.compute.manager [req-8c818c1e-6edb-4dcc-bec2-0c40988b8dfc req-68315cf3-83ec-40d7-8ad9-7538ff2c0166 service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Received unexpected event network-vif-unplugged-13b70ab9-69cc-4d4f-9a8a-a100d1401730 for instance with vm_state active and task_state shelving.
Aug 03 05:10:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:28 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Instance destroyed successfully.
Aug 03 05:10:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:28 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-90ce48b8-49ec-4463-828b-577a4a7baa56 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Beginning cold snapshot process
Aug 03 05:10:28 user nova-compute[72444]: DEBUG nova.privsep.utils [None req-90ce48b8-49ec-4463-828b-577a4a7baa56 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72444) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 03 05:10:28 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-90ce48b8-49ec-4463-828b-577a4a7baa56 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3/disk /opt/stack/data/nova/instances/snapshots/tmpp9rzf32n/dc192d3927c046ce80881b5afc9ca949 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:10:29 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:29 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:29 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:29 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:29 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-90ce48b8-49ec-4463-828b-577a4a7baa56 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3/disk /opt/stack/data/nova/instances/snapshots/tmpp9rzf32n/dc192d3927c046ce80881b5afc9ca949" returned: 0 in 0.758s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:10:29 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-90ce48b8-49ec-4463-828b-577a4a7baa56 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Snapshot extracted, beginning image upload
Aug 03 05:10:29 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:30 user nova-compute[72444]: DEBUG nova.compute.manager [req-0c59f2f0-9358-4894-a27b-28cdf9425412 req-3fe7b450-8836-4429-9165-55075620a52a service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Received event network-vif-plugged-13b70ab9-69cc-4d4f-9a8a-a100d1401730 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:10:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0c59f2f0-9358-4894-a27b-28cdf9425412 req-3fe7b450-8836-4429-9165-55075620a52a service nova] Acquiring lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:10:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0c59f2f0-9358-4894-a27b-28cdf9425412 req-3fe7b450-8836-4429-9165-55075620a52a service nova] Lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:10:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0c59f2f0-9358-4894-a27b-28cdf9425412 req-3fe7b450-8836-4429-9165-55075620a52a service nova] Lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:10:30 user nova-compute[72444]: DEBUG nova.compute.manager [req-0c59f2f0-9358-4894-a27b-28cdf9425412 req-3fe7b450-8836-4429-9165-55075620a52a service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] No waiting events found dispatching network-vif-plugged-13b70ab9-69cc-4d4f-9a8a-a100d1401730 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:10:30 user nova-compute[72444]: WARNING nova.compute.manager [req-0c59f2f0-9358-4894-a27b-28cdf9425412 req-3fe7b450-8836-4429-9165-55075620a52a service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Received unexpected event network-vif-plugged-13b70ab9-69cc-4d4f-9a8a-a100d1401730 for instance with vm_state active and task_state shelving_image_uploading.
Aug 03 05:10:30 user nova-compute[72444]: DEBUG nova.compute.manager [req-0c59f2f0-9358-4894-a27b-28cdf9425412 req-3fe7b450-8836-4429-9165-55075620a52a service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Received event network-vif-plugged-13b70ab9-69cc-4d4f-9a8a-a100d1401730 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:10:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0c59f2f0-9358-4894-a27b-28cdf9425412 req-3fe7b450-8836-4429-9165-55075620a52a service nova] Acquiring lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:10:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0c59f2f0-9358-4894-a27b-28cdf9425412 req-3fe7b450-8836-4429-9165-55075620a52a service nova] Lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:10:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0c59f2f0-9358-4894-a27b-28cdf9425412 req-3fe7b450-8836-4429-9165-55075620a52a service nova] Lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:10:30 user nova-compute[72444]: DEBUG nova.compute.manager [req-0c59f2f0-9358-4894-a27b-28cdf9425412 req-3fe7b450-8836-4429-9165-55075620a52a service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] No waiting events found dispatching network-vif-plugged-13b70ab9-69cc-4d4f-9a8a-a100d1401730 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:10:30 user nova-compute[72444]: WARNING nova.compute.manager [req-0c59f2f0-9358-4894-a27b-28cdf9425412 req-3fe7b450-8836-4429-9165-55075620a52a service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Received unexpected event network-vif-plugged-13b70ab9-69cc-4d4f-9a8a-a100d1401730 for instance with vm_state active and task_state shelving_image_uploading.
Aug 03 05:10:30 user nova-compute[72444]: DEBUG nova.compute.manager [req-0c59f2f0-9358-4894-a27b-28cdf9425412 req-3fe7b450-8836-4429-9165-55075620a52a service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Received event network-vif-plugged-13b70ab9-69cc-4d4f-9a8a-a100d1401730 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:10:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0c59f2f0-9358-4894-a27b-28cdf9425412 req-3fe7b450-8836-4429-9165-55075620a52a service nova] Acquiring lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:10:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0c59f2f0-9358-4894-a27b-28cdf9425412 req-3fe7b450-8836-4429-9165-55075620a52a service nova] Lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:10:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0c59f2f0-9358-4894-a27b-28cdf9425412 req-3fe7b450-8836-4429-9165-55075620a52a service nova] Lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:10:30 user nova-compute[72444]: DEBUG nova.compute.manager [req-0c59f2f0-9358-4894-a27b-28cdf9425412 req-3fe7b450-8836-4429-9165-55075620a52a service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] No waiting events found dispatching network-vif-plugged-13b70ab9-69cc-4d4f-9a8a-a100d1401730 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:10:30 user nova-compute[72444]: WARNING nova.compute.manager [req-0c59f2f0-9358-4894-a27b-28cdf9425412 req-3fe7b450-8836-4429-9165-55075620a52a service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Received unexpected event network-vif-plugged-13b70ab9-69cc-4d4f-9a8a-a100d1401730 for instance with vm_state active and task_state shelving_image_uploading.
Aug 03 05:10:30 user nova-compute[72444]: DEBUG nova.compute.manager [req-0c59f2f0-9358-4894-a27b-28cdf9425412 req-3fe7b450-8836-4429-9165-55075620a52a service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Received event network-vif-unplugged-13b70ab9-69cc-4d4f-9a8a-a100d1401730 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:10:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0c59f2f0-9358-4894-a27b-28cdf9425412 req-3fe7b450-8836-4429-9165-55075620a52a service nova] Acquiring lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:10:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0c59f2f0-9358-4894-a27b-28cdf9425412 req-3fe7b450-8836-4429-9165-55075620a52a service nova] Lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:10:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0c59f2f0-9358-4894-a27b-28cdf9425412 req-3fe7b450-8836-4429-9165-55075620a52a service nova] Lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:10:30 user nova-compute[72444]: DEBUG nova.compute.manager [req-0c59f2f0-9358-4894-a27b-28cdf9425412 req-3fe7b450-8836-4429-9165-55075620a52a service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] No waiting events found dispatching network-vif-unplugged-13b70ab9-69cc-4d4f-9a8a-a100d1401730 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:10:30 user nova-compute[72444]: WARNING nova.compute.manager [req-0c59f2f0-9358-4894-a27b-28cdf9425412 req-3fe7b450-8836-4429-9165-55075620a52a service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Received unexpected event network-vif-unplugged-13b70ab9-69cc-4d4f-9a8a-a100d1401730 for instance with vm_state active and task_state shelving_image_uploading.
Aug 03 05:10:30 user nova-compute[72444]: DEBUG nova.compute.manager [req-0c59f2f0-9358-4894-a27b-28cdf9425412 req-3fe7b450-8836-4429-9165-55075620a52a service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Received event network-vif-plugged-13b70ab9-69cc-4d4f-9a8a-a100d1401730 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:10:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0c59f2f0-9358-4894-a27b-28cdf9425412 req-3fe7b450-8836-4429-9165-55075620a52a service nova] Acquiring lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:10:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0c59f2f0-9358-4894-a27b-28cdf9425412 req-3fe7b450-8836-4429-9165-55075620a52a service nova] Lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:10:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0c59f2f0-9358-4894-a27b-28cdf9425412 req-3fe7b450-8836-4429-9165-55075620a52a service nova] Lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:10:30 user nova-compute[72444]: DEBUG nova.compute.manager [req-0c59f2f0-9358-4894-a27b-28cdf9425412 req-3fe7b450-8836-4429-9165-55075620a52a service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] No waiting events found dispatching network-vif-plugged-13b70ab9-69cc-4d4f-9a8a-a100d1401730 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:10:30 user nova-compute[72444]: WARNING nova.compute.manager [req-0c59f2f0-9358-4894-a27b-28cdf9425412 req-3fe7b450-8836-4429-9165-55075620a52a service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Received unexpected event network-vif-plugged-13b70ab9-69cc-4d4f-9a8a-a100d1401730 for instance with vm_state active and task_state shelving_image_uploading.
Aug 03 05:10:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:31 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-90ce48b8-49ec-4463-828b-577a4a7baa56 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Snapshot image upload complete
Aug 03 05:10:31 user nova-compute[72444]: DEBUG nova.compute.manager [None req-90ce48b8-49ec-4463-828b-577a4a7baa56 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:10:31 user nova-compute[72444]: INFO nova.compute.manager [None req-90ce48b8-49ec-4463-828b-577a4a7baa56 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Shelve offloading
Aug 03 05:10:32 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Instance destroyed successfully.
Aug 03 05:10:32 user nova-compute[72444]: DEBUG nova.compute.manager [None req-90ce48b8-49ec-4463-828b-577a4a7baa56 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:10:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-90ce48b8-49ec-4463-828b-577a4a7baa56 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "refresh_cache-f58f50ed-c8f1-4468-b919-0a5aa3d630b3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:10:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-90ce48b8-49ec-4463-828b-577a4a7baa56 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquired lock "refresh_cache-f58f50ed-c8f1-4468-b919-0a5aa3d630b3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:10:32 user nova-compute[72444]: DEBUG nova.network.neutron [None req-90ce48b8-49ec-4463-828b-577a4a7baa56 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 05:10:32 user nova-compute[72444]: DEBUG nova.network.neutron [None req-90ce48b8-49ec-4463-828b-577a4a7baa56 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Updating instance_info_cache with network_info: [{"id": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "address": "fa:16:3e:c7:96:a3", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b70ab9-69", "ovs_interfaceid": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:10:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-90ce48b8-49ec-4463-828b-577a4a7baa56 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Releasing lock "refresh_cache-f58f50ed-c8f1-4468-b919-0a5aa3d630b3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:10:33 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Instance destroyed successfully.
Aug 03 05:10:33 user nova-compute[72444]: DEBUG nova.objects.instance [None req-90ce48b8-49ec-4463-828b-577a4a7baa56 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lazy-loading 'resources' on Instance uuid f58f50ed-c8f1-4468-b919-0a5aa3d630b3 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:10:33 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-90ce48b8-49ec-4463-828b-577a4a7baa56 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:08:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1386279515',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1386279515',id=41,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKwBS6VH+8+Zjncxxqwf6lSCfoolZ+1flhdWAiismKhDCjeyiT0KQv/moXMgsKxRKPdMD0euVaGQEkYvPQrRbgz0gJ7DoHqkcatTOpkTGrAK8fUAMB4od9QWxCJoMWRgg==',key_name='tempest-keypair-592139302',keypairs=<?>,launch_index=0,launched_at=2023-08-03T05:08:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ccf62b9ebb5f487184e3b84bbe7e73ad',ramdisk_id='',reservation_id='r-38brd54j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-941210092',owner_user_name='tempest-AttachVolumeShelveTestJSON-941210092-project-member',shelved_at='2023-08-03T05:10:31.926125',shelved_host='user',shelved_image_id='d15c3d7d-0f1f-4fb9-8463-7092f1646b7a'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T05:10:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bff27e3d2ae04049b35afe1bfcc7352b',uuid=f58f50ed-c8f1-4468-b919-0a5aa3d630b3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "address": "fa:16:3e:c7:96:a3", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b70ab9-69", "ovs_interfaceid": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 05:10:33 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-90ce48b8-49ec-4463-828b-577a4a7baa56 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Converting VIF {"id": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "address": "fa:16:3e:c7:96:a3", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b70ab9-69", "ovs_interfaceid": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:10:33 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-90ce48b8-49ec-4463-828b-577a4a7baa56 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:96:a3,bridge_name='br-int',has_traffic_filtering=True,id=13b70ab9-69cc-4d4f-9a8a-a100d1401730,network=Network(3e3f34b4-1878-4a24-b0b2-ab0472fb62d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b70ab9-69') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:10:33 user nova-compute[72444]: DEBUG os_vif [None req-90ce48b8-49ec-4463-828b-577a4a7baa56 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:96:a3,bridge_name='br-int',has_traffic_filtering=True,id=13b70ab9-69cc-4d4f-9a8a-a100d1401730,network=Network(3e3f34b4-1878-4a24-b0b2-ab0472fb62d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b70ab9-69') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 05:10:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13b70ab9-69, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:10:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:10:33 user nova-compute[72444]: INFO os_vif [None req-90ce48b8-49ec-4463-828b-577a4a7baa56 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:96:a3,bridge_name='br-int',has_traffic_filtering=True,id=13b70ab9-69cc-4d4f-9a8a-a100d1401730,network=Network(3e3f34b4-1878-4a24-b0b2-ab0472fb62d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b70ab9-69')
Aug 03 05:10:33 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-90ce48b8-49ec-4463-828b-577a4a7baa56 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Deleting instance files /opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3_del
Aug 03 05:10:33 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-90ce48b8-49ec-4463-828b-577a4a7baa56 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Deletion of /opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3_del complete
Aug 03 05:10:33 user nova-compute[72444]: DEBUG nova.compute.manager [req-38281d22-60af-4bfb-94d1-3925f15bfb5f req-a9ddc622-a612-46ed-aa7a-68cada1f1523 service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Received event network-changed-13b70ab9-69cc-4d4f-9a8a-a100d1401730 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:10:33 user nova-compute[72444]: DEBUG nova.compute.manager [req-38281d22-60af-4bfb-94d1-3925f15bfb5f req-a9ddc622-a612-46ed-aa7a-68cada1f1523 service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Refreshing instance network info cache due to event network-changed-13b70ab9-69cc-4d4f-9a8a-a100d1401730. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:10:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-38281d22-60af-4bfb-94d1-3925f15bfb5f req-a9ddc622-a612-46ed-aa7a-68cada1f1523 service nova] Acquiring lock "refresh_cache-f58f50ed-c8f1-4468-b919-0a5aa3d630b3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:10:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-38281d22-60af-4bfb-94d1-3925f15bfb5f req-a9ddc622-a612-46ed-aa7a-68cada1f1523 service nova] Acquired lock "refresh_cache-f58f50ed-c8f1-4468-b919-0a5aa3d630b3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:10:33 user nova-compute[72444]: DEBUG nova.network.neutron [req-38281d22-60af-4bfb-94d1-3925f15bfb5f req-a9ddc622-a612-46ed-aa7a-68cada1f1523 service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Refreshing network info cache for port 13b70ab9-69cc-4d4f-9a8a-a100d1401730 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:10:33 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-90ce48b8-49ec-4463-828b-577a4a7baa56 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Deleted allocations for instance f58f50ed-c8f1-4468-b919-0a5aa3d630b3
Aug 03 05:10:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-90ce48b8-49ec-4463-828b-577a4a7baa56 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:10:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-90ce48b8-49ec-4463-828b-577a4a7baa56 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:10:33 user nova-compute[72444]: DEBUG nova.objects.instance [None req-90ce48b8-49ec-4463-828b-577a4a7baa56 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lazy-loading 'numa_topology' on Instance uuid f58f50ed-c8f1-4468-b919-0a5aa3d630b3 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:10:33 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-90ce48b8-49ec-4463-828b-577a4a7baa56 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:10:33 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-90ce48b8-49ec-4463-828b-577a4a7baa56 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:10:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-90ce48b8-49ec-4463-828b-577a4a7baa56 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.158s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:10:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-90ce48b8-49ec-4463-828b-577a4a7baa56 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.023s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:10:33 user nova-compute[72444]: DEBUG nova.network.neutron [req-38281d22-60af-4bfb-94d1-3925f15bfb5f req-a9ddc622-a612-46ed-aa7a-68cada1f1523 service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Updated VIF entry in instance network info cache for port 13b70ab9-69cc-4d4f-9a8a-a100d1401730. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:10:33 user nova-compute[72444]: DEBUG nova.network.neutron [req-38281d22-60af-4bfb-94d1-3925f15bfb5f req-a9ddc622-a612-46ed-aa7a-68cada1f1523 service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Updating instance_info_cache with network_info: [{"id": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "address": "fa:16:3e:c7:96:a3", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap13b70ab9-69", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:10:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-38281d22-60af-4bfb-94d1-3925f15bfb5f req-a9ddc622-a612-46ed-aa7a-68cada1f1523 service nova] Releasing lock "refresh_cache-f58f50ed-c8f1-4468-b919-0a5aa3d630b3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:10:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:43 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:43 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691039428.571389, f58f50ed-c8f1-4468-b919-0a5aa3d630b3 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:10:43 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] VM Stopped (Lifecycle Event)
Aug 03 05:10:43 user nova-compute[72444]: DEBUG nova.compute.manager [None req-b59322ec-f181-4d37-b1ff-07a9d15ad280 None None] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:10:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:48 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:49 user nova-compute[72444]: DEBUG nova.compute.manager [req-8d237fe4-c409-4875-a559-18a7e602f832 req-f111cd94-204f-4f0d-910c-69c11e3579bf service nova] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Received event network-changed-d9c036ff-c273-42a7-9add-024d41a7b0be {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:10:49 user nova-compute[72444]: DEBUG nova.compute.manager [req-8d237fe4-c409-4875-a559-18a7e602f832 req-f111cd94-204f-4f0d-910c-69c11e3579bf service nova] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Refreshing instance network info cache due to event network-changed-d9c036ff-c273-42a7-9add-024d41a7b0be. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:10:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8d237fe4-c409-4875-a559-18a7e602f832 req-f111cd94-204f-4f0d-910c-69c11e3579bf service nova] Acquiring lock "refresh_cache-bf8b022e-eb3d-4315-b2fe-aca113826b6b" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:10:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8d237fe4-c409-4875-a559-18a7e602f832 req-f111cd94-204f-4f0d-910c-69c11e3579bf service nova] Acquired lock "refresh_cache-bf8b022e-eb3d-4315-b2fe-aca113826b6b" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:10:49 user nova-compute[72444]: DEBUG nova.network.neutron [req-8d237fe4-c409-4875-a559-18a7e602f832 req-f111cd94-204f-4f0d-910c-69c11e3579bf service nova] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Refreshing network info cache for port d9c036ff-c273-42a7-9add-024d41a7b0be {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:10:50 user nova-compute[72444]: DEBUG nova.network.neutron [req-8d237fe4-c409-4875-a559-18a7e602f832 req-f111cd94-204f-4f0d-910c-69c11e3579bf service nova] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Updated VIF entry in instance network info cache for port d9c036ff-c273-42a7-9add-024d41a7b0be. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:10:50 user nova-compute[72444]: DEBUG nova.network.neutron [req-8d237fe4-c409-4875-a559-18a7e602f832 req-f111cd94-204f-4f0d-910c-69c11e3579bf service nova] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Updating instance_info_cache with network_info: [{"id": "d9c036ff-c273-42a7-9add-024d41a7b0be", "address": "fa:16:3e:41:62:4d", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c036ff-c2", "ovs_interfaceid": "d9c036ff-c273-42a7-9add-024d41a7b0be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:10:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8d237fe4-c409-4875-a559-18a7e602f832 req-f111cd94-204f-4f0d-910c-69c11e3579bf service nova] Releasing lock "refresh_cache-bf8b022e-eb3d-4315-b2fe-aca113826b6b" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:10:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "ec672d0a-06fd-4d15-b608-017e97ce2035" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:10:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "ec672d0a-06fd-4d15-b608-017e97ce2035" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:10:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 05:10:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:10:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:10:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:10:58 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 05:10:58 user nova-compute[72444]: INFO nova.compute.claims [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Claim successful on node user
Aug 03 05:10:58 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:10:58 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:10:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.382s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:10:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 05:10:58 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 05:10:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 05:10:58 user nova-compute[72444]: DEBUG nova.network.neutron [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 05:10:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 05:10:58 user nova-compute[72444]: INFO nova.virt.block_device [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Booting with volume snapshot 65dfa75b-9e26-49cb-9cdf-36c43a8ed5f6 at /dev/vda
Aug 03 05:10:59 user nova-compute[72444]: DEBUG nova.policy [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ef4d8130e33c4d9ea44c29be12f18234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae931112fcda4e2f8dfd4f540d905139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 05:10:59 user nova-compute[72444]: DEBUG nova.network.neutron [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Successfully created port: 4dc8fd24-2dae-48e6-a580-da63dc368a37 {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 05:11:00 user nova-compute[72444]: DEBUG nova.network.neutron [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Successfully updated port: 4dc8fd24-2dae-48e6-a580-da63dc368a37 {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 05:11:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "refresh_cache-ec672d0a-06fd-4d15-b608-017e97ce2035" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:11:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquired lock "refresh_cache-ec672d0a-06fd-4d15-b608-017e97ce2035" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:11:00 user nova-compute[72444]: DEBUG nova.network.neutron [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 05:11:00 user nova-compute[72444]: DEBUG nova.compute.manager [req-aaec8be9-1cf5-4822-821e-8eeced89897c req-9977675c-12f9-4863-93b0-95cdd73da2bf service nova] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Received event network-changed-4dc8fd24-2dae-48e6-a580-da63dc368a37 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:11:00 user nova-compute[72444]: DEBUG nova.compute.manager [req-aaec8be9-1cf5-4822-821e-8eeced89897c req-9977675c-12f9-4863-93b0-95cdd73da2bf service nova] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Refreshing instance network info cache due to event network-changed-4dc8fd24-2dae-48e6-a580-da63dc368a37. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:11:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-aaec8be9-1cf5-4822-821e-8eeced89897c req-9977675c-12f9-4863-93b0-95cdd73da2bf service nova] Acquiring lock "refresh_cache-ec672d0a-06fd-4d15-b608-017e97ce2035" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:11:00 user nova-compute[72444]: DEBUG nova.network.neutron [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 05:11:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:11:01 user nova-compute[72444]: DEBUG nova.network.neutron [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Updating instance_info_cache with network_info: [{"id": "4dc8fd24-2dae-48e6-a580-da63dc368a37", "address": "fa:16:3e:4a:2d:6b", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc8fd24-2d", "ovs_interfaceid": "4dc8fd24-2dae-48e6-a580-da63dc368a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:11:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Releasing lock "refresh_cache-ec672d0a-06fd-4d15-b608-017e97ce2035" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:11:01 user nova-compute[72444]: DEBUG nova.compute.manager [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Instance network_info: |[{"id": "4dc8fd24-2dae-48e6-a580-da63dc368a37", "address": "fa:16:3e:4a:2d:6b", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc8fd24-2d", "ovs_interfaceid": "4dc8fd24-2dae-48e6-a580-da63dc368a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 05:11:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-aaec8be9-1cf5-4822-821e-8eeced89897c req-9977675c-12f9-4863-93b0-95cdd73da2bf service nova] Acquired lock "refresh_cache-ec672d0a-06fd-4d15-b608-017e97ce2035" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:11:01 user nova-compute[72444]: DEBUG nova.network.neutron [req-aaec8be9-1cf5-4822-821e-8eeced89897c req-9977675c-12f9-4863-93b0-95cdd73da2bf service nova] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Refreshing network info cache for port 4dc8fd24-2dae-48e6-a580-da63dc368a37 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:11:01 user nova-compute[72444]: DEBUG nova.network.neutron [req-aaec8be9-1cf5-4822-821e-8eeced89897c req-9977675c-12f9-4863-93b0-95cdd73da2bf service nova] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Updated VIF entry in instance network info cache for port 4dc8fd24-2dae-48e6-a580-da63dc368a37. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:11:01 user nova-compute[72444]: DEBUG nova.network.neutron [req-aaec8be9-1cf5-4822-821e-8eeced89897c req-9977675c-12f9-4863-93b0-95cdd73da2bf service nova] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Updating instance_info_cache with network_info: [{"id": "4dc8fd24-2dae-48e6-a580-da63dc368a37", "address": "fa:16:3e:4a:2d:6b", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc8fd24-2d", "ovs_interfaceid": "4dc8fd24-2dae-48e6-a580-da63dc368a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:11:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-aaec8be9-1cf5-4822-821e-8eeced89897c req-9977675c-12f9-4863-93b0-95cdd73da2bf service nova] Releasing lock "refresh_cache-ec672d0a-06fd-4d15-b608-017e97ce2035" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:11:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:11:03 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:11:04 user nova-compute[72444]: DEBUG os_brick.utils [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:11:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:11:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:11:04 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9441fa-56b9-4b3e-820b-8217defcd8e4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:11:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:11:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:11:04 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[893cc6ae-8ca2-40c5-ac00-053fa26303f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:11:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:11:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:11:04 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a26611-528b-4ad6-bf31-217f9ffe61cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:11:04 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c62f8aa-199b-42c3-ba3a-7234c87a260e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:11:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:11:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:11:04 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:11:04 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 05:11:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:11:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:11:04 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 05:11:04 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c337dc5-e4a4-4757-b58b-ba342cd8897f]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:11:04 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 05:11:04 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 05:11:04 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 05:11:04 user nova-compute[72444]: DEBUG os_brick.utils [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:11:04 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Updating existing volume attachment record: 592b5ba4-c564-4f69-a885-890869fde63d {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 05:11:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:11:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:11:08 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:11:08 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:11:09 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:11:09 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 05:11:10 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:11:10 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:11:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-bf8b022e-eb3d-4315-b2fe-aca113826b6b" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:11:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-bf8b022e-eb3d-4315-b2fe-aca113826b6b" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:11:10 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 05:11:11 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Updating instance_info_cache with network_info: [{"id": "d9c036ff-c273-42a7-9add-024d41a7b0be", "address": "fa:16:3e:41:62:4d", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c036ff-c2", "ovs_interfaceid": "d9c036ff-c273-42a7-9add-024d41a7b0be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:11:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-bf8b022e-eb3d-4315-b2fe-aca113826b6b" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:11:11 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 05:11:11 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG nova.compute.manager [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 05:11:12 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Creating image(s)
Aug 03 05:11:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Did not create local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Ensure instance console log exists: /opt/stack/data/nova/instances/ec672d0a-06fd-4d15-b608-017e97ce2035/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Start _get_guest_xml network_info=[{"id": "4dc8fd24-2dae-48e6-a580-da63dc368a37", "address": "fa:16:3e:4a:2d:6b", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc8fd24-2d", "ovs_interfaceid": "4dc8fd24-2dae-48e6-a580-da63dc368a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-03T05:10:51Z,direct_url=<?>,disk_format='qcow2',id=e67d4295-eada-41cb-a03e-0d3a60c7047d,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-670380356',owner='ae931112fcda4e2f8dfd4f540d905139',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-03T05:10:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ajhvVbyc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ec672d0a-06fd-4d15-b608-017e97ce2035', 'attached_at': '', 'detached_at': '', 'volume_id': 'dda2643b-18f7-41ce-b877-63fb96cc42bb', 'serial': 'dda2643b-18f7-41ce-b877-63fb96cc42bb'}, 'disk_bus': 'virtio', 'attachment_id': '592b5ba4-c564-4f69-a885-890869fde63d', 'guest_format': None, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 05:11:12 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:11:12 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:11:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-03T05:10:51Z,direct_url=<?>,disk_format='qcow2',id=e67d4295-eada-41cb-a03e-0d3a60c7047d,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-670380356',owner='ae931112fcda4e2f8dfd4f540d905139',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-03T05:10:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ajhvVbyc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:11:12 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:11:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:11:12 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:11:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:11:12 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 05:11:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9339cc9a-79c6-4949-8fb6-e2884fe3e959]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 05:11:12 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f22c1e-da2a-4a79-861b-01301c5bd508]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb] added
Aug 03 05:11:12 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[083735c2-258c-48ac-8af3-5171eb3cdbd6]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b311b9-a97b-4d99-9b47-fbb47623cb73]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ajhvVbyc {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ajhvVbyc" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e043641f-f6f3-4e04-829f-242c86b04aa5]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ajhvVbyc'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d8373b-1d3d-431b-ac21-b0871054271f]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f02ece8-0ebd-4efe-b939-07cd2128008d]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 (non-flash)
Aug 03 05:11:12 user nova-compute[72444]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c (non-flash)
Aug 03 05:11:12 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 (non-flash)
Aug 03 05:11:12 user nova-compute[72444]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c (non-flash)
Aug 03 05:11:12 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3aa24a1-d37b-4c66-b9ec-be5c16aaffed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb, portal: 172.16.0.220,3260]
Aug 03 05:11:12 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb, portal: 172.16.0.220,3260] successful.
Aug 03 05:11:12 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ea10a3-a760-463d-bdd8-01a9e7497c77]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb8cd7b-bd5a-44fd-bceb-04bb33130013]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 (non-flash)
Aug 03 05:11:12 user nova-compute[72444]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c (non-flash)
Aug 03 05:11:12 user nova-compute[72444]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb (non-flash)
Aug 03 05:11:12 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 (non-flash)
Aug 03 05:11:12 user nova-compute[72444]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c (non-flash)
Aug 03 05:11:12 user nova-compute[72444]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb (non-flash)
Aug 03 05:11:12 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba0b695-c52e-4f83-885e-d27fdb795baa]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 05:11:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ajhvVbyc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 05:11:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:11:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:11:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23561323664326562', 'path': '/dev/sdd'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:11:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561323664326562', 'path': '/dev/sdd'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 05:11:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1876707565',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1876707565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1876707565',id=44,image_ref='e67d4295-eada-41cb-a03e-0d3a60c7047d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/9Ic2C55M+91fZbMsEQQt6pLoqf0z3yYCZ7gLUJO4pwCs3xaLjOdwEI7+Qmhd7ExlvnMIrHeSD38ZygeihziB9C7n8880Qxc41Hr9hGXyUamVhCVG/5sUBWnWmTooEBw==',key_name='tempest-keypair-2097327391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae931112fcda4e2f8dfd4f540d905139',ramdisk_id='',reservation_id='r-rqx0tbnd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1788747136',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1788747136-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1788747136',owner_user_name='tempest-TestVolumeBootPattern-1788747136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef4d8130e33c4d9ea44c29be12f18234',uuid=ec672d0a-06fd-4d15-b608-017e97ce2035,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4dc8fd24-2dae-48e6-a580-da63dc368a37", "address": "fa:16:3e:4a:2d:6b", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc8fd24-2d", "ovs_interfaceid": "4dc8fd24-2dae-48e6-a580-da63dc368a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 05:11:13 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Converting VIF {"id": "4dc8fd24-2dae-48e6-a580-da63dc368a37", "address": "fa:16:3e:4a:2d:6b", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc8fd24-2d", "ovs_interfaceid": "4dc8fd24-2dae-48e6-a580-da63dc368a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:11:13 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:2d:6b,bridge_name='br-int',has_traffic_filtering=True,id=4dc8fd24-2dae-48e6-a580-da63dc368a37,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dc8fd24-2d') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:11:13 user nova-compute[72444]: DEBUG nova.objects.instance [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lazy-loading 'pci_devices' on Instance uuid ec672d0a-06fd-4d15-b608-017e97ce2035 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:11:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] End _get_guest_xml xml=<domain type="kvm">
Aug 03 05:11:14 user nova-compute[72444]:   <uuid>ec672d0a-06fd-4d15-b608-017e97ce2035</uuid>
Aug 03 05:11:14 user nova-compute[72444]:   <name>instance-0000002c</name>
Aug 03 05:11:14 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 05:11:14 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 05:11:14 user nova-compute[72444]:   <metadata>
Aug 03 05:11:14 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 05:11:14 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 05:11:14 user nova-compute[72444]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1876707565</nova:name>
Aug 03 05:11:14 user nova-compute[72444]:       <nova:creationTime>2023-08-03 05:11:12</nova:creationTime>
Aug 03 05:11:14 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 05:11:14 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 05:11:14 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 05:11:14 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 05:11:14 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 05:11:14 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 05:11:14 user nova-compute[72444]:       </nova:flavor>
Aug 03 05:11:14 user nova-compute[72444]:       <nova:owner>
Aug 03 05:11:14 user nova-compute[72444]:         <nova:user uuid="ef4d8130e33c4d9ea44c29be12f18234">tempest-TestVolumeBootPattern-1788747136-project-member</nova:user>
Aug 03 05:11:14 user nova-compute[72444]:         <nova:project uuid="ae931112fcda4e2f8dfd4f540d905139">tempest-TestVolumeBootPattern-1788747136</nova:project>
Aug 03 05:11:14 user nova-compute[72444]:       </nova:owner>
Aug 03 05:11:14 user nova-compute[72444]:       <nova:root type="image" uuid="e67d4295-eada-41cb-a03e-0d3a60c7047d"/>
Aug 03 05:11:14 user nova-compute[72444]:       <nova:ports>
Aug 03 05:11:14 user nova-compute[72444]:         <nova:port uuid="4dc8fd24-2dae-48e6-a580-da63dc368a37">
Aug 03 05:11:14 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 03 05:11:14 user nova-compute[72444]:         </nova:port>
Aug 03 05:11:14 user nova-compute[72444]:       </nova:ports>
Aug 03 05:11:14 user nova-compute[72444]:     </nova:instance>
Aug 03 05:11:14 user nova-compute[72444]:   </metadata>
Aug 03 05:11:14 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 05:11:14 user nova-compute[72444]:     <system>
Aug 03 05:11:14 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 05:11:14 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 05:11:14 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 05:11:14 user nova-compute[72444]:       <entry name="serial">ec672d0a-06fd-4d15-b608-017e97ce2035</entry>
Aug 03 05:11:14 user nova-compute[72444]:       <entry name="uuid">ec672d0a-06fd-4d15-b608-017e97ce2035</entry>
Aug 03 05:11:14 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 05:11:14 user nova-compute[72444]:     </system>
Aug 03 05:11:14 user nova-compute[72444]:   </sysinfo>
Aug 03 05:11:14 user nova-compute[72444]:   <os>
Aug 03 05:11:14 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 05:11:14 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 05:11:14 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 05:11:14 user nova-compute[72444]:   </os>
Aug 03 05:11:14 user nova-compute[72444]:   <features>
Aug 03 05:11:14 user nova-compute[72444]:     <acpi/>
Aug 03 05:11:14 user nova-compute[72444]:     <apic/>
Aug 03 05:11:14 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 05:11:14 user nova-compute[72444]:   </features>
Aug 03 05:11:14 user nova-compute[72444]:   <clock offset="utc">
Aug 03 05:11:14 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 05:11:14 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 05:11:14 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 05:11:14 user nova-compute[72444]:   </clock>
Aug 03 05:11:14 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 05:11:14 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 05:11:14 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 05:11:14 user nova-compute[72444]:   </cpu>
Aug 03 05:11:14 user nova-compute[72444]:   <devices>
Aug 03 05:11:14 user nova-compute[72444]:     <disk type="block" device="disk">
Aug 03 05:11:14 user nova-compute[72444]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:11:14 user nova-compute[72444]:       <source dev="/dev/sdd"/>
Aug 03 05:11:14 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 05:11:14 user nova-compute[72444]:       <serial>dda2643b-18f7-41ce-b877-63fb96cc42bb</serial>
Aug 03 05:11:14 user nova-compute[72444]:     </disk>
Aug 03 05:11:14 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 05:11:14 user nova-compute[72444]:       <mac address="fa:16:3e:4a:2d:6b"/>
Aug 03 05:11:14 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:11:14 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 05:11:14 user nova-compute[72444]:       <target dev="tap4dc8fd24-2d"/>
Aug 03 05:11:14 user nova-compute[72444]:     </interface>
Aug 03 05:11:14 user nova-compute[72444]:     <serial type="pty">
Aug 03 05:11:14 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/ec672d0a-06fd-4d15-b608-017e97ce2035/console.log" append="off"/>
Aug 03 05:11:14 user nova-compute[72444]:     </serial>
Aug 03 05:11:14 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 05:11:14 user nova-compute[72444]:     <video>
Aug 03 05:11:14 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:11:14 user nova-compute[72444]:     </video>
Aug 03 05:11:14 user nova-compute[72444]:     <rng model="virtio">
Aug 03 05:11:14 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 05:11:14 user nova-compute[72444]:     </rng>
Aug 03 05:11:14 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 05:11:14 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 05:11:14 user nova-compute[72444]:       <stats period="10"/>
Aug 03 05:11:14 user nova-compute[72444]:     </memballoon>
Aug 03 05:11:14 user nova-compute[72444]:   </devices>
Aug 03 05:11:14 user nova-compute[72444]: </domain>
Aug 03 05:11:14 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 05:11:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1876707565',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1876707565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1876707565',id=44,image_ref='e67d4295-eada-41cb-a03e-0d3a60c7047d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/9Ic2C55M+91fZbMsEQQt6pLoqf0z3yYCZ7gLUJO4pwCs3xaLjOdwEI7+Qmhd7ExlvnMIrHeSD38ZygeihziB9C7n8880Qxc41Hr9hGXyUamVhCVG/5sUBWnWmTooEBw==',key_name='tempest-keypair-2097327391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae931112fcda4e2f8dfd4f540d905139',ramdisk_id='',reservation_id='r-rqx0tbnd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1788747136',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1788747136-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1788747136',owner_user_name='tempest-TestVolumeBootPattern-1788747136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef4d8130e33c4d9ea44c29be12f18234',uuid=ec672d0a-06fd-4d15-b608-017e97ce2035,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4dc8fd24-2dae-48e6-a580-da63dc368a37", "address": "fa:16:3e:4a:2d:6b", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc8fd24-2d", "ovs_interfaceid": "4dc8fd24-2dae-48e6-a580-da63dc368a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 05:11:14 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Converting VIF {"id": "4dc8fd24-2dae-48e6-a580-da63dc368a37", "address": "fa:16:3e:4a:2d:6b", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc8fd24-2d", "ovs_interfaceid": "4dc8fd24-2dae-48e6-a580-da63dc368a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:11:14 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:2d:6b,bridge_name='br-int',has_traffic_filtering=True,id=4dc8fd24-2dae-48e6-a580-da63dc368a37,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dc8fd24-2d') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:11:14 user nova-compute[72444]: DEBUG os_vif [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:2d:6b,bridge_name='br-int',has_traffic_filtering=True,id=4dc8fd24-2dae-48e6-a580-da63dc368a37,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dc8fd24-2d') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 05:11:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:11:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:11:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 05:11:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:11:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4dc8fd24-2d, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:11:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4dc8fd24-2d, col_values=(('external_ids', {'iface-id': '4dc8fd24-2dae-48e6-a580-da63dc368a37', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:2d:6b', 'vm-uuid': 'ec672d0a-06fd-4d15-b608-017e97ce2035'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:11:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:11:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:11:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:11:14 user nova-compute[72444]: INFO os_vif [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:2d:6b,bridge_name='br-int',has_traffic_filtering=True,id=4dc8fd24-2dae-48e6-a580-da63dc368a37,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dc8fd24-2d')
Aug 03 05:11:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:11:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] No VIF found with MAC fa:16:3e:4a:2d:6b, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 05:11:14 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:11:14 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:11:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:11:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:11:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:11:14 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:11:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:11:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:11:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:11:15 user nova-compute[72444]: DEBUG nova.compute.manager [req-ebc01c30-149f-4cc0-813f-881310590d33 req-fa3843ce-03c1-4826-9253-6737111bf0e3 service nova] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Received event network-vif-plugged-4dc8fd24-2dae-48e6-a580-da63dc368a37 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:11:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ebc01c30-149f-4cc0-813f-881310590d33 req-fa3843ce-03c1-4826-9253-6737111bf0e3 service nova] Acquiring lock "ec672d0a-06fd-4d15-b608-017e97ce2035-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:11:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ebc01c30-149f-4cc0-813f-881310590d33 req-fa3843ce-03c1-4826-9253-6737111bf0e3 service nova] Lock "ec672d0a-06fd-4d15-b608-017e97ce2035-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:11:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ebc01c30-149f-4cc0-813f-881310590d33 req-fa3843ce-03c1-4826-9253-6737111bf0e3 service nova] Lock "ec672d0a-06fd-4d15-b608-017e97ce2035-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:11:15 user nova-compute[72444]: DEBUG nova.compute.manager [req-ebc01c30-149f-4cc0-813f-881310590d33 req-fa3843ce-03c1-4826-9253-6737111bf0e3 service nova] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] No waiting events found dispatching network-vif-plugged-4dc8fd24-2dae-48e6-a580-da63dc368a37 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:11:15 user nova-compute[72444]: WARNING nova.compute.manager [req-ebc01c30-149f-4cc0-813f-881310590d33 req-fa3843ce-03c1-4826-9253-6737111bf0e3 service nova] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Received unexpected event network-vif-plugged-4dc8fd24-2dae-48e6-a580-da63dc368a37 for instance with vm_state building and task_state spawning.
Aug 03 05:11:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:11:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:11:15 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 05:11:15 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 05:11:15 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 05:11:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:11:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:11:16 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:11:16 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:11:16 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=8572MB free_disk=25.40770721435547GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:11:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:11:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:11:16 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance bf8b022e-eb3d-4315-b2fe-aca113826b6b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:11:16 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 685818c7-b515-4118-a952-a52a5942c4e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:11:16 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance ec672d0a-06fd-4d15-b608-017e97ce2035 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:11:16 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:11:16 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:11:16 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:11:16 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:11:16 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:11:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:11:17 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691039477.3626602, ec672d0a-06fd-4d15-b608-017e97ce2035 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:11:17 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] VM Resumed (Lifecycle Event)
Aug 03 05:11:17 user nova-compute[72444]: DEBUG nova.compute.manager [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 05:11:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 05:11:17 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Instance spawned successfully.
Aug 03 05:11:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 05:11:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:11:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:11:17 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:11:17 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:11:17 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 05:11:17 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691039477.3640263, ec672d0a-06fd-4d15-b608-017e97ce2035 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:11:17 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] VM Started (Lifecycle Event)
Aug 03 05:11:17 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:11:17 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:11:17 user nova-compute[72444]: INFO nova.compute.manager [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Took 4.86 seconds to spawn the instance on the hypervisor.
Aug 03 05:11:17 user nova-compute[72444]: DEBUG nova.compute.manager [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:11:17 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 05:11:17 user nova-compute[72444]: INFO nova.compute.manager [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Took 19.08 seconds to build instance.
Aug 03 05:11:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-34a0a1ba-6990-4b06-889c-a2db1eae34ae tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "ec672d0a-06fd-4d15-b608-017e97ce2035" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.184s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:11:17 user nova-compute[72444]: DEBUG nova.compute.manager [req-e229cc13-7c2c-4fb1-8ab2-a64030a6184e req-7bc9c5c8-f1ce-4358-a16e-0fd323691bb1 service nova] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Received event network-vif-plugged-4dc8fd24-2dae-48e6-a580-da63dc368a37 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:11:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e229cc13-7c2c-4fb1-8ab2-a64030a6184e req-7bc9c5c8-f1ce-4358-a16e-0fd323691bb1 service nova] Acquiring lock "ec672d0a-06fd-4d15-b608-017e97ce2035-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:11:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e229cc13-7c2c-4fb1-8ab2-a64030a6184e req-7bc9c5c8-f1ce-4358-a16e-0fd323691bb1 service nova] Lock "ec672d0a-06fd-4d15-b608-017e97ce2035-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:11:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e229cc13-7c2c-4fb1-8ab2-a64030a6184e req-7bc9c5c8-f1ce-4358-a16e-0fd323691bb1 service nova] Lock "ec672d0a-06fd-4d15-b608-017e97ce2035-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:11:17 user nova-compute[72444]: DEBUG nova.compute.manager [req-e229cc13-7c2c-4fb1-8ab2-a64030a6184e req-7bc9c5c8-f1ce-4358-a16e-0fd323691bb1 service nova] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] No waiting events found dispatching network-vif-plugged-4dc8fd24-2dae-48e6-a580-da63dc368a37 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:11:17 user nova-compute[72444]: WARNING nova.compute.manager [req-e229cc13-7c2c-4fb1-8ab2-a64030a6184e req-7bc9c5c8-f1ce-4358-a16e-0fd323691bb1 service nova] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Received unexpected event network-vif-plugged-4dc8fd24-2dae-48e6-a580-da63dc368a37 for instance with vm_state active and task_state None.
Aug 03 05:11:18 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:11:19 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:11:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:11:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:11:29 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:11:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:11:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:11:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:11:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:11:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:11:44 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:11:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:11:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:11:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:11:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:11:57 user nova-compute[72444]: DEBUG nova.compute.manager [req-fc4d938a-919e-448e-b53c-c76f64a66fb8 req-753cd34e-bb2c-4715-9a68-bf257f0786e6 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Received event network-changed-15762642-ded6-4ef6-90c7-46bf3a884904 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:11:57 user nova-compute[72444]: DEBUG nova.compute.manager [req-fc4d938a-919e-448e-b53c-c76f64a66fb8 req-753cd34e-bb2c-4715-9a68-bf257f0786e6 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Refreshing instance network info cache due to event network-changed-15762642-ded6-4ef6-90c7-46bf3a884904. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:11:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-fc4d938a-919e-448e-b53c-c76f64a66fb8 req-753cd34e-bb2c-4715-9a68-bf257f0786e6 service nova] Acquiring lock "refresh_cache-685818c7-b515-4118-a952-a52a5942c4e3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:11:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-fc4d938a-919e-448e-b53c-c76f64a66fb8 req-753cd34e-bb2c-4715-9a68-bf257f0786e6 service nova] Acquired lock "refresh_cache-685818c7-b515-4118-a952-a52a5942c4e3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:11:57 user nova-compute[72444]: DEBUG nova.network.neutron [req-fc4d938a-919e-448e-b53c-c76f64a66fb8 req-753cd34e-bb2c-4715-9a68-bf257f0786e6 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Refreshing network info cache for port 15762642-ded6-4ef6-90c7-46bf3a884904 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:11:57 user nova-compute[72444]: DEBUG nova.network.neutron [req-fc4d938a-919e-448e-b53c-c76f64a66fb8 req-753cd34e-bb2c-4715-9a68-bf257f0786e6 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Updated VIF entry in instance network info cache for port 15762642-ded6-4ef6-90c7-46bf3a884904. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:11:57 user nova-compute[72444]: DEBUG nova.network.neutron [req-fc4d938a-919e-448e-b53c-c76f64a66fb8 req-753cd34e-bb2c-4715-9a68-bf257f0786e6 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Updating instance_info_cache with network_info: [{"id": "15762642-ded6-4ef6-90c7-46bf3a884904", "address": "fa:16:3e:9b:fd:92", "network": {"id": "7057d5fc-5467-4681-8ed0-5243099b3df3", "bridge": "br-int", "label": "tempest-TestShelveInstance-5073894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df9034b591f2496fbef89f59646a31cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15762642-de", "ovs_interfaceid": "15762642-ded6-4ef6-90c7-46bf3a884904", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:11:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-fc4d938a-919e-448e-b53c-c76f64a66fb8 req-753cd34e-bb2c-4715-9a68-bf257f0786e6 service nova] Releasing lock "refresh_cache-685818c7-b515-4118-a952-a52a5942c4e3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:11:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Acquiring lock "685818c7-b515-4118-a952-a52a5942c4e3" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:11:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lock "685818c7-b515-4118-a952-a52a5942c4e3" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:11:57 user nova-compute[72444]: INFO nova.compute.manager [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Shelve offloading
Aug 03 05:11:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:11:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:11:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:11:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:11:58 user nova-compute[72444]: DEBUG nova.compute.manager [req-3bad6e20-eae3-4c6b-bec2-61ff1eee3f6c req-3f46eaa2-2bef-460b-979b-9b0abe794c72 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Received event network-vif-unplugged-15762642-ded6-4ef6-90c7-46bf3a884904 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:11:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3bad6e20-eae3-4c6b-bec2-61ff1eee3f6c req-3f46eaa2-2bef-460b-979b-9b0abe794c72 service nova] Acquiring lock "685818c7-b515-4118-a952-a52a5942c4e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:11:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3bad6e20-eae3-4c6b-bec2-61ff1eee3f6c req-3f46eaa2-2bef-460b-979b-9b0abe794c72 service nova] Lock "685818c7-b515-4118-a952-a52a5942c4e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:11:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3bad6e20-eae3-4c6b-bec2-61ff1eee3f6c req-3f46eaa2-2bef-460b-979b-9b0abe794c72 service nova] Lock "685818c7-b515-4118-a952-a52a5942c4e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:11:58 user nova-compute[72444]: DEBUG nova.compute.manager [req-3bad6e20-eae3-4c6b-bec2-61ff1eee3f6c req-3f46eaa2-2bef-460b-979b-9b0abe794c72 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] No waiting events found dispatching network-vif-unplugged-15762642-ded6-4ef6-90c7-46bf3a884904 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:11:58 user nova-compute[72444]: WARNING nova.compute.manager [req-3bad6e20-eae3-4c6b-bec2-61ff1eee3f6c req-3f46eaa2-2bef-460b-979b-9b0abe794c72 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Received unexpected event network-vif-unplugged-15762642-ded6-4ef6-90c7-46bf3a884904 for instance with vm_state active and task_state shelving.
Aug 03 05:11:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:11:58 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Instance destroyed successfully.
Aug 03 05:11:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:11:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Acquiring lock "refresh_cache-685818c7-b515-4118-a952-a52a5942c4e3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:11:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Acquired lock "refresh_cache-685818c7-b515-4118-a952-a52a5942c4e3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:11:58 user nova-compute[72444]: DEBUG nova.network.neutron [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 05:11:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:11:59 user nova-compute[72444]: DEBUG nova.network.neutron [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Updating instance_info_cache with network_info: [{"id": "15762642-ded6-4ef6-90c7-46bf3a884904", "address": "fa:16:3e:9b:fd:92", "network": {"id": "7057d5fc-5467-4681-8ed0-5243099b3df3", "bridge": "br-int", "label": "tempest-TestShelveInstance-5073894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df9034b591f2496fbef89f59646a31cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15762642-de", "ovs_interfaceid": "15762642-ded6-4ef6-90c7-46bf3a884904", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:11:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Releasing lock "refresh_cache-685818c7-b515-4118-a952-a52a5942c4e3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG nova.compute.manager [req-ceb5cf10-8e86-42f1-9110-b0af6fa72972 req-a744f78d-38d5-4ee2-9ae5-9f97b916f337 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Received event network-vif-plugged-15762642-ded6-4ef6-90c7-46bf3a884904 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ceb5cf10-8e86-42f1-9110-b0af6fa72972 req-a744f78d-38d5-4ee2-9ae5-9f97b916f337 service nova] Acquiring lock "685818c7-b515-4118-a952-a52a5942c4e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ceb5cf10-8e86-42f1-9110-b0af6fa72972 req-a744f78d-38d5-4ee2-9ae5-9f97b916f337 service nova] Lock "685818c7-b515-4118-a952-a52a5942c4e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ceb5cf10-8e86-42f1-9110-b0af6fa72972 req-a744f78d-38d5-4ee2-9ae5-9f97b916f337 service nova] Lock "685818c7-b515-4118-a952-a52a5942c4e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG nova.compute.manager [req-ceb5cf10-8e86-42f1-9110-b0af6fa72972 req-a744f78d-38d5-4ee2-9ae5-9f97b916f337 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] No waiting events found dispatching network-vif-plugged-15762642-ded6-4ef6-90c7-46bf3a884904 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:12:00 user nova-compute[72444]: WARNING nova.compute.manager [req-ceb5cf10-8e86-42f1-9110-b0af6fa72972 req-a744f78d-38d5-4ee2-9ae5-9f97b916f337 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Received unexpected event network-vif-plugged-15762642-ded6-4ef6-90c7-46bf3a884904 for instance with vm_state active and task_state shelving.
Aug 03 05:12:00 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Instance destroyed successfully.
Aug 03 05:12:00 user nova-compute[72444]: DEBUG nova.objects.instance [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lazy-loading 'resources' on Instance uuid 685818c7-b515-4118-a952-a52a5942c4e3 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:10:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1129121706',display_name='tempest-TestShelveInstance-server-1129121706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1129121706',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhnSFVSYyIoliFKyFB/B2Z+tXspOpFn6D6+zix3bZV/aAGwrmK7q42wnCb91aouVv1HXPq8ltR87nVyNr/0W7/IY0epB+HwKN3DG0chjc7bQOjfwdtSWQxRujXjqbiSPQ==',key_name='tempest-TestShelveInstance-18244009',keypairs=<?>,launch_index=0,launched_at=2023-08-03T05:10:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df9034b591f2496fbef89f59646a31cc',ramdisk_id='',reservation_id='r-cyiehe4p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-98284952',owner_user_name='tempest-TestShelveInstance-98284952-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T05:10:19Z,user_data=None,user_id='566ccf33576b48dd8efe2427e8410d62',uuid=685818c7-b515-4118-a952-a52a5942c4e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15762642-ded6-4ef6-90c7-46bf3a884904", "address": "fa:16:3e:9b:fd:92", "network": {"id": "7057d5fc-5467-4681-8ed0-5243099b3df3", "bridge": "br-int", "label": "tempest-TestShelveInstance-5073894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df9034b591f2496fbef89f59646a31cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15762642-de", "ovs_interfaceid": "15762642-ded6-4ef6-90c7-46bf3a884904", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Converting VIF {"id": "15762642-ded6-4ef6-90c7-46bf3a884904", "address": "fa:16:3e:9b:fd:92", "network": {"id": "7057d5fc-5467-4681-8ed0-5243099b3df3", "bridge": "br-int", "label": "tempest-TestShelveInstance-5073894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df9034b591f2496fbef89f59646a31cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15762642-de", "ovs_interfaceid": "15762642-ded6-4ef6-90c7-46bf3a884904", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:fd:92,bridge_name='br-int',has_traffic_filtering=True,id=15762642-ded6-4ef6-90c7-46bf3a884904,network=Network(7057d5fc-5467-4681-8ed0-5243099b3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15762642-de') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG os_vif [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:fd:92,bridge_name='br-int',has_traffic_filtering=True,id=15762642-ded6-4ef6-90c7-46bf3a884904,network=Network(7057d5fc-5467-4681-8ed0-5243099b3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15762642-de') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15762642-de, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG nova.compute.manager [req-298c546f-e304-42b3-a5ba-f2f27f96dfdc req-0724e940-0190-4045-ae80-2e497cfb23f3 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Received event network-changed-15762642-ded6-4ef6-90c7-46bf3a884904 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG nova.compute.manager [req-298c546f-e304-42b3-a5ba-f2f27f96dfdc req-0724e940-0190-4045-ae80-2e497cfb23f3 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Refreshing instance network info cache due to event network-changed-15762642-ded6-4ef6-90c7-46bf3a884904. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-298c546f-e304-42b3-a5ba-f2f27f96dfdc req-0724e940-0190-4045-ae80-2e497cfb23f3 service nova] Acquiring lock "refresh_cache-685818c7-b515-4118-a952-a52a5942c4e3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-298c546f-e304-42b3-a5ba-f2f27f96dfdc req-0724e940-0190-4045-ae80-2e497cfb23f3 service nova] Acquired lock "refresh_cache-685818c7-b515-4118-a952-a52a5942c4e3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG nova.network.neutron [req-298c546f-e304-42b3-a5ba-f2f27f96dfdc req-0724e940-0190-4045-ae80-2e497cfb23f3 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Refreshing network info cache for port 15762642-ded6-4ef6-90c7-46bf3a884904 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:12:00 user nova-compute[72444]: INFO os_vif [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:fd:92,bridge_name='br-int',has_traffic_filtering=True,id=15762642-ded6-4ef6-90c7-46bf3a884904,network=Network(7057d5fc-5467-4681-8ed0-5243099b3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15762642-de')
Aug 03 05:12:00 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MGJqnglX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:12:00 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:12:00 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c1f3d6-d58f-4cb8-ac5b-e2780f87eab1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5755c506-ddc8-41f6-9fcc-b34d3361e46a]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 (non-flash)
Aug 03 05:12:00 user nova-compute[72444]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c (non-flash)
Aug 03 05:12:00 user nova-compute[72444]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb (non-flash)
Aug 03 05:12:00 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 (non-flash)
Aug 03 05:12:00 user nova-compute[72444]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c (non-flash)
Aug 03 05:12:00 user nova-compute[72444]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb (non-flash)
Aug 03 05:12:00 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30944e6d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c'): ({'sdc'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Removing single pathed devices sdc {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d099e521-89e6-49dd-9fcb-305eab227311]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[924d3cc0-0c2a-4684-9f45-d821dde11a6d]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Flushing IO for device /dev/sdc {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74a1e15-7dc1-4ef3-b800-b3940820c20f]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85bfabb-6f1a-46b0-a5b9-ddebf7bb7f64]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] SCSI volumes sdc have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9fa177-9f1c-4100-9461-d844cac39d5b]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbe00eb-e033-46d7-8f46-b33f8dc342bb]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c, portal: 172.16.0.220,3260]
Aug 03 05:12:00 user nova-compute[72444]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c, portal: 172.16.0.220,3260] successful.
Aug 03 05:12:00 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc2907f-37c5-4fab-9357-94df28479705]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] <== disconnect_volume: return (268ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 05:12:00 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Deleting instance files /opt/stack/data/nova/instances/685818c7-b515-4118-a952-a52a5942c4e3_del
Aug 03 05:12:00 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Deletion of /opt/stack/data/nova/instances/685818c7-b515-4118-a952-a52a5942c4e3_del complete
Aug 03 05:12:00 user nova-compute[72444]: DEBUG nova.network.neutron [req-298c546f-e304-42b3-a5ba-f2f27f96dfdc req-0724e940-0190-4045-ae80-2e497cfb23f3 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Updated VIF entry in instance network info cache for port 15762642-ded6-4ef6-90c7-46bf3a884904. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG nova.network.neutron [req-298c546f-e304-42b3-a5ba-f2f27f96dfdc req-0724e940-0190-4045-ae80-2e497cfb23f3 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Updating instance_info_cache with network_info: [{"id": "15762642-ded6-4ef6-90c7-46bf3a884904", "address": "fa:16:3e:9b:fd:92", "network": {"id": "7057d5fc-5467-4681-8ed0-5243099b3df3", "bridge": null, "label": "tempest-TestShelveInstance-5073894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df9034b591f2496fbef89f59646a31cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap15762642-de", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-298c546f-e304-42b3-a5ba-f2f27f96dfdc req-0724e940-0190-4045-ae80-2e497cfb23f3 service nova] Releasing lock "refresh_cache-685818c7-b515-4118-a952-a52a5942c4e3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:12:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:12:01 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Deleted allocations for instance 685818c7-b515-4118-a952-a52a5942c4e3
Aug 03 05:12:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:12:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:12:01 user nova-compute[72444]: DEBUG nova.objects.instance [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lazy-loading 'numa_topology' on Instance uuid 685818c7-b515-4118-a952-a52a5942c4e3 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:12:01 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:12:01 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:12:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.149s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:12:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-b15e8b5d-9c26-42a5-bc1e-8eb2fa9c8428 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lock "685818c7-b515-4118-a952-a52a5942c4e3" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.853s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:12:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:12:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:12:05 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:12:05 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:12:06 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:12:06 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Cleaning up deleted instances {{(pid=72444) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 03 05:12:06 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] There are 0 instances to clean {{(pid=72444) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 03 05:12:09 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:12:09 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:12:09 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 05:12:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:12:10 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:12:10 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:12:10 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Rebuilding the list of instances to heal {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 05:12:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-bf8b022e-eb3d-4315-b2fe-aca113826b6b" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:12:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-bf8b022e-eb3d-4315-b2fe-aca113826b6b" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:12:10 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 05:12:10 user nova-compute[72444]: DEBUG nova.objects.instance [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lazy-loading 'info_cache' on Instance uuid bf8b022e-eb3d-4315-b2fe-aca113826b6b {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:12:11 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Updating instance_info_cache with network_info: [{"id": "d9c036ff-c273-42a7-9add-024d41a7b0be", "address": "fa:16:3e:41:62:4d", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c036ff-c2", "ovs_interfaceid": "d9c036ff-c273-42a7-9add-024d41a7b0be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:12:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-bf8b022e-eb3d-4315-b2fe-aca113826b6b" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:12:11 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 05:12:11 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:12:11 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:12:13 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691039518.6993167, 685818c7-b515-4118-a952-a52a5942c4e3 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:12:13 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] VM Stopped (Lifecycle Event)
Aug 03 05:12:13 user nova-compute[72444]: DEBUG nova.compute.manager [None req-bcbd7473-910b-4b2f-a883-3088b4fcb4ce None None] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:12:13 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:12:14 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:12:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:12:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:12:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:12:14 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:12:15 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 05:12:15 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 05:12:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:12:15 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:12:15 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:12:15 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=8579MB free_disk=25.406131744384766GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:12:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:12:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:12:15 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance bf8b022e-eb3d-4315-b2fe-aca113826b6b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:12:15 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance ec672d0a-06fd-4d15-b608-017e97ce2035 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:12:15 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:12:15 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:12:15 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Refreshing inventories for resource provider b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 03 05:12:15 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Updating ProviderTree inventory for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 03 05:12:15 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Updating inventory in ProviderTree for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 03 05:12:15 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Refreshing aggregate associations for resource provider b624a913-bb6b-4a17-8cd7-7b0950cff161, aggregates: None {{(pid=72444) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 03 05:12:15 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Refreshing trait associations for resource provider b624a913-bb6b-4a17-8cd7-7b0950cff161, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=72444) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 03 05:12:15 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:12:15 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:12:15 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:12:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.371s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:12:15 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:12:15 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72444) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 03 05:12:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:12:17 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:12:20 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:12:20 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:12:20 user nova-compute[72444]: INFO nova.compute.manager [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Unshelving
Aug 03 05:12:20 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:12:20 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:12:20 user nova-compute[72444]: DEBUG nova.objects.instance [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lazy-loading 'pci_requests' on Instance uuid f58f50ed-c8f1-4468-b919-0a5aa3d630b3 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:12:20 user nova-compute[72444]: DEBUG nova.objects.instance [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lazy-loading 'numa_topology' on Instance uuid f58f50ed-c8f1-4468-b919-0a5aa3d630b3 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:12:20 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 05:12:20 user nova-compute[72444]: INFO nova.compute.claims [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Claim successful on node user
Aug 03 05:12:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:12:20 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:12:20 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:12:20 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.239s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:12:20 user nova-compute[72444]: INFO nova.network.neutron [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Updating port 13b70ab9-69cc-4d4f-9a8a-a100d1401730 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 03 05:12:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "refresh_cache-f58f50ed-c8f1-4468-b919-0a5aa3d630b3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:12:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquired lock "refresh_cache-f58f50ed-c8f1-4468-b919-0a5aa3d630b3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:12:21 user nova-compute[72444]: DEBUG nova.network.neutron [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 05:12:21 user nova-compute[72444]: DEBUG nova.compute.manager [req-63357483-bce9-4dde-a1ce-07de44f3b312 req-7efbd88b-ab5e-46e7-88e6-76d3b5e07dc6 service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Received event network-changed-13b70ab9-69cc-4d4f-9a8a-a100d1401730 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:12:21 user nova-compute[72444]: DEBUG nova.compute.manager [req-63357483-bce9-4dde-a1ce-07de44f3b312 req-7efbd88b-ab5e-46e7-88e6-76d3b5e07dc6 service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Refreshing instance network info cache due to event network-changed-13b70ab9-69cc-4d4f-9a8a-a100d1401730. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:12:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-63357483-bce9-4dde-a1ce-07de44f3b312 req-7efbd88b-ab5e-46e7-88e6-76d3b5e07dc6 service nova] Acquiring lock "refresh_cache-f58f50ed-c8f1-4468-b919-0a5aa3d630b3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:12:21 user nova-compute[72444]: DEBUG nova.network.neutron [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Updating instance_info_cache with network_info: [{"id": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "address": "fa:16:3e:c7:96:a3", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b70ab9-69", "ovs_interfaceid": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:12:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Releasing lock "refresh_cache-f58f50ed-c8f1-4468-b919-0a5aa3d630b3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:12:21 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 05:12:21 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Creating image(s)
Aug 03 05:12:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "/opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:12:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "/opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:12:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "/opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:12:21 user nova-compute[72444]: DEBUG nova.objects.instance [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lazy-loading 'trusted_certs' on Instance uuid f58f50ed-c8f1-4468-b919-0a5aa3d630b3 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:12:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-63357483-bce9-4dde-a1ce-07de44f3b312 req-7efbd88b-ab5e-46e7-88e6-76d3b5e07dc6 service nova] Acquired lock "refresh_cache-f58f50ed-c8f1-4468-b919-0a5aa3d630b3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:12:21 user nova-compute[72444]: DEBUG nova.network.neutron [req-63357483-bce9-4dde-a1ce-07de44f3b312 req-7efbd88b-ab5e-46e7-88e6-76d3b5e07dc6 service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Refreshing network info cache for port 13b70ab9-69cc-4d4f-9a8a-a100d1401730 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:12:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "f696e590c80c2ec2521c55acdfb83162490dcdde" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:12:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "f696e590c80c2ec2521c55acdfb83162490dcdde" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:12:22 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f696e590c80c2ec2521c55acdfb83162490dcdde.part --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:12:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f696e590c80c2ec2521c55acdfb83162490dcdde.part --force-share --output=json" returned: 0 in 0.139s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:12:23 user nova-compute[72444]: DEBUG nova.virt.images [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] d15c3d7d-0f1f-4fb9-8463-7092f1646b7a was qcow2, converting to raw {{(pid=72444) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 03 05:12:23 user nova-compute[72444]: DEBUG nova.privsep.utils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72444) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 03 05:12:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f696e590c80c2ec2521c55acdfb83162490dcdde.part /opt/stack/data/nova/instances/_base/f696e590c80c2ec2521c55acdfb83162490dcdde.converted {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:12:23 user nova-compute[72444]: DEBUG nova.network.neutron [req-63357483-bce9-4dde-a1ce-07de44f3b312 req-7efbd88b-ab5e-46e7-88e6-76d3b5e07dc6 service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Updated VIF entry in instance network info cache for port 13b70ab9-69cc-4d4f-9a8a-a100d1401730. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:12:23 user nova-compute[72444]: DEBUG nova.network.neutron [req-63357483-bce9-4dde-a1ce-07de44f3b312 req-7efbd88b-ab5e-46e7-88e6-76d3b5e07dc6 service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Updating instance_info_cache with network_info: [{"id": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "address": "fa:16:3e:c7:96:a3", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b70ab9-69", "ovs_interfaceid": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:12:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-63357483-bce9-4dde-a1ce-07de44f3b312 req-7efbd88b-ab5e-46e7-88e6-76d3b5e07dc6 service nova] Releasing lock "refresh_cache-f58f50ed-c8f1-4468-b919-0a5aa3d630b3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:12:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f696e590c80c2ec2521c55acdfb83162490dcdde.part /opt/stack/data/nova/instances/_base/f696e590c80c2ec2521c55acdfb83162490dcdde.converted" returned: 0 in 0.557s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:12:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f696e590c80c2ec2521c55acdfb83162490dcdde.converted --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:12:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f696e590c80c2ec2521c55acdfb83162490dcdde.converted --force-share --output=json" returned: 0 in 0.133s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:12:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "f696e590c80c2ec2521c55acdfb83162490dcdde" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.933s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:12:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f696e590c80c2ec2521c55acdfb83162490dcdde --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:12:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f696e590c80c2ec2521c55acdfb83162490dcdde --force-share --output=json" returned: 0 in 0.126s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:12:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "f696e590c80c2ec2521c55acdfb83162490dcdde" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:12:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "f696e590c80c2ec2521c55acdfb83162490dcdde" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:12:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f696e590c80c2ec2521c55acdfb83162490dcdde --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:12:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f696e590c80c2ec2521c55acdfb83162490dcdde --force-share --output=json" returned: 0 in 0.128s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:12:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f696e590c80c2ec2521c55acdfb83162490dcdde,backing_fmt=raw /opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:12:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f696e590c80c2ec2521c55acdfb83162490dcdde,backing_fmt=raw /opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3/disk 1073741824" returned: 0 in 0.052s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:12:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "f696e590c80c2ec2521c55acdfb83162490dcdde" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:12:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f696e590c80c2ec2521c55acdfb83162490dcdde --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:12:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f696e590c80c2ec2521c55acdfb83162490dcdde --force-share --output=json" returned: 0 in 0.126s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:12:24 user nova-compute[72444]: DEBUG nova.objects.instance [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lazy-loading 'migration_context' on Instance uuid f58f50ed-c8f1-4468-b919-0a5aa3d630b3 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:12:24 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Rebasing disk image.
Aug 03 05:12:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:12:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.132s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:12:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e -F raw /opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3/disk {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:12:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e -F raw /opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3/disk" returned: 0 in 2.097s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Ensure instance console log exists: /opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Start _get_guest_xml network_info=[{"id": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "address": "fa:16:3e:c7:96:a3", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b70ab9-69", "ovs_interfaceid": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='52705e6f45894584f83c4d2e0dc1b77f',container_format='bare',created_at=2023-08-03T05:10:28Z,direct_url=<?>,disk_format='qcow2',id=d15c3d7d-0f1f-4fb9-8463-7092f1646b7a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1386279515-shelved',owner='ccf62b9ebb5f487184e3b84bbe7e73ad',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-03T05:10:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 05:12:26 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:12:26 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:12:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='52705e6f45894584f83c4d2e0dc1b77f',container_format='bare',created_at=2023-08-03T05:10:28Z,direct_url=<?>,disk_format='qcow2',id=d15c3d7d-0f1f-4fb9-8463-7092f1646b7a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1386279515-shelved',owner='ccf62b9ebb5f487184e3b84bbe7e73ad',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-03T05:10:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG nova.objects.instance [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lazy-loading 'vcpu_model' on Instance uuid f58f50ed-c8f1-4468-b919-0a5aa3d630b3 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-03T05:08:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1386279515',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1386279515',id=41,image_ref='d15c3d7d-0f1f-4fb9-8463-7092f1646b7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-592139302',keypairs=<?>,launch_index=0,launched_at=2023-08-03T05:08:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ccf62b9ebb5f487184e3b84bbe7e73ad',ramdisk_id='',reservation_id='r-38brd54j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-941210092',owner_user_name='tempest-AttachVolumeShelveTestJSON-941210092-project-member',shelved_at='2023-08-03T05:10:31.926125',shelved_host='user',shelved_image_id='d15c3d7d-0f1f-4fb9-8463-7092f1646b7a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:12:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bff27e3d2ae04049b35afe1bfcc7352b',uuid=f58f50ed-c8f1-4468-b919-0a5aa3d630b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "address": "fa:16:3e:c7:96:a3", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b70ab9-69", "ovs_interfaceid": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Converting VIF {"id": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "address": "fa:16:3e:c7:96:a3", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b70ab9-69", "ovs_interfaceid": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:96:a3,bridge_name='br-int',has_traffic_filtering=True,id=13b70ab9-69cc-4d4f-9a8a-a100d1401730,network=Network(3e3f34b4-1878-4a24-b0b2-ab0472fb62d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b70ab9-69') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG nova.objects.instance [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lazy-loading 'pci_devices' on Instance uuid f58f50ed-c8f1-4468-b919-0a5aa3d630b3 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] End _get_guest_xml xml=<domain type="kvm">
Aug 03 05:12:26 user nova-compute[72444]:   <uuid>f58f50ed-c8f1-4468-b919-0a5aa3d630b3</uuid>
Aug 03 05:12:26 user nova-compute[72444]:   <name>instance-00000029</name>
Aug 03 05:12:26 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 05:12:26 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 05:12:26 user nova-compute[72444]:   <metadata>
Aug 03 05:12:26 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 05:12:26 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 05:12:26 user nova-compute[72444]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1386279515</nova:name>
Aug 03 05:12:26 user nova-compute[72444]:       <nova:creationTime>2023-08-03 05:12:26</nova:creationTime>
Aug 03 05:12:26 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 05:12:26 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 05:12:26 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 05:12:26 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 05:12:26 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 05:12:26 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 05:12:26 user nova-compute[72444]:       </nova:flavor>
Aug 03 05:12:26 user nova-compute[72444]:       <nova:owner>
Aug 03 05:12:26 user nova-compute[72444]:         <nova:user uuid="bff27e3d2ae04049b35afe1bfcc7352b">tempest-AttachVolumeShelveTestJSON-941210092-project-member</nova:user>
Aug 03 05:12:26 user nova-compute[72444]:         <nova:project uuid="ccf62b9ebb5f487184e3b84bbe7e73ad">tempest-AttachVolumeShelveTestJSON-941210092</nova:project>
Aug 03 05:12:26 user nova-compute[72444]:       </nova:owner>
Aug 03 05:12:26 user nova-compute[72444]:       <nova:root type="image" uuid="d15c3d7d-0f1f-4fb9-8463-7092f1646b7a"/>
Aug 03 05:12:26 user nova-compute[72444]:       <nova:ports>
Aug 03 05:12:26 user nova-compute[72444]:         <nova:port uuid="13b70ab9-69cc-4d4f-9a8a-a100d1401730">
Aug 03 05:12:26 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 03 05:12:26 user nova-compute[72444]:         </nova:port>
Aug 03 05:12:26 user nova-compute[72444]:       </nova:ports>
Aug 03 05:12:26 user nova-compute[72444]:     </nova:instance>
Aug 03 05:12:26 user nova-compute[72444]:   </metadata>
Aug 03 05:12:26 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 05:12:26 user nova-compute[72444]:     <system>
Aug 03 05:12:26 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 05:12:26 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 05:12:26 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 05:12:26 user nova-compute[72444]:       <entry name="serial">f58f50ed-c8f1-4468-b919-0a5aa3d630b3</entry>
Aug 03 05:12:26 user nova-compute[72444]:       <entry name="uuid">f58f50ed-c8f1-4468-b919-0a5aa3d630b3</entry>
Aug 03 05:12:26 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 05:12:26 user nova-compute[72444]:     </system>
Aug 03 05:12:26 user nova-compute[72444]:   </sysinfo>
Aug 03 05:12:26 user nova-compute[72444]:   <os>
Aug 03 05:12:26 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 05:12:26 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 05:12:26 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 05:12:26 user nova-compute[72444]:   </os>
Aug 03 05:12:26 user nova-compute[72444]:   <features>
Aug 03 05:12:26 user nova-compute[72444]:     <acpi/>
Aug 03 05:12:26 user nova-compute[72444]:     <apic/>
Aug 03 05:12:26 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 05:12:26 user nova-compute[72444]:   </features>
Aug 03 05:12:26 user nova-compute[72444]:   <clock offset="utc">
Aug 03 05:12:26 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 05:12:26 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 05:12:26 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 05:12:26 user nova-compute[72444]:   </clock>
Aug 03 05:12:26 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 05:12:26 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 05:12:26 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 05:12:26 user nova-compute[72444]:   </cpu>
Aug 03 05:12:26 user nova-compute[72444]:   <devices>
Aug 03 05:12:26 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 05:12:26 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 05:12:26 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3/disk"/>
Aug 03 05:12:26 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 05:12:26 user nova-compute[72444]:     </disk>
Aug 03 05:12:26 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 05:12:26 user nova-compute[72444]:       <mac address="fa:16:3e:c7:96:a3"/>
Aug 03 05:12:26 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:12:26 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 05:12:26 user nova-compute[72444]:       <target dev="tap13b70ab9-69"/>
Aug 03 05:12:26 user nova-compute[72444]:     </interface>
Aug 03 05:12:26 user nova-compute[72444]:     <serial type="pty">
Aug 03 05:12:26 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3/console.log" append="off"/>
Aug 03 05:12:26 user nova-compute[72444]:     </serial>
Aug 03 05:12:26 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 05:12:26 user nova-compute[72444]:     <video>
Aug 03 05:12:26 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:12:26 user nova-compute[72444]:     </video>
Aug 03 05:12:26 user nova-compute[72444]:     <rng model="virtio">
Aug 03 05:12:26 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 05:12:26 user nova-compute[72444]:     </rng>
Aug 03 05:12:26 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 05:12:26 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 05:12:26 user nova-compute[72444]:       <stats period="10"/>
Aug 03 05:12:26 user nova-compute[72444]:     </memballoon>
Aug 03 05:12:26 user nova-compute[72444]:   </devices>
Aug 03 05:12:26 user nova-compute[72444]: </domain>
Aug 03 05:12:26 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-03T05:08:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1386279515',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1386279515',id=41,image_ref='d15c3d7d-0f1f-4fb9-8463-7092f1646b7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-592139302',keypairs=<?>,launch_index=0,launched_at=2023-08-03T05:08:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ccf62b9ebb5f487184e3b84bbe7e73ad',ramdisk_id='',reservation_id='r-38brd54j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-941210092',owner_user_name='tempest-AttachVolumeShelveTestJSON-941210092-project-member',shelved_at='2023-08-03T05:10:31.926125',shelved_host='user',shelved_image_id='d15c3d7d-0f1f-4fb9-8463-7092f1646b7a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:12:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bff27e3d2ae04049b35afe1bfcc7352b',uuid=f58f50ed-c8f1-4468-b919-0a5aa3d630b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "address": "fa:16:3e:c7:96:a3", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b70ab9-69", "ovs_interfaceid": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Converting VIF {"id": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "address": "fa:16:3e:c7:96:a3", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b70ab9-69", "ovs_interfaceid": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:96:a3,bridge_name='br-int',has_traffic_filtering=True,id=13b70ab9-69cc-4d4f-9a8a-a100d1401730,network=Network(3e3f34b4-1878-4a24-b0b2-ab0472fb62d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b70ab9-69') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG os_vif [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:96:a3,bridge_name='br-int',has_traffic_filtering=True,id=13b70ab9-69cc-4d4f-9a8a-a100d1401730,network=Network(3e3f34b4-1878-4a24-b0b2-ab0472fb62d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b70ab9-69') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13b70ab9-69, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap13b70ab9-69, col_values=(('external_ids', {'iface-id': '13b70ab9-69cc-4d4f-9a8a-a100d1401730', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:96:a3', 'vm-uuid': 'f58f50ed-c8f1-4468-b919-0a5aa3d630b3'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:12:26 user nova-compute[72444]: INFO os_vif [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:96:a3,bridge_name='br-int',has_traffic_filtering=True,id=13b70ab9-69cc-4d4f-9a8a-a100d1401730,network=Network(3e3f34b4-1878-4a24-b0b2-ab0472fb62d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b70ab9-69')
Aug 03 05:12:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:12:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] No VIF found with MAC fa:16:3e:c7:96:a3, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 05:12:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:12:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:12:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:12:28 user nova-compute[72444]: DEBUG nova.compute.manager [req-48b6aebe-a759-45a6-8ba8-3df62021a237 req-1086c63e-f436-4d1e-b0f0-9a9e3d2128fa service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Received event network-vif-plugged-13b70ab9-69cc-4d4f-9a8a-a100d1401730 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:12:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-48b6aebe-a759-45a6-8ba8-3df62021a237 req-1086c63e-f436-4d1e-b0f0-9a9e3d2128fa service nova] Acquiring lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:12:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-48b6aebe-a759-45a6-8ba8-3df62021a237 req-1086c63e-f436-4d1e-b0f0-9a9e3d2128fa service nova] Lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:12:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-48b6aebe-a759-45a6-8ba8-3df62021a237 req-1086c63e-f436-4d1e-b0f0-9a9e3d2128fa service nova] Lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:12:28 user nova-compute[72444]: DEBUG nova.compute.manager [req-48b6aebe-a759-45a6-8ba8-3df62021a237 req-1086c63e-f436-4d1e-b0f0-9a9e3d2128fa service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] No waiting events found dispatching network-vif-plugged-13b70ab9-69cc-4d4f-9a8a-a100d1401730 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:12:28 user nova-compute[72444]: WARNING nova.compute.manager [req-48b6aebe-a759-45a6-8ba8-3df62021a237 req-1086c63e-f436-4d1e-b0f0-9a9e3d2128fa service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Received unexpected event network-vif-plugged-13b70ab9-69cc-4d4f-9a8a-a100d1401730 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 03 05:12:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:12:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:12:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:12:30 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691039550.028518, f58f50ed-c8f1-4468-b919-0a5aa3d630b3 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:12:30 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] VM Resumed (Lifecycle Event)
Aug 03 05:12:30 user nova-compute[72444]: DEBUG nova.compute.manager [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 05:12:30 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 05:12:30 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Instance spawned successfully.
Aug 03 05:12:30 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:12:30 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:12:30 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 05:12:30 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691039550.0299833, f58f50ed-c8f1-4468-b919-0a5aa3d630b3 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:12:30 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] VM Started (Lifecycle Event)
Aug 03 05:12:30 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:12:30 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:12:30 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 05:12:30 user nova-compute[72444]: DEBUG nova.compute.manager [req-32084dde-3ea1-46e0-96c6-66f369e27ea1 req-b10ca8dd-e7c6-4f9b-a9d6-b16ae9aba951 service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Received event network-vif-plugged-13b70ab9-69cc-4d4f-9a8a-a100d1401730 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:12:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-32084dde-3ea1-46e0-96c6-66f369e27ea1 req-b10ca8dd-e7c6-4f9b-a9d6-b16ae9aba951 service nova] Acquiring lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:12:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-32084dde-3ea1-46e0-96c6-66f369e27ea1 req-b10ca8dd-e7c6-4f9b-a9d6-b16ae9aba951 service nova] Lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:12:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-32084dde-3ea1-46e0-96c6-66f369e27ea1 req-b10ca8dd-e7c6-4f9b-a9d6-b16ae9aba951 service nova] Lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:12:30 user nova-compute[72444]: DEBUG nova.compute.manager [req-32084dde-3ea1-46e0-96c6-66f369e27ea1 req-b10ca8dd-e7c6-4f9b-a9d6-b16ae9aba951 service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] No waiting events found dispatching network-vif-plugged-13b70ab9-69cc-4d4f-9a8a-a100d1401730 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:12:30 user nova-compute[72444]: WARNING nova.compute.manager [req-32084dde-3ea1-46e0-96c6-66f369e27ea1 req-b10ca8dd-e7c6-4f9b-a9d6-b16ae9aba951 service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Received unexpected event network-vif-plugged-13b70ab9-69cc-4d4f-9a8a-a100d1401730 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 03 05:12:30 user nova-compute[72444]: DEBUG nova.compute.manager [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:12:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5d6cc589-36fe-4dff-a2ee-69563e59d789 tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.118s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:12:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:12:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:12:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:12:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:12:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:12:46 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:12:49 user nova-compute[72444]: DEBUG nova.compute.manager [req-71b2f9ad-5d7d-408e-89a0-0c1232d6cd03 req-e8ab908d-023a-4c8c-a5ab-10dc30ae2743 service nova] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Received event network-changed-4dc8fd24-2dae-48e6-a580-da63dc368a37 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:12:49 user nova-compute[72444]: DEBUG nova.compute.manager [req-71b2f9ad-5d7d-408e-89a0-0c1232d6cd03 req-e8ab908d-023a-4c8c-a5ab-10dc30ae2743 service nova] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Refreshing instance network info cache due to event network-changed-4dc8fd24-2dae-48e6-a580-da63dc368a37. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:12:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-71b2f9ad-5d7d-408e-89a0-0c1232d6cd03 req-e8ab908d-023a-4c8c-a5ab-10dc30ae2743 service nova] Acquiring lock "refresh_cache-ec672d0a-06fd-4d15-b608-017e97ce2035" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:12:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-71b2f9ad-5d7d-408e-89a0-0c1232d6cd03 req-e8ab908d-023a-4c8c-a5ab-10dc30ae2743 service nova] Acquired lock "refresh_cache-ec672d0a-06fd-4d15-b608-017e97ce2035" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:12:49 user nova-compute[72444]: DEBUG nova.network.neutron [req-71b2f9ad-5d7d-408e-89a0-0c1232d6cd03 req-e8ab908d-023a-4c8c-a5ab-10dc30ae2743 service nova] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Refreshing network info cache for port 4dc8fd24-2dae-48e6-a580-da63dc368a37 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG nova.network.neutron [req-71b2f9ad-5d7d-408e-89a0-0c1232d6cd03 req-e8ab908d-023a-4c8c-a5ab-10dc30ae2743 service nova] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Updated VIF entry in instance network info cache for port 4dc8fd24-2dae-48e6-a580-da63dc368a37. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG nova.network.neutron [req-71b2f9ad-5d7d-408e-89a0-0c1232d6cd03 req-e8ab908d-023a-4c8c-a5ab-10dc30ae2743 service nova] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Updating instance_info_cache with network_info: [{"id": "4dc8fd24-2dae-48e6-a580-da63dc368a37", "address": "fa:16:3e:4a:2d:6b", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc8fd24-2d", "ovs_interfaceid": "4dc8fd24-2dae-48e6-a580-da63dc368a37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-71b2f9ad-5d7d-408e-89a0-0c1232d6cd03 req-e8ab908d-023a-4c8c-a5ab-10dc30ae2743 service nova] Releasing lock "refresh_cache-ec672d0a-06fd-4d15-b608-017e97ce2035" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "ec672d0a-06fd-4d15-b608-017e97ce2035" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "ec672d0a-06fd-4d15-b608-017e97ce2035" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "ec672d0a-06fd-4d15-b608-017e97ce2035-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "ec672d0a-06fd-4d15-b608-017e97ce2035-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "ec672d0a-06fd-4d15-b608-017e97ce2035-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:12:50 user nova-compute[72444]: INFO nova.compute.manager [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Terminating instance
Aug 03 05:12:50 user nova-compute[72444]: DEBUG nova.compute.manager [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG nova.compute.manager [req-d9b3a4a5-6886-45bc-b29a-46f59ee8c41f req-d236f579-dd1a-4553-a5e4-072613fc038b service nova] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Received event network-vif-unplugged-4dc8fd24-2dae-48e6-a580-da63dc368a37 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d9b3a4a5-6886-45bc-b29a-46f59ee8c41f req-d236f579-dd1a-4553-a5e4-072613fc038b service nova] Acquiring lock "ec672d0a-06fd-4d15-b608-017e97ce2035-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d9b3a4a5-6886-45bc-b29a-46f59ee8c41f req-d236f579-dd1a-4553-a5e4-072613fc038b service nova] Lock "ec672d0a-06fd-4d15-b608-017e97ce2035-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d9b3a4a5-6886-45bc-b29a-46f59ee8c41f req-d236f579-dd1a-4553-a5e4-072613fc038b service nova] Lock "ec672d0a-06fd-4d15-b608-017e97ce2035-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG nova.compute.manager [req-d9b3a4a5-6886-45bc-b29a-46f59ee8c41f req-d236f579-dd1a-4553-a5e4-072613fc038b service nova] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] No waiting events found dispatching network-vif-unplugged-4dc8fd24-2dae-48e6-a580-da63dc368a37 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG nova.compute.manager [req-d9b3a4a5-6886-45bc-b29a-46f59ee8c41f req-d236f579-dd1a-4553-a5e4-072613fc038b service nova] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Received event network-vif-unplugged-4dc8fd24-2dae-48e6-a580-da63dc368a37 for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 05:12:50 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Instance destroyed successfully.
Aug 03 05:12:50 user nova-compute[72444]: DEBUG nova.objects.instance [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lazy-loading 'resources' on Instance uuid ec672d0a-06fd-4d15-b608-017e97ce2035 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1876707565',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1876707565',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1876707565',id=44,image_ref='e67d4295-eada-41cb-a03e-0d3a60c7047d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/9Ic2C55M+91fZbMsEQQt6pLoqf0z3yYCZ7gLUJO4pwCs3xaLjOdwEI7+Qmhd7ExlvnMIrHeSD38ZygeihziB9C7n8880Qxc41Hr9hGXyUamVhCVG/5sUBWnWmTooEBw==',key_name='tempest-keypair-2097327391',keypairs=<?>,launch_index=0,launched_at=2023-08-03T05:11:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae931112fcda4e2f8dfd4f540d905139',ramdisk_id='',reservation_id='r-rqx0tbnd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1788747136',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1788747136-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1788747136',owner_user_name='tempest-TestVolumeBootPattern-1788747136-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T05:11:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef4d8130e33c4d9ea44c29be12f18234',uuid=ec672d0a-06fd-4d15-b608-017e97ce2035,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4dc8fd24-2dae-48e6-a580-da63dc368a37", "address": "fa:16:3e:4a:2d:6b", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc8fd24-2d", "ovs_interfaceid": "4dc8fd24-2dae-48e6-a580-da63dc368a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Converting VIF {"id": "4dc8fd24-2dae-48e6-a580-da63dc368a37", "address": "fa:16:3e:4a:2d:6b", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc8fd24-2d", "ovs_interfaceid": "4dc8fd24-2dae-48e6-a580-da63dc368a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:2d:6b,bridge_name='br-int',has_traffic_filtering=True,id=4dc8fd24-2dae-48e6-a580-da63dc368a37,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dc8fd24-2d') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG os_vif [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:2d:6b,bridge_name='br-int',has_traffic_filtering=True,id=4dc8fd24-2dae-48e6-a580-da63dc368a37,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dc8fd24-2d') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4dc8fd24-2d, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:12:50 user nova-compute[72444]: INFO os_vif [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:2d:6b,bridge_name='br-int',has_traffic_filtering=True,id=4dc8fd24-2dae-48e6-a580-da63dc368a37,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dc8fd24-2d')
Aug 03 05:12:50 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ajhvVbyc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:12:50 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:12:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3f9aa1-e81b-47df-b68e-6903cdf205aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0648c93e-4a04-449e-9788-3701d52c8e23]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 (non-flash)
Aug 03 05:12:50 user nova-compute[72444]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb (non-flash)
Aug 03 05:12:50 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 (non-flash)
Aug 03 05:12:50 user nova-compute[72444]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb (non-flash)
Aug 03 05:12:50 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308c3c3640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb'): ({'sdd'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Removing single pathed devices sdd {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9495d66-0030-4d44-bd8e-dec7b06c41c3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e449a43a-726a-4a14-8e99-eb0f087c7cf5]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Flushing IO for device /dev/sdd {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[787d5659-5e4f-4cee-b792-069868006700]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 05:12:50 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:12:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:12:51 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64e3e4c-a055-4b17-b4e7-7a6df133f0ba]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:12:51 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 05:12:51 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] SCSI volumes sdd have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 05:12:51 user nova-compute[72444]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO5a33abce-5a26d2eb6d419146', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5a33abce', '/dev/disk/by-id/scsi-23561323664326562') {{(pid=84280) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 03 05:12:51 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55e7801-0e79-4226-8c20-dea565e7b0d4]: (4, None) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:12:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 05:12:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:12:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:12:51 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[10951d8f-d00b-4a56-b250-bc3c148a1b9e]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:12:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:12:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:12:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:12:51 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff02ebf-7443-41d4-bf9f-3e32beba25c5]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:12:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb, portal: 172.16.0.220,3260]
Aug 03 05:12:51 user nova-compute[72444]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb, portal: 172.16.0.220,3260] successful.
Aug 03 05:12:51 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:12:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:12:51 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda2643b-18f7-41ce-b877-63fb96cc42bb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:12:51 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b682a2ba-353d-45bf-a18c-524d7018e02b]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:12:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:12:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:12:51 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] <== disconnect_volume: return (282ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:12:51 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 05:12:51 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Deleting instance files /opt/stack/data/nova/instances/ec672d0a-06fd-4d15-b608-017e97ce2035_del
Aug 03 05:12:51 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Deletion of /opt/stack/data/nova/instances/ec672d0a-06fd-4d15-b608-017e97ce2035_del complete
Aug 03 05:12:51 user nova-compute[72444]: INFO nova.compute.manager [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 03 05:12:51 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 05:12:51 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 05:12:51 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 05:12:51 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:12:51 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Took 0.77 seconds to deallocate network for instance.
Aug 03 05:12:52 user nova-compute[72444]: DEBUG nova.compute.manager [req-c9a999f8-e3f3-4d79-842c-a43c7be32220 req-bc21d9cc-d321-41a7-b093-b6fd0ee8bd8c service nova] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Received event network-vif-deleted-4dc8fd24-2dae-48e6-a580-da63dc368a37 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:12:52 user nova-compute[72444]: DEBUG nova.compute.manager [req-8a435411-6f5e-4737-83a4-74b6d1552014 req-22fc6f68-8c99-45da-a4ab-8a68b66d5d43 service nova] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Received event network-vif-plugged-4dc8fd24-2dae-48e6-a580-da63dc368a37 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:12:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8a435411-6f5e-4737-83a4-74b6d1552014 req-22fc6f68-8c99-45da-a4ab-8a68b66d5d43 service nova] Acquiring lock "ec672d0a-06fd-4d15-b608-017e97ce2035-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:12:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8a435411-6f5e-4737-83a4-74b6d1552014 req-22fc6f68-8c99-45da-a4ab-8a68b66d5d43 service nova] Lock "ec672d0a-06fd-4d15-b608-017e97ce2035-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:12:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8a435411-6f5e-4737-83a4-74b6d1552014 req-22fc6f68-8c99-45da-a4ab-8a68b66d5d43 service nova] Lock "ec672d0a-06fd-4d15-b608-017e97ce2035-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:12:52 user nova-compute[72444]: DEBUG nova.compute.manager [req-8a435411-6f5e-4737-83a4-74b6d1552014 req-22fc6f68-8c99-45da-a4ab-8a68b66d5d43 service nova] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] No waiting events found dispatching network-vif-plugged-4dc8fd24-2dae-48e6-a580-da63dc368a37 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:12:52 user nova-compute[72444]: WARNING nova.compute.manager [req-8a435411-6f5e-4737-83a4-74b6d1552014 req-22fc6f68-8c99-45da-a4ab-8a68b66d5d43 service nova] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Received unexpected event network-vif-plugged-4dc8fd24-2dae-48e6-a580-da63dc368a37 for instance with vm_state active and task_state deleting.
Aug 03 05:12:52 user nova-compute[72444]: INFO nova.compute.manager [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Took 0.69 seconds to detach 1 volumes for instance.
Aug 03 05:12:52 user nova-compute[72444]: DEBUG nova.compute.manager [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Deleting volume: dda2643b-18f7-41ce-b877-63fb96cc42bb {{(pid=72444) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 03 05:12:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:12:52 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:12:52 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:12:52 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:12:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.186s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:12:53 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Deleted allocations for instance ec672d0a-06fd-4d15-b608-017e97ce2035
Aug 03 05:12:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-141e86f4-c4e0-4b64-a926-78c6eac71949 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "ec672d0a-06fd-4d15-b608-017e97ce2035" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.130s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:12:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:12:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:13:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:13:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:13:05 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691039570.8005168, ec672d0a-06fd-4d15-b608-017e97ce2035 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:13:05 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] VM Stopped (Lifecycle Event)
Aug 03 05:13:05 user nova-compute[72444]: DEBUG nova.compute.manager [None req-a07bbcec-346a-48ea-bb87-81e8ce1a872c None None] [instance: ec672d0a-06fd-4d15-b608-017e97ce2035] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:13:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:13:06 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:13:07 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:13:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:13:10 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:13:11 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:13:11 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:13:11 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Didn't find any instances for network info cache update. {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 03 05:13:11 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:13:11 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 05:13:12 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:13:14 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:13:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:13:15 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:13:15 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:13:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:13:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:13:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:13:15 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:13:16 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 05:13:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:13:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:13:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:13:16 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:13:16 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:13:16 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:13:16 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=8575MB free_disk=25.379467010498047GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:13:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:13:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:13:16 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance bf8b022e-eb3d-4315-b2fe-aca113826b6b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:13:16 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance f58f50ed-c8f1-4468-b919-0a5aa3d630b3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:13:16 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:13:16 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:13:16 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:13:16 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:13:16 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:13:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.257s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:13:17 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:13:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:13:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:13:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:13:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:13:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:13:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "bf8b022e-eb3d-4315-b2fe-aca113826b6b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:13:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "bf8b022e-eb3d-4315-b2fe-aca113826b6b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:13:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "bf8b022e-eb3d-4315-b2fe-aca113826b6b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:13:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "bf8b022e-eb3d-4315-b2fe-aca113826b6b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:13:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "bf8b022e-eb3d-4315-b2fe-aca113826b6b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:13:43 user nova-compute[72444]: INFO nova.compute.manager [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Terminating instance
Aug 03 05:13:43 user nova-compute[72444]: DEBUG nova.compute.manager [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 05:13:43 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:13:43 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:13:43 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:13:43 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG nova.compute.manager [req-ac9c6b1b-a9df-47c4-b0e8-2d0e87d9730e req-5bdfc082-edb3-406c-a8f9-730eadece808 service nova] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Received event network-vif-unplugged-d9c036ff-c273-42a7-9add-024d41a7b0be {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ac9c6b1b-a9df-47c4-b0e8-2d0e87d9730e req-5bdfc082-edb3-406c-a8f9-730eadece808 service nova] Acquiring lock "bf8b022e-eb3d-4315-b2fe-aca113826b6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ac9c6b1b-a9df-47c4-b0e8-2d0e87d9730e req-5bdfc082-edb3-406c-a8f9-730eadece808 service nova] Lock "bf8b022e-eb3d-4315-b2fe-aca113826b6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ac9c6b1b-a9df-47c4-b0e8-2d0e87d9730e req-5bdfc082-edb3-406c-a8f9-730eadece808 service nova] Lock "bf8b022e-eb3d-4315-b2fe-aca113826b6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG nova.compute.manager [req-ac9c6b1b-a9df-47c4-b0e8-2d0e87d9730e req-5bdfc082-edb3-406c-a8f9-730eadece808 service nova] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] No waiting events found dispatching network-vif-unplugged-d9c036ff-c273-42a7-9add-024d41a7b0be {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG nova.compute.manager [req-ac9c6b1b-a9df-47c4-b0e8-2d0e87d9730e req-5bdfc082-edb3-406c-a8f9-730eadece808 service nova] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Received event network-vif-unplugged-d9c036ff-c273-42a7-9add-024d41a7b0be for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 05:13:44 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Instance destroyed successfully.
Aug 03 05:13:44 user nova-compute[72444]: DEBUG nova.objects.instance [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lazy-loading 'resources' on Instance uuid bf8b022e-eb3d-4315-b2fe-aca113826b6b {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:08:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1598415921',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1598415921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1598415921',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIT5Hl3gXjbHQicmXYbJG1uN306r+f5uwmgo0j8Wwc+0Tq8mZ8mw+ceSC04uhHrGDjRijAgRvwk+EZzyPx96HnwWGfWCmJQuGWsYsoB4lVL0EnJfnfTcHbtRaPEX3dFmFA==',key_name='tempest-keypair-140047733',keypairs=<?>,launch_index=0,launched_at=2023-08-03T05:09:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae931112fcda4e2f8dfd4f540d905139',ramdisk_id='',reservation_id='r-cx0q5956',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1788747136',owner_user_name='tempest-TestVolumeBootPattern-1788747136-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T05:09:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef4d8130e33c4d9ea44c29be12f18234',uuid=bf8b022e-eb3d-4315-b2fe-aca113826b6b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9c036ff-c273-42a7-9add-024d41a7b0be", "address": "fa:16:3e:41:62:4d", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c036ff-c2", "ovs_interfaceid": "d9c036ff-c273-42a7-9add-024d41a7b0be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Converting VIF {"id": "d9c036ff-c273-42a7-9add-024d41a7b0be", "address": "fa:16:3e:41:62:4d", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c036ff-c2", "ovs_interfaceid": "d9c036ff-c273-42a7-9add-024d41a7b0be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:62:4d,bridge_name='br-int',has_traffic_filtering=True,id=d9c036ff-c273-42a7-9add-024d41a7b0be,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9c036ff-c2') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG os_vif [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:62:4d,bridge_name='br-int',has_traffic_filtering=True,id=d9c036ff-c273-42a7-9add-024d41a7b0be,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9c036ff-c2') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9c036ff-c2, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:13:44 user nova-compute[72444]: INFO os_vif [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:62:4d,bridge_name='br-int',has_traffic_filtering=True,id=d9c036ff-c273-42a7-9add-024d41a7b0be,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9c036ff-c2')
Aug 03 05:13:44 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kTMYBCba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:13:44 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:13:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7228704e-5b84-401e-8af0-d7b066734d6f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[18889563-5cc0-40f0-96b6-e596df39a907]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 (non-flash)
Aug 03 05:13:44 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 (non-flash)
Aug 03 05:13:44 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30a0f33c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9'): ({'sdb'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Removing single pathed devices sdb {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[15577a69-473d-4125-9c1b-92073754d0ed]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89891be-0c18-4489-926b-098e5e0c31a0]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Flushing IO for device /dev/sdb {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1a0abc-bb9b-41b6-bcb4-145938e03c72]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a032e4a9-4628-4479-ac17-9ab1a3579b6a]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99999c1-e6f7-4540-87a6-12904ecd1dde]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1bcb8aa-728b-47a2-93ff-829a187ec90e]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9, portal: 172.16.0.220,3260]
Aug 03 05:13:44 user nova-compute[72444]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9, portal: 172.16.0.220,3260] successful.
Aug 03 05:13:44 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06519da-1db3-47c6-966b-2d8608926ab9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4039d7-7231-40c0-afc7-ab0bc2f24496]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.253s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] <== disconnect_volume: return (255ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 05:13:44 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Deleting instance files /opt/stack/data/nova/instances/bf8b022e-eb3d-4315-b2fe-aca113826b6b_del
Aug 03 05:13:44 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Deletion of /opt/stack/data/nova/instances/bf8b022e-eb3d-4315-b2fe-aca113826b6b_del complete
Aug 03 05:13:44 user nova-compute[72444]: INFO nova.compute.manager [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Took 1.10 seconds to destroy the instance on the hypervisor.
Aug 03 05:13:44 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 05:13:44 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 05:13:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:13:46 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:13:46 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Took 1.14 seconds to deallocate network for instance.
Aug 03 05:13:46 user nova-compute[72444]: DEBUG nova.compute.manager [req-0661311f-8a61-4f9d-ad9e-8277a495be3e req-f15d3ba1-2316-48b9-a596-f5cc3b692ca7 service nova] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Received event network-vif-deleted-d9c036ff-c273-42a7-9add-024d41a7b0be {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:13:46 user nova-compute[72444]: DEBUG nova.compute.manager [req-0947e0c8-6dbe-4e07-b58a-be42660ad9d3 req-d07ce2bb-0b95-40b6-a32a-49722e524385 service nova] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Received event network-vif-plugged-d9c036ff-c273-42a7-9add-024d41a7b0be {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:13:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0947e0c8-6dbe-4e07-b58a-be42660ad9d3 req-d07ce2bb-0b95-40b6-a32a-49722e524385 service nova] Acquiring lock "bf8b022e-eb3d-4315-b2fe-aca113826b6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:13:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0947e0c8-6dbe-4e07-b58a-be42660ad9d3 req-d07ce2bb-0b95-40b6-a32a-49722e524385 service nova] Lock "bf8b022e-eb3d-4315-b2fe-aca113826b6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:13:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0947e0c8-6dbe-4e07-b58a-be42660ad9d3 req-d07ce2bb-0b95-40b6-a32a-49722e524385 service nova] Lock "bf8b022e-eb3d-4315-b2fe-aca113826b6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:13:46 user nova-compute[72444]: DEBUG nova.compute.manager [req-0947e0c8-6dbe-4e07-b58a-be42660ad9d3 req-d07ce2bb-0b95-40b6-a32a-49722e524385 service nova] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] No waiting events found dispatching network-vif-plugged-d9c036ff-c273-42a7-9add-024d41a7b0be {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:13:46 user nova-compute[72444]: WARNING nova.compute.manager [req-0947e0c8-6dbe-4e07-b58a-be42660ad9d3 req-d07ce2bb-0b95-40b6-a32a-49722e524385 service nova] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Received unexpected event network-vif-plugged-d9c036ff-c273-42a7-9add-024d41a7b0be for instance with vm_state active and task_state deleting.
Aug 03 05:13:46 user nova-compute[72444]: INFO nova.compute.manager [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Took 0.72 seconds to detach 1 volumes for instance.
Aug 03 05:13:46 user nova-compute[72444]: DEBUG nova.compute.manager [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Deleting volume: e06519da-1db3-47c6-966b-2d8608926ab9 {{(pid=72444) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 03 05:13:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:13:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:13:46 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:13:46 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:13:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.129s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:13:47 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Deleted allocations for instance bf8b022e-eb3d-4315-b2fe-aca113826b6b
Aug 03 05:13:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2031d319-61b4-44ba-86fd-bb8364da6e2d tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "bf8b022e-eb3d-4315-b2fe-aca113826b6b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.331s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:13:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Acquiring lock "685818c7-b515-4118-a952-a52a5942c4e3" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:13:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lock "685818c7-b515-4118-a952-a52a5942c4e3" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:13:49 user nova-compute[72444]: INFO nova.compute.manager [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Unshelving
Aug 03 05:13:49 user nova-compute[72444]: INFO nova.virt.block_device [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Booting with volume 0297ed59-1a10-41d1-8550-7e7cdc0b471c at /dev/vda
Aug 03 05:13:49 user nova-compute[72444]: DEBUG os_brick.utils [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:13:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:13:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:13:49 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9c9978-e777-4214-bab4-8e4553a7e75e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:13:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:13:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:13:49 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4e2766-bcea-465b-929e-e02807a268e2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:13:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:13:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:13:49 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b80900-4ea1-40a1-9d55-be0df75b1aa6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:13:49 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[26257868-ab9e-4c63-a6ef-1d81a3fd7e66]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:13:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:13:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:13:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:13:49 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 05:13:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:13:49 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:13:49 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 05:13:49 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b474e24-f051-40f0-a985-2558b19bb3e4]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:13:49 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 05:13:49 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 05:13:49 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 05:13:49 user nova-compute[72444]: DEBUG os_brick.utils [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:13:49 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Updating existing volume attachment record: 4418b968-75fd-4b85-8d8c-976ec97b35e0 {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 05:13:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:13:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:13:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:13:56 user nova-compute[72444]: DEBUG nova.objects.instance [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lazy-loading 'pci_requests' on Instance uuid 685818c7-b515-4118-a952-a52a5942c4e3 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:13:56 user nova-compute[72444]: DEBUG nova.objects.instance [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lazy-loading 'numa_topology' on Instance uuid 685818c7-b515-4118-a952-a52a5942c4e3 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:13:56 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 05:13:56 user nova-compute[72444]: INFO nova.compute.claims [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Claim successful on node user
Aug 03 05:13:56 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:13:56 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:13:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.252s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:13:57 user nova-compute[72444]: INFO nova.network.neutron [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Updating port 15762642-ded6-4ef6-90c7-46bf3a884904 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 03 05:13:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Acquiring lock "refresh_cache-685818c7-b515-4118-a952-a52a5942c4e3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:13:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Acquired lock "refresh_cache-685818c7-b515-4118-a952-a52a5942c4e3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:13:57 user nova-compute[72444]: DEBUG nova.network.neutron [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG nova.compute.manager [req-5fced67b-b2d3-412a-b8f6-f175f5a6d20d req-379820f0-7a13-492a-a2b8-93424f0f2488 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Received event network-changed-15762642-ded6-4ef6-90c7-46bf3a884904 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG nova.compute.manager [req-5fced67b-b2d3-412a-b8f6-f175f5a6d20d req-379820f0-7a13-492a-a2b8-93424f0f2488 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Refreshing instance network info cache due to event network-changed-15762642-ded6-4ef6-90c7-46bf3a884904. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5fced67b-b2d3-412a-b8f6-f175f5a6d20d req-379820f0-7a13-492a-a2b8-93424f0f2488 service nova] Acquiring lock "refresh_cache-685818c7-b515-4118-a952-a52a5942c4e3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG nova.network.neutron [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Updating instance_info_cache with network_info: [{"id": "15762642-ded6-4ef6-90c7-46bf3a884904", "address": "fa:16:3e:9b:fd:92", "network": {"id": "7057d5fc-5467-4681-8ed0-5243099b3df3", "bridge": "br-int", "label": "tempest-TestShelveInstance-5073894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df9034b591f2496fbef89f59646a31cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15762642-de", "ovs_interfaceid": "15762642-ded6-4ef6-90c7-46bf3a884904", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Releasing lock "refresh_cache-685818c7-b515-4118-a952-a52a5942c4e3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 05:13:58 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Creating image(s)
Aug 03 05:13:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Did not create local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Ensure instance console log exists: /opt/stack/data/nova/instances/685818c7-b515-4118-a952-a52a5942c4e3/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Start _get_guest_xml network_info=[{"id": "15762642-ded6-4ef6-90c7-46bf3a884904", "address": "fa:16:3e:9b:fd:92", "network": {"id": "7057d5fc-5467-4681-8ed0-5243099b3df3", "bridge": "br-int", "label": "tempest-TestShelveInstance-5073894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df9034b591f2496fbef89f59646a31cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15762642-de", "ovs_interfaceid": "15762642-ded6-4ef6-90c7-46bf3a884904", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MGJqnglX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '685818c7-b515-4118-a952-a52a5942c4e3', 'attached_at': '', 'detached_at': '', 'volume_id': '0297ed59-1a10-41d1-8550-7e7cdc0b471c', 'serial': '0297ed59-1a10-41d1-8550-7e7cdc0b471c'}, 'disk_bus': 'virtio', 'attachment_id': '4418b968-75fd-4b85-8d8c-976ec97b35e0', 'guest_format': None, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5fced67b-b2d3-412a-b8f6-f175f5a6d20d req-379820f0-7a13-492a-a2b8-93424f0f2488 service nova] Acquired lock "refresh_cache-685818c7-b515-4118-a952-a52a5942c4e3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG nova.network.neutron [req-5fced67b-b2d3-412a-b8f6-f175f5a6d20d req-379820f0-7a13-492a-a2b8-93424f0f2488 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Refreshing network info cache for port 15762642-ded6-4ef6-90c7-46bf3a884904 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:13:58 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:13:58 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:13:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG nova.objects.instance [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lazy-loading 'vcpu_model' on Instance uuid 685818c7-b515-4118-a952-a52a5942c4e3 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MGJqnglX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:13:58 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:13:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:13:58 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:13:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:13:58 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[39bd84e7-aa0a-487e-be1b-63d005ac955a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 05:13:58 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f759e30-7a3e-47df-9ace-29d54d5e1ed0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c] added
Aug 03 05:13:58 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6f46b3-2381-41fb-ba95-135e8a8b3011]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb14af9a-054f-419b-ad22-9b8d13fe806e]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MGJqnglX {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MGJqnglX" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a6e417-d676-458c-ab7b-ba1ae063f95d]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MGJqnglX'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6d51d7-0a19-4026-aad8-e4106603a8c9]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[359ef5f7-9fc4-41de-bd20-5b45978daba9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 03 05:13:58 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 03 05:13:58 user nova-compute[72444]:  {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:13:58 user nova-compute[72444]: WARNING os_brick.initiator.connectors.iscsi [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 03 05:13:58 user nova-compute[72444]: 
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f12b32-3561-4460-83eb-578191c913ea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c, portal: 172.16.0.220,3260]
Aug 03 05:13:58 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c, portal: 172.16.0.220,3260] successful.
Aug 03 05:13:58 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[75353442-9ed5-4ee0-9191-23904b44fc5d]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f01ea1-b6b6-4dec-bdcd-dbb5308cbaa0]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c (non-flash)
Aug 03 05:13:58 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c (non-flash)
Aug 03 05:13:58 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[515eb440-c684-409a-9ead-32d533741720]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG nova.network.neutron [req-5fced67b-b2d3-412a-b8f6-f175f5a6d20d req-379820f0-7a13-492a-a2b8-93424f0f2488 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Updated VIF entry in instance network info cache for port 15762642-ded6-4ef6-90c7-46bf3a884904. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG nova.network.neutron [req-5fced67b-b2d3-412a-b8f6-f175f5a6d20d req-379820f0-7a13-492a-a2b8-93424f0f2488 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Updating instance_info_cache with network_info: [{"id": "15762642-ded6-4ef6-90c7-46bf3a884904", "address": "fa:16:3e:9b:fd:92", "network": {"id": "7057d5fc-5467-4681-8ed0-5243099b3df3", "bridge": "br-int", "label": "tempest-TestShelveInstance-5073894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df9034b591f2496fbef89f59646a31cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15762642-de", "ovs_interfaceid": "15762642-ded6-4ef6-90c7-46bf3a884904", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:13:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-5fced67b-b2d3-412a-b8f6-f175f5a6d20d req-379820f0-7a13-492a-a2b8-93424f0f2488 service nova] Releasing lock "refresh_cache-685818c7-b515-4118-a952-a52a5942c4e3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:13:59 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691039624.5086763, bf8b022e-eb3d-4315-b2fe-aca113826b6b => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:13:59 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] VM Stopped (Lifecycle Event)
Aug 03 05:13:59 user nova-compute[72444]: DEBUG nova.compute.manager [None req-2d6c6483-0254-4710-b94d-cebcfaec71c3 None None] [instance: bf8b022e-eb3d-4315-b2fe-aca113826b6b] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:13:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:13:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:13:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:13:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:13:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:13:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:13:59 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 05:13:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MGJqnglX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 05:13:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:13:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '23030326332383864', 'path': '/dev/sdb'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:13:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030326332383864', 'path': '/dev/sdb'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 05:13:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-03T05:10:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1129121706',display_name='tempest-TestShelveInstance-server-1129121706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1129121706',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-18244009',keypairs=<?>,launch_index=0,launched_at=2023-08-03T05:10:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='df9034b591f2496fbef89f59646a31cc',ramdisk_id='',reservation_id='r-cyiehe4p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-98284952',owner_user_name='tempest-TestShelveInstance-98284952-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T05:13:49Z,user_data=None,user_id='566ccf33576b48dd8efe2427e8410d62',uuid=685818c7-b515-4118-a952-a52a5942c4e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "15762642-ded6-4ef6-90c7-46bf3a884904", "address": "fa:16:3e:9b:fd:92", "network": {"id": "7057d5fc-5467-4681-8ed0-5243099b3df3", "bridge": "br-int", "label": "tempest-TestShelveInstance-5073894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df9034b591f2496fbef89f59646a31cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15762642-de", "ovs_interfaceid": "15762642-ded6-4ef6-90c7-46bf3a884904", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 05:13:59 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Converting VIF {"id": "15762642-ded6-4ef6-90c7-46bf3a884904", "address": "fa:16:3e:9b:fd:92", "network": {"id": "7057d5fc-5467-4681-8ed0-5243099b3df3", "bridge": "br-int", "label": "tempest-TestShelveInstance-5073894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df9034b591f2496fbef89f59646a31cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15762642-de", "ovs_interfaceid": "15762642-ded6-4ef6-90c7-46bf3a884904", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:13:59 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:fd:92,bridge_name='br-int',has_traffic_filtering=True,id=15762642-ded6-4ef6-90c7-46bf3a884904,network=Network(7057d5fc-5467-4681-8ed0-5243099b3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15762642-de') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:13:59 user nova-compute[72444]: DEBUG nova.objects.instance [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lazy-loading 'pci_devices' on Instance uuid 685818c7-b515-4118-a952-a52a5942c4e3 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:13:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] End _get_guest_xml xml=<domain type="kvm">
Aug 03 05:13:59 user nova-compute[72444]:   <uuid>685818c7-b515-4118-a952-a52a5942c4e3</uuid>
Aug 03 05:13:59 user nova-compute[72444]:   <name>instance-0000002b</name>
Aug 03 05:13:59 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 05:13:59 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 05:13:59 user nova-compute[72444]:   <metadata>
Aug 03 05:13:59 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 05:13:59 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 05:13:59 user nova-compute[72444]:       <nova:name>tempest-TestShelveInstance-server-1129121706</nova:name>
Aug 03 05:13:59 user nova-compute[72444]:       <nova:creationTime>2023-08-03 05:13:58</nova:creationTime>
Aug 03 05:13:59 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 05:13:59 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 05:13:59 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 05:13:59 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 05:13:59 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 05:13:59 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 05:13:59 user nova-compute[72444]:       </nova:flavor>
Aug 03 05:13:59 user nova-compute[72444]:       <nova:owner>
Aug 03 05:13:59 user nova-compute[72444]:         <nova:user uuid="566ccf33576b48dd8efe2427e8410d62">tempest-TestShelveInstance-98284952-project-member</nova:user>
Aug 03 05:13:59 user nova-compute[72444]:         <nova:project uuid="df9034b591f2496fbef89f59646a31cc">tempest-TestShelveInstance-98284952</nova:project>
Aug 03 05:13:59 user nova-compute[72444]:       </nova:owner>
Aug 03 05:13:59 user nova-compute[72444]:       <nova:ports>
Aug 03 05:13:59 user nova-compute[72444]:         <nova:port uuid="15762642-ded6-4ef6-90c7-46bf3a884904">
Aug 03 05:13:59 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 03 05:13:59 user nova-compute[72444]:         </nova:port>
Aug 03 05:13:59 user nova-compute[72444]:       </nova:ports>
Aug 03 05:13:59 user nova-compute[72444]:     </nova:instance>
Aug 03 05:13:59 user nova-compute[72444]:   </metadata>
Aug 03 05:13:59 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 05:13:59 user nova-compute[72444]:     <system>
Aug 03 05:13:59 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 05:13:59 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 05:13:59 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 05:13:59 user nova-compute[72444]:       <entry name="serial">685818c7-b515-4118-a952-a52a5942c4e3</entry>
Aug 03 05:13:59 user nova-compute[72444]:       <entry name="uuid">685818c7-b515-4118-a952-a52a5942c4e3</entry>
Aug 03 05:13:59 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 05:13:59 user nova-compute[72444]:     </system>
Aug 03 05:13:59 user nova-compute[72444]:   </sysinfo>
Aug 03 05:13:59 user nova-compute[72444]:   <os>
Aug 03 05:13:59 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 05:13:59 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 05:13:59 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 05:13:59 user nova-compute[72444]:   </os>
Aug 03 05:13:59 user nova-compute[72444]:   <features>
Aug 03 05:13:59 user nova-compute[72444]:     <acpi/>
Aug 03 05:13:59 user nova-compute[72444]:     <apic/>
Aug 03 05:13:59 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 05:13:59 user nova-compute[72444]:   </features>
Aug 03 05:13:59 user nova-compute[72444]:   <clock offset="utc">
Aug 03 05:13:59 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 05:13:59 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 05:13:59 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 05:13:59 user nova-compute[72444]:   </clock>
Aug 03 05:13:59 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 05:13:59 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 05:13:59 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 05:13:59 user nova-compute[72444]:   </cpu>
Aug 03 05:13:59 user nova-compute[72444]:   <devices>
Aug 03 05:13:59 user nova-compute[72444]:     <disk type="block" device="disk">
Aug 03 05:13:59 user nova-compute[72444]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:13:59 user nova-compute[72444]:       <source dev="/dev/sdb"/>
Aug 03 05:13:59 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 05:13:59 user nova-compute[72444]:       <serial>0297ed59-1a10-41d1-8550-7e7cdc0b471c</serial>
Aug 03 05:13:59 user nova-compute[72444]:     </disk>
Aug 03 05:13:59 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 05:13:59 user nova-compute[72444]:       <mac address="fa:16:3e:9b:fd:92"/>
Aug 03 05:13:59 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:13:59 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 05:13:59 user nova-compute[72444]:       <target dev="tap15762642-de"/>
Aug 03 05:13:59 user nova-compute[72444]:     </interface>
Aug 03 05:13:59 user nova-compute[72444]:     <serial type="pty">
Aug 03 05:13:59 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/685818c7-b515-4118-a952-a52a5942c4e3/console.log" append="off"/>
Aug 03 05:13:59 user nova-compute[72444]:     </serial>
Aug 03 05:13:59 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 05:13:59 user nova-compute[72444]:     <video>
Aug 03 05:13:59 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:13:59 user nova-compute[72444]:     </video>
Aug 03 05:13:59 user nova-compute[72444]:     <rng model="virtio">
Aug 03 05:13:59 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 05:13:59 user nova-compute[72444]:     </rng>
Aug 03 05:13:59 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 05:13:59 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 05:13:59 user nova-compute[72444]:       <stats period="10"/>
Aug 03 05:13:59 user nova-compute[72444]:     </memballoon>
Aug 03 05:13:59 user nova-compute[72444]:   </devices>
Aug 03 05:13:59 user nova-compute[72444]: </domain>
Aug 03 05:13:59 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 05:13:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-03T05:10:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1129121706',display_name='tempest-TestShelveInstance-server-1129121706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1129121706',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-18244009',keypairs=<?>,launch_index=0,launched_at=2023-08-03T05:10:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='df9034b591f2496fbef89f59646a31cc',ramdisk_id='',reservation_id='r-cyiehe4p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-98284952',owner_user_name='tempest-TestShelveInstance-98284952-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T05:13:49Z,user_data=None,user_id='566ccf33576b48dd8efe2427e8410d62',uuid=685818c7-b515-4118-a952-a52a5942c4e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "15762642-ded6-4ef6-90c7-46bf3a884904", "address": "fa:16:3e:9b:fd:92", "network": {"id": "7057d5fc-5467-4681-8ed0-5243099b3df3", "bridge": "br-int", "label": "tempest-TestShelveInstance-5073894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df9034b591f2496fbef89f59646a31cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15762642-de", "ovs_interfaceid": "15762642-ded6-4ef6-90c7-46bf3a884904", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 05:13:59 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Converting VIF {"id": "15762642-ded6-4ef6-90c7-46bf3a884904", "address": "fa:16:3e:9b:fd:92", "network": {"id": "7057d5fc-5467-4681-8ed0-5243099b3df3", "bridge": "br-int", "label": "tempest-TestShelveInstance-5073894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df9034b591f2496fbef89f59646a31cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15762642-de", "ovs_interfaceid": "15762642-ded6-4ef6-90c7-46bf3a884904", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:13:59 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:fd:92,bridge_name='br-int',has_traffic_filtering=True,id=15762642-ded6-4ef6-90c7-46bf3a884904,network=Network(7057d5fc-5467-4681-8ed0-5243099b3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15762642-de') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:13:59 user nova-compute[72444]: DEBUG os_vif [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:fd:92,bridge_name='br-int',has_traffic_filtering=True,id=15762642-ded6-4ef6-90c7-46bf3a884904,network=Network(7057d5fc-5467-4681-8ed0-5243099b3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15762642-de') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 05:13:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:13:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:13:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 05:13:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:13:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15762642-de, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:13:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap15762642-de, col_values=(('external_ids', {'iface-id': '15762642-ded6-4ef6-90c7-46bf3a884904', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:fd:92', 'vm-uuid': '685818c7-b515-4118-a952-a52a5942c4e3'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:13:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:13:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:13:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:13:59 user nova-compute[72444]: INFO os_vif [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:fd:92,bridge_name='br-int',has_traffic_filtering=True,id=15762642-ded6-4ef6-90c7-46bf3a884904,network=Network(7057d5fc-5467-4681-8ed0-5243099b3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15762642-de')
Aug 03 05:13:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:13:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] No VIF found with MAC fa:16:3e:9b:fd:92, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 05:14:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:14:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:14:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:14:01 user nova-compute[72444]: DEBUG nova.compute.manager [req-58bc994b-08c1-4e67-b451-d80a7bc49d92 req-3091e026-ab74-4db9-b60e-7763dcaa906b service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Received event network-vif-plugged-15762642-ded6-4ef6-90c7-46bf3a884904 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:14:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-58bc994b-08c1-4e67-b451-d80a7bc49d92 req-3091e026-ab74-4db9-b60e-7763dcaa906b service nova] Acquiring lock "685818c7-b515-4118-a952-a52a5942c4e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:14:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-58bc994b-08c1-4e67-b451-d80a7bc49d92 req-3091e026-ab74-4db9-b60e-7763dcaa906b service nova] Lock "685818c7-b515-4118-a952-a52a5942c4e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:14:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-58bc994b-08c1-4e67-b451-d80a7bc49d92 req-3091e026-ab74-4db9-b60e-7763dcaa906b service nova] Lock "685818c7-b515-4118-a952-a52a5942c4e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:14:01 user nova-compute[72444]: DEBUG nova.compute.manager [req-58bc994b-08c1-4e67-b451-d80a7bc49d92 req-3091e026-ab74-4db9-b60e-7763dcaa906b service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] No waiting events found dispatching network-vif-plugged-15762642-ded6-4ef6-90c7-46bf3a884904 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:14:01 user nova-compute[72444]: WARNING nova.compute.manager [req-58bc994b-08c1-4e67-b451-d80a7bc49d92 req-3091e026-ab74-4db9-b60e-7763dcaa906b service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Received unexpected event network-vif-plugged-15762642-ded6-4ef6-90c7-46bf3a884904 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 03 05:14:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:14:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:14:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:14:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:14:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:14:03 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691039643.1902852, 685818c7-b515-4118-a952-a52a5942c4e3 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:14:03 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] VM Resumed (Lifecycle Event)
Aug 03 05:14:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 05:14:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 05:14:03 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Instance spawned successfully.
Aug 03 05:14:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:14:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:14:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:14:03 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 05:14:03 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691039643.191809, 685818c7-b515-4118-a952-a52a5942c4e3 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:14:03 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] VM Started (Lifecycle Event)
Aug 03 05:14:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:14:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-70ab0f55-f814-4058-bf10-29999a10d748 tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lock "685818c7-b515-4118-a952-a52a5942c4e3" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.925s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:14:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:14:03 user nova-compute[72444]: DEBUG nova.compute.manager [req-e19da5ec-3d59-4cdd-8248-59104b750419 req-ccc8e929-44ec-4979-99a3-38f06f6a91d1 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Received event network-vif-plugged-15762642-ded6-4ef6-90c7-46bf3a884904 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:14:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e19da5ec-3d59-4cdd-8248-59104b750419 req-ccc8e929-44ec-4979-99a3-38f06f6a91d1 service nova] Acquiring lock "685818c7-b515-4118-a952-a52a5942c4e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:14:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e19da5ec-3d59-4cdd-8248-59104b750419 req-ccc8e929-44ec-4979-99a3-38f06f6a91d1 service nova] Lock "685818c7-b515-4118-a952-a52a5942c4e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:14:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e19da5ec-3d59-4cdd-8248-59104b750419 req-ccc8e929-44ec-4979-99a3-38f06f6a91d1 service nova] Lock "685818c7-b515-4118-a952-a52a5942c4e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:14:03 user nova-compute[72444]: DEBUG nova.compute.manager [req-e19da5ec-3d59-4cdd-8248-59104b750419 req-ccc8e929-44ec-4979-99a3-38f06f6a91d1 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] No waiting events found dispatching network-vif-plugged-15762642-ded6-4ef6-90c7-46bf3a884904 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:14:03 user nova-compute[72444]: WARNING nova.compute.manager [req-e19da5ec-3d59-4cdd-8248-59104b750419 req-ccc8e929-44ec-4979-99a3-38f06f6a91d1 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Received unexpected event network-vif-plugged-15762642-ded6-4ef6-90c7-46bf3a884904 for instance with vm_state active and task_state None.
Aug 03 05:14:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:14:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:14:08 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:14:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:14:09 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:14:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8bdaff35-2a74-429f-a000-360ea5e00c3d tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:14:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8bdaff35-2a74-429f-a000-360ea5e00c3d tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:14:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8bdaff35-2a74-429f-a000-360ea5e00c3d tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:14:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8bdaff35-2a74-429f-a000-360ea5e00c3d tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:14:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8bdaff35-2a74-429f-a000-360ea5e00c3d tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:14:10 user nova-compute[72444]: INFO nova.compute.manager [None req-8bdaff35-2a74-429f-a000-360ea5e00c3d tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Terminating instance
Aug 03 05:14:10 user nova-compute[72444]: DEBUG nova.compute.manager [None req-8bdaff35-2a74-429f-a000-360ea5e00c3d tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 05:14:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:14:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:14:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:14:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:14:10 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:14:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:14:11 user nova-compute[72444]: DEBUG nova.compute.manager [req-450675c1-b989-4b3c-9497-2712e31b6b1c req-ed782a56-7475-495d-b1ae-8f7440fca02c service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Received event network-vif-unplugged-13b70ab9-69cc-4d4f-9a8a-a100d1401730 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:14:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-450675c1-b989-4b3c-9497-2712e31b6b1c req-ed782a56-7475-495d-b1ae-8f7440fca02c service nova] Acquiring lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:14:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-450675c1-b989-4b3c-9497-2712e31b6b1c req-ed782a56-7475-495d-b1ae-8f7440fca02c service nova] Lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:14:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-450675c1-b989-4b3c-9497-2712e31b6b1c req-ed782a56-7475-495d-b1ae-8f7440fca02c service nova] Lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:14:11 user nova-compute[72444]: DEBUG nova.compute.manager [req-450675c1-b989-4b3c-9497-2712e31b6b1c req-ed782a56-7475-495d-b1ae-8f7440fca02c service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] No waiting events found dispatching network-vif-unplugged-13b70ab9-69cc-4d4f-9a8a-a100d1401730 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:14:11 user nova-compute[72444]: DEBUG nova.compute.manager [req-450675c1-b989-4b3c-9497-2712e31b6b1c req-ed782a56-7475-495d-b1ae-8f7440fca02c service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Received event network-vif-unplugged-13b70ab9-69cc-4d4f-9a8a-a100d1401730 for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 05:14:11 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Instance destroyed successfully.
Aug 03 05:14:11 user nova-compute[72444]: DEBUG nova.objects.instance [None req-8bdaff35-2a74-429f-a000-360ea5e00c3d tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lazy-loading 'resources' on Instance uuid f58f50ed-c8f1-4468-b919-0a5aa3d630b3 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:14:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-8bdaff35-2a74-429f-a000-360ea5e00c3d tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-03T05:08:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1386279515',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1386279515',id=41,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKwBS6VH+8+Zjncxxqwf6lSCfoolZ+1flhdWAiismKhDCjeyiT0KQv/moXMgsKxRKPdMD0euVaGQEkYvPQrRbgz0gJ7DoHqkcatTOpkTGrAK8fUAMB4od9QWxCJoMWRgg==',key_name='tempest-keypair-592139302',keypairs=<?>,launch_index=0,launched_at=2023-08-03T05:12:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ccf62b9ebb5f487184e3b84bbe7e73ad',ramdisk_id='',reservation_id='r-38brd54j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-941210092',owner_user_name='tempest-AttachVolumeShelveTestJSON-941210092-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T05:12:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bff27e3d2ae04049b35afe1bfcc7352b',uuid=f58f50ed-c8f1-4468-b919-0a5aa3d630b3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "address": "fa:16:3e:c7:96:a3", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b70ab9-69", "ovs_interfaceid": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 05:14:11 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-8bdaff35-2a74-429f-a000-360ea5e00c3d tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Converting VIF {"id": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "address": "fa:16:3e:c7:96:a3", "network": {"id": "3e3f34b4-1878-4a24-b0b2-ab0472fb62d4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1097152396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf62b9ebb5f487184e3b84bbe7e73ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b70ab9-69", "ovs_interfaceid": "13b70ab9-69cc-4d4f-9a8a-a100d1401730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:14:11 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-8bdaff35-2a74-429f-a000-360ea5e00c3d tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:96:a3,bridge_name='br-int',has_traffic_filtering=True,id=13b70ab9-69cc-4d4f-9a8a-a100d1401730,network=Network(3e3f34b4-1878-4a24-b0b2-ab0472fb62d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b70ab9-69') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:14:11 user nova-compute[72444]: DEBUG os_vif [None req-8bdaff35-2a74-429f-a000-360ea5e00c3d tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:96:a3,bridge_name='br-int',has_traffic_filtering=True,id=13b70ab9-69cc-4d4f-9a8a-a100d1401730,network=Network(3e3f34b4-1878-4a24-b0b2-ab0472fb62d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b70ab9-69') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 05:14:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:14:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13b70ab9-69, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:14:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:14:11 user nova-compute[72444]: INFO os_vif [None req-8bdaff35-2a74-429f-a000-360ea5e00c3d tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:96:a3,bridge_name='br-int',has_traffic_filtering=True,id=13b70ab9-69cc-4d4f-9a8a-a100d1401730,network=Network(3e3f34b4-1878-4a24-b0b2-ab0472fb62d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b70ab9-69')
Aug 03 05:14:11 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-8bdaff35-2a74-429f-a000-360ea5e00c3d tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Deleting instance files /opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3_del
Aug 03 05:14:11 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-8bdaff35-2a74-429f-a000-360ea5e00c3d tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Deletion of /opt/stack/data/nova/instances/f58f50ed-c8f1-4468-b919-0a5aa3d630b3_del complete
Aug 03 05:14:11 user nova-compute[72444]: INFO nova.compute.manager [None req-8bdaff35-2a74-429f-a000-360ea5e00c3d tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 03 05:14:11 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-8bdaff35-2a74-429f-a000-360ea5e00c3d tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 05:14:11 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 05:14:11 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 05:14:11 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:14:11 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:14:11 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Rebuilding the list of instances to heal {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 05:14:11 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Skipping network cache update for instance because it is being deleted. {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9859}}
Aug 03 05:14:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-685818c7-b515-4118-a952-a52a5942c4e3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:14:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-685818c7-b515-4118-a952-a52a5942c4e3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:14:11 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 05:14:11 user nova-compute[72444]: DEBUG nova.objects.instance [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lazy-loading 'info_cache' on Instance uuid 685818c7-b515-4118-a952-a52a5942c4e3 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:14:12 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:14:12 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Took 0.90 seconds to deallocate network for instance.
Aug 03 05:14:12 user nova-compute[72444]: DEBUG nova.compute.manager [req-1ea8ca25-c693-4a30-a96b-d350ff07db86 req-736a5539-2f08-4dc4-bd6c-fbe71bc2acd2 service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Received event network-vif-deleted-13b70ab9-69cc-4d4f-9a8a-a100d1401730 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:14:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8bdaff35-2a74-429f-a000-360ea5e00c3d tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:14:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8bdaff35-2a74-429f-a000-360ea5e00c3d tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:14:12 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Updating instance_info_cache with network_info: [{"id": "15762642-ded6-4ef6-90c7-46bf3a884904", "address": "fa:16:3e:9b:fd:92", "network": {"id": "7057d5fc-5467-4681-8ed0-5243099b3df3", "bridge": "br-int", "label": "tempest-TestShelveInstance-5073894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df9034b591f2496fbef89f59646a31cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15762642-de", "ovs_interfaceid": "15762642-ded6-4ef6-90c7-46bf3a884904", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:14:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-685818c7-b515-4118-a952-a52a5942c4e3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:14:12 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 05:14:12 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-8bdaff35-2a74-429f-a000-360ea5e00c3d tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:14:12 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-8bdaff35-2a74-429f-a000-360ea5e00c3d tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:14:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8bdaff35-2a74-429f-a000-360ea5e00c3d tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.146s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:14:12 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-8bdaff35-2a74-429f-a000-360ea5e00c3d tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Deleted allocations for instance f58f50ed-c8f1-4468-b919-0a5aa3d630b3
Aug 03 05:14:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8bdaff35-2a74-429f-a000-360ea5e00c3d tempest-AttachVolumeShelveTestJSON-941210092 tempest-AttachVolumeShelveTestJSON-941210092-project-member] Lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.071s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:14:12 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:14:12 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 05:14:13 user nova-compute[72444]: DEBUG nova.compute.manager [req-a4130840-11aa-4aa9-a02a-e8c36406cf6a req-267a64cb-5171-4937-a158-dfdc835f72e5 service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Received event network-vif-plugged-13b70ab9-69cc-4d4f-9a8a-a100d1401730 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:14:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a4130840-11aa-4aa9-a02a-e8c36406cf6a req-267a64cb-5171-4937-a158-dfdc835f72e5 service nova] Acquiring lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:14:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a4130840-11aa-4aa9-a02a-e8c36406cf6a req-267a64cb-5171-4937-a158-dfdc835f72e5 service nova] Lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:14:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-a4130840-11aa-4aa9-a02a-e8c36406cf6a req-267a64cb-5171-4937-a158-dfdc835f72e5 service nova] Lock "f58f50ed-c8f1-4468-b919-0a5aa3d630b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:14:13 user nova-compute[72444]: DEBUG nova.compute.manager [req-a4130840-11aa-4aa9-a02a-e8c36406cf6a req-267a64cb-5171-4937-a158-dfdc835f72e5 service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] No waiting events found dispatching network-vif-plugged-13b70ab9-69cc-4d4f-9a8a-a100d1401730 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:14:13 user nova-compute[72444]: WARNING nova.compute.manager [req-a4130840-11aa-4aa9-a02a-e8c36406cf6a req-267a64cb-5171-4937-a158-dfdc835f72e5 service nova] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Received unexpected event network-vif-plugged-13b70ab9-69cc-4d4f-9a8a-a100d1401730 for instance with vm_state deleted and task_state None.
Aug 03 05:14:13 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:14:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:14:16 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:14:16 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:14:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:14:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:14:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:14:16 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:14:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 05:14:17 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:14:17 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:14:17 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=8721MB free_disk=25.405624389648438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:14:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:14:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:14:17 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 685818c7-b515-4118-a952-a52a5942c4e3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:14:17 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:14:17 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:14:17 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:14:17 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:14:17 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:14:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:14:18 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:14:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:14:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:14:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:14:26 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691039651.365923, f58f50ed-c8f1-4468-b919-0a5aa3d630b3 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:14:26 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] VM Stopped (Lifecycle Event)
Aug 03 05:14:26 user nova-compute[72444]: DEBUG nova.compute.manager [None req-1b4cbce0-66ed-4e41-97c7-19482fec5ccb None None] [instance: f58f50ed-c8f1-4468-b919-0a5aa3d630b3] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:14:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:14:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:14:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:14:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:14:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:14:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "1af9b9e3-b8aa-4060-8760-f0f9c73789d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:14:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "1af9b9e3-b8aa-4060-8760-f0f9c73789d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:14:45 user nova-compute[72444]: DEBUG nova.compute.manager [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 05:14:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:14:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:14:45 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 05:14:45 user nova-compute[72444]: INFO nova.compute.claims [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Claim successful on node user
Aug 03 05:14:45 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:14:45 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:14:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.233s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:14:45 user nova-compute[72444]: DEBUG nova.compute.manager [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 05:14:45 user nova-compute[72444]: DEBUG nova.compute.manager [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 05:14:45 user nova-compute[72444]: DEBUG nova.network.neutron [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 05:14:45 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 05:14:45 user nova-compute[72444]: DEBUG nova.compute.manager [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 05:14:45 user nova-compute[72444]: INFO nova.virt.block_device [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Booting with volume 6eeb498c-9c47-4bd7-96cf-95f826712fed at /dev/vda
Aug 03 05:14:45 user nova-compute[72444]: DEBUG nova.policy [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ef4d8130e33c4d9ea44c29be12f18234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae931112fcda4e2f8dfd4f540d905139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 05:14:45 user nova-compute[72444]: DEBUG os_brick.utils [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:14:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:14:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:14:45 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[77944543-11f4-42cc-8ecd-f6c7202144e5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:14:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:14:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:14:45 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a697142-6dbb-43c0-8662-64ea3788da26]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:14:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:14:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:14:45 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e8d074-942f-4ed7-b4ea-424cbe0e8450]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:14:45 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c8e678-0892-4f63-aff9-15e0db44a92e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:14:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:14:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:14:45 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 05:14:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:14:45 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:14:45 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 05:14:45 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4342fbc9-7c18-4657-bd29-a74e90e31988]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:14:45 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 05:14:45 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 05:14:45 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 05:14:45 user nova-compute[72444]: DEBUG os_brick.utils [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] <== get_connector_properties: return (189ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:14:45 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Updating existing volume attachment record: cfcc1e3f-7e60-47ae-872d-a2522e22073d {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 05:14:46 user nova-compute[72444]: DEBUG nova.network.neutron [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Successfully created port: 3d419d24-f4aa-447f-9140-6285ddc07469 {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 05:14:46 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:14:46 user nova-compute[72444]: DEBUG nova.network.neutron [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Successfully updated port: 3d419d24-f4aa-447f-9140-6285ddc07469 {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 05:14:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "refresh_cache-1af9b9e3-b8aa-4060-8760-f0f9c73789d4" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:14:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquired lock "refresh_cache-1af9b9e3-b8aa-4060-8760-f0f9c73789d4" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:14:47 user nova-compute[72444]: DEBUG nova.network.neutron [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 05:14:47 user nova-compute[72444]: DEBUG nova.compute.manager [req-62102e1a-78e3-43d0-a4f8-d72ad09ee879 req-88867288-3996-4925-a565-c5376f55f684 service nova] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Received event network-changed-3d419d24-f4aa-447f-9140-6285ddc07469 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:14:47 user nova-compute[72444]: DEBUG nova.compute.manager [req-62102e1a-78e3-43d0-a4f8-d72ad09ee879 req-88867288-3996-4925-a565-c5376f55f684 service nova] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Refreshing instance network info cache due to event network-changed-3d419d24-f4aa-447f-9140-6285ddc07469. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:14:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-62102e1a-78e3-43d0-a4f8-d72ad09ee879 req-88867288-3996-4925-a565-c5376f55f684 service nova] Acquiring lock "refresh_cache-1af9b9e3-b8aa-4060-8760-f0f9c73789d4" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:14:47 user nova-compute[72444]: DEBUG nova.network.neutron [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 05:14:47 user nova-compute[72444]: DEBUG nova.network.neutron [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Updating instance_info_cache with network_info: [{"id": "3d419d24-f4aa-447f-9140-6285ddc07469", "address": "fa:16:3e:40:7a:e5", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d419d24-f4", "ovs_interfaceid": "3d419d24-f4aa-447f-9140-6285ddc07469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:14:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Releasing lock "refresh_cache-1af9b9e3-b8aa-4060-8760-f0f9c73789d4" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:14:47 user nova-compute[72444]: DEBUG nova.compute.manager [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Instance network_info: |[{"id": "3d419d24-f4aa-447f-9140-6285ddc07469", "address": "fa:16:3e:40:7a:e5", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d419d24-f4", "ovs_interfaceid": "3d419d24-f4aa-447f-9140-6285ddc07469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 05:14:47 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-62102e1a-78e3-43d0-a4f8-d72ad09ee879 req-88867288-3996-4925-a565-c5376f55f684 service nova] Acquired lock "refresh_cache-1af9b9e3-b8aa-4060-8760-f0f9c73789d4" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:14:47 user nova-compute[72444]: DEBUG nova.network.neutron [req-62102e1a-78e3-43d0-a4f8-d72ad09ee879 req-88867288-3996-4925-a565-c5376f55f684 service nova] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Refreshing network info cache for port 3d419d24-f4aa-447f-9140-6285ddc07469 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:14:48 user nova-compute[72444]: DEBUG nova.network.neutron [req-62102e1a-78e3-43d0-a4f8-d72ad09ee879 req-88867288-3996-4925-a565-c5376f55f684 service nova] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Updated VIF entry in instance network info cache for port 3d419d24-f4aa-447f-9140-6285ddc07469. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:14:48 user nova-compute[72444]: DEBUG nova.network.neutron [req-62102e1a-78e3-43d0-a4f8-d72ad09ee879 req-88867288-3996-4925-a565-c5376f55f684 service nova] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Updating instance_info_cache with network_info: [{"id": "3d419d24-f4aa-447f-9140-6285ddc07469", "address": "fa:16:3e:40:7a:e5", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d419d24-f4", "ovs_interfaceid": "3d419d24-f4aa-447f-9140-6285ddc07469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:14:48 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-62102e1a-78e3-43d0-a4f8-d72ad09ee879 req-88867288-3996-4925-a565-c5376f55f684 service nova] Releasing lock "refresh_cache-1af9b9e3-b8aa-4060-8760-f0f9c73789d4" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:14:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:14:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:14:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:14:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:14:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:14:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG nova.compute.manager [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 05:14:53 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Creating image(s)
Aug 03 05:14:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Did not create local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Ensure instance console log exists: /opt/stack/data/nova/instances/1af9b9e3-b8aa-4060-8760-f0f9c73789d4/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Start _get_guest_xml network_info=[{"id": "3d419d24-f4aa-447f-9140-6285ddc07469", "address": "fa:16:3e:40:7a:e5", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d419d24-f4", "ovs_interfaceid": "3d419d24-f4aa-447f-9140-6285ddc07469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDySbitl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1af9b9e3-b8aa-4060-8760-f0f9c73789d4', 'attached_at': '', 'detached_at': '', 'volume_id': '6eeb498c-9c47-4bd7-96cf-95f826712fed', 'serial': '6eeb498c-9c47-4bd7-96cf-95f826712fed'}, 'disk_bus': 'virtio', 'attachment_id': 'cfcc1e3f-7e60-47ae-872d-a2522e22073d', 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 05:14:53 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:14:53 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:14:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDySbitl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:14:53 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:14:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:14:53 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:14:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:14:53 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 05:14:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a325626e-d5fa-4fd7-9fa8-65aa92781238]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 05:14:53 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6455aa-96c3-41a2-ac30-6266f9ba3717]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed] added
Aug 03 05:14:53 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f449374c-df53-4803-be5b-9c184faa3988]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8e2a5e-3883-490a-8b7a-46526b6b997c]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gDySbitl {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gDySbitl" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e05eeb5-caa5-43c3-b9ee-5e379e3d4e80]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gDySbitl'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[abcee78b-dbae-4201-a80a-207cca879a2c]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc60bfd-ac12-4622-80cf-d5a863c22f27]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c (non-flash)
Aug 03 05:14:53 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c (non-flash)
Aug 03 05:14:53 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c36f8a9-00c4-43be-af0e-f37d16c39eb4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed, portal: 172.16.0.220,3260]
Aug 03 05:14:53 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed, portal: 172.16.0.220,3260] successful.
Aug 03 05:14:53 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[341f1332-3a39-4002-aaa5-4aa2667ddfa1]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[309bdf59-0c41-4dd6-be44-2c1043f4d854]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c (non-flash)
Aug 03 05:14:53 user nova-compute[72444]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed (non-flash)
Aug 03 05:14:53 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c (non-flash)
Aug 03 05:14:53 user nova-compute[72444]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed (non-flash)
Aug 03 05:14:53 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe7ce37-6297-4b53-bf84-c3da9d612458]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 05:14:53 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDySbitl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 05:14:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:14:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23531623230653362', 'path': '/dev/sdc'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:14:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531623230653362', 'path': '/dev/sdc'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 05:14:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-126063360',display_name='tempest-TestVolumeBootPattern-server-126063360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-126063360',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJb/ucac2bYqYTTpUwHVlINSI4Sfb+N0MYWJk4BUfIgi24wGpfawX18lRHaBUwUNuvA9BvzcrJArj3JZ6r/WP+myl5DP/2VX4xcdyXqMaH1gGJv8NyGzE7tn1ggSM7aa7A==',key_name='tempest-TestVolumeBootPattern-1711073489',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae931112fcda4e2f8dfd4f540d905139',ramdisk_id='',reservation_id='r-bef6tsz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1788747136',owner_user_name='tempest-TestVolumeBootPattern-1788747136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:14:46Z,user_data=None,user_id='ef4d8130e33c4d9ea44c29be12f18234',uuid=1af9b9e3-b8aa-4060-8760-f0f9c73789d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d419d24-f4aa-447f-9140-6285ddc07469", "address": "fa:16:3e:40:7a:e5", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d419d24-f4", "ovs_interfaceid": "3d419d24-f4aa-447f-9140-6285ddc07469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 05:14:54 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Converting VIF {"id": "3d419d24-f4aa-447f-9140-6285ddc07469", "address": "fa:16:3e:40:7a:e5", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d419d24-f4", "ovs_interfaceid": "3d419d24-f4aa-447f-9140-6285ddc07469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:14:54 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:7a:e5,bridge_name='br-int',has_traffic_filtering=True,id=3d419d24-f4aa-447f-9140-6285ddc07469,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d419d24-f4') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:14:54 user nova-compute[72444]: DEBUG nova.objects.instance [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lazy-loading 'pci_devices' on Instance uuid 1af9b9e3-b8aa-4060-8760-f0f9c73789d4 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:14:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] End _get_guest_xml xml=<domain type="kvm">
Aug 03 05:14:54 user nova-compute[72444]:   <uuid>1af9b9e3-b8aa-4060-8760-f0f9c73789d4</uuid>
Aug 03 05:14:54 user nova-compute[72444]:   <name>instance-0000002d</name>
Aug 03 05:14:54 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 05:14:54 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 05:14:54 user nova-compute[72444]:   <metadata>
Aug 03 05:14:54 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 05:14:54 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 05:14:54 user nova-compute[72444]:       <nova:name>tempest-TestVolumeBootPattern-server-126063360</nova:name>
Aug 03 05:14:54 user nova-compute[72444]:       <nova:creationTime>2023-08-03 05:14:53</nova:creationTime>
Aug 03 05:14:54 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 05:14:54 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 05:14:54 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 05:14:54 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 05:14:54 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 05:14:54 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 05:14:54 user nova-compute[72444]:       </nova:flavor>
Aug 03 05:14:54 user nova-compute[72444]:       <nova:owner>
Aug 03 05:14:54 user nova-compute[72444]:         <nova:user uuid="ef4d8130e33c4d9ea44c29be12f18234">tempest-TestVolumeBootPattern-1788747136-project-member</nova:user>
Aug 03 05:14:54 user nova-compute[72444]:         <nova:project uuid="ae931112fcda4e2f8dfd4f540d905139">tempest-TestVolumeBootPattern-1788747136</nova:project>
Aug 03 05:14:54 user nova-compute[72444]:       </nova:owner>
Aug 03 05:14:54 user nova-compute[72444]:       <nova:ports>
Aug 03 05:14:54 user nova-compute[72444]:         <nova:port uuid="3d419d24-f4aa-447f-9140-6285ddc07469">
Aug 03 05:14:54 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 03 05:14:54 user nova-compute[72444]:         </nova:port>
Aug 03 05:14:54 user nova-compute[72444]:       </nova:ports>
Aug 03 05:14:54 user nova-compute[72444]:     </nova:instance>
Aug 03 05:14:54 user nova-compute[72444]:   </metadata>
Aug 03 05:14:54 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 05:14:54 user nova-compute[72444]:     <system>
Aug 03 05:14:54 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 05:14:54 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 05:14:54 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 05:14:54 user nova-compute[72444]:       <entry name="serial">1af9b9e3-b8aa-4060-8760-f0f9c73789d4</entry>
Aug 03 05:14:54 user nova-compute[72444]:       <entry name="uuid">1af9b9e3-b8aa-4060-8760-f0f9c73789d4</entry>
Aug 03 05:14:54 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 05:14:54 user nova-compute[72444]:     </system>
Aug 03 05:14:54 user nova-compute[72444]:   </sysinfo>
Aug 03 05:14:54 user nova-compute[72444]:   <os>
Aug 03 05:14:54 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 05:14:54 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 05:14:54 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 05:14:54 user nova-compute[72444]:   </os>
Aug 03 05:14:54 user nova-compute[72444]:   <features>
Aug 03 05:14:54 user nova-compute[72444]:     <acpi/>
Aug 03 05:14:54 user nova-compute[72444]:     <apic/>
Aug 03 05:14:54 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 05:14:54 user nova-compute[72444]:   </features>
Aug 03 05:14:54 user nova-compute[72444]:   <clock offset="utc">
Aug 03 05:14:54 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 05:14:54 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 05:14:54 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 05:14:54 user nova-compute[72444]:   </clock>
Aug 03 05:14:54 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 05:14:54 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 05:14:54 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 05:14:54 user nova-compute[72444]:   </cpu>
Aug 03 05:14:54 user nova-compute[72444]:   <devices>
Aug 03 05:14:54 user nova-compute[72444]:     <disk type="block" device="disk">
Aug 03 05:14:54 user nova-compute[72444]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:14:54 user nova-compute[72444]:       <source dev="/dev/sdc"/>
Aug 03 05:14:54 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 05:14:54 user nova-compute[72444]:       <serial>6eeb498c-9c47-4bd7-96cf-95f826712fed</serial>
Aug 03 05:14:54 user nova-compute[72444]:     </disk>
Aug 03 05:14:54 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 05:14:54 user nova-compute[72444]:       <mac address="fa:16:3e:40:7a:e5"/>
Aug 03 05:14:54 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:14:54 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 05:14:54 user nova-compute[72444]:       <target dev="tap3d419d24-f4"/>
Aug 03 05:14:54 user nova-compute[72444]:     </interface>
Aug 03 05:14:54 user nova-compute[72444]:     <serial type="pty">
Aug 03 05:14:54 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/1af9b9e3-b8aa-4060-8760-f0f9c73789d4/console.log" append="off"/>
Aug 03 05:14:54 user nova-compute[72444]:     </serial>
Aug 03 05:14:54 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 05:14:54 user nova-compute[72444]:     <video>
Aug 03 05:14:54 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:14:54 user nova-compute[72444]:     </video>
Aug 03 05:14:54 user nova-compute[72444]:     <rng model="virtio">
Aug 03 05:14:54 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 05:14:54 user nova-compute[72444]:     </rng>
Aug 03 05:14:54 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 05:14:54 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 05:14:54 user nova-compute[72444]:       <stats period="10"/>
Aug 03 05:14:54 user nova-compute[72444]:     </memballoon>
Aug 03 05:14:54 user nova-compute[72444]:   </devices>
Aug 03 05:14:54 user nova-compute[72444]: </domain>
Aug 03 05:14:54 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 05:14:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-126063360',display_name='tempest-TestVolumeBootPattern-server-126063360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-126063360',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJb/ucac2bYqYTTpUwHVlINSI4Sfb+N0MYWJk4BUfIgi24wGpfawX18lRHaBUwUNuvA9BvzcrJArj3JZ6r/WP+myl5DP/2VX4xcdyXqMaH1gGJv8NyGzE7tn1ggSM7aa7A==',key_name='tempest-TestVolumeBootPattern-1711073489',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae931112fcda4e2f8dfd4f540d905139',ramdisk_id='',reservation_id='r-bef6tsz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1788747136',owner_user_name='tempest-TestVolumeBootPattern-1788747136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:14:46Z,user_data=None,user_id='ef4d8130e33c4d9ea44c29be12f18234',uuid=1af9b9e3-b8aa-4060-8760-f0f9c73789d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d419d24-f4aa-447f-9140-6285ddc07469", "address": "fa:16:3e:40:7a:e5", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d419d24-f4", "ovs_interfaceid": "3d419d24-f4aa-447f-9140-6285ddc07469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 05:14:54 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Converting VIF {"id": "3d419d24-f4aa-447f-9140-6285ddc07469", "address": "fa:16:3e:40:7a:e5", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d419d24-f4", "ovs_interfaceid": "3d419d24-f4aa-447f-9140-6285ddc07469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:14:54 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:7a:e5,bridge_name='br-int',has_traffic_filtering=True,id=3d419d24-f4aa-447f-9140-6285ddc07469,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d419d24-f4') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:14:54 user nova-compute[72444]: DEBUG os_vif [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:7a:e5,bridge_name='br-int',has_traffic_filtering=True,id=3d419d24-f4aa-447f-9140-6285ddc07469,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d419d24-f4') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 05:14:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:14:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:14:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 05:14:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:14:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d419d24-f4, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:14:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3d419d24-f4, col_values=(('external_ids', {'iface-id': '3d419d24-f4aa-447f-9140-6285ddc07469', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:7a:e5', 'vm-uuid': '1af9b9e3-b8aa-4060-8760-f0f9c73789d4'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:14:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:14:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:14:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:14:54 user nova-compute[72444]: INFO os_vif [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:7a:e5,bridge_name='br-int',has_traffic_filtering=True,id=3d419d24-f4aa-447f-9140-6285ddc07469,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d419d24-f4')
Aug 03 05:14:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:14:54 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] No VIF found with MAC fa:16:3e:40:7a:e5, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 05:14:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:14:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:14:56 user nova-compute[72444]: DEBUG nova.compute.manager [req-76f8578e-790b-468a-8f15-fafb18f6a4a4 req-e0444dd6-56b2-499c-a2f6-48936b67b593 service nova] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Received event network-vif-plugged-3d419d24-f4aa-447f-9140-6285ddc07469 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:14:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-76f8578e-790b-468a-8f15-fafb18f6a4a4 req-e0444dd6-56b2-499c-a2f6-48936b67b593 service nova] Acquiring lock "1af9b9e3-b8aa-4060-8760-f0f9c73789d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:14:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-76f8578e-790b-468a-8f15-fafb18f6a4a4 req-e0444dd6-56b2-499c-a2f6-48936b67b593 service nova] Lock "1af9b9e3-b8aa-4060-8760-f0f9c73789d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:14:56 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-76f8578e-790b-468a-8f15-fafb18f6a4a4 req-e0444dd6-56b2-499c-a2f6-48936b67b593 service nova] Lock "1af9b9e3-b8aa-4060-8760-f0f9c73789d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:14:56 user nova-compute[72444]: DEBUG nova.compute.manager [req-76f8578e-790b-468a-8f15-fafb18f6a4a4 req-e0444dd6-56b2-499c-a2f6-48936b67b593 service nova] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] No waiting events found dispatching network-vif-plugged-3d419d24-f4aa-447f-9140-6285ddc07469 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:14:56 user nova-compute[72444]: WARNING nova.compute.manager [req-76f8578e-790b-468a-8f15-fafb18f6a4a4 req-e0444dd6-56b2-499c-a2f6-48936b67b593 service nova] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Received unexpected event network-vif-plugged-3d419d24-f4aa-447f-9140-6285ddc07469 for instance with vm_state building and task_state spawning.
Aug 03 05:14:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:14:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:14:58 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691039698.13969, 1af9b9e3-b8aa-4060-8760-f0f9c73789d4 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:14:58 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] VM Resumed (Lifecycle Event)
Aug 03 05:14:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 05:14:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 05:14:58 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Instance spawned successfully.
Aug 03 05:14:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 05:14:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:14:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:14:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:14:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:14:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:14:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:14:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:14:58 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:14:58 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 05:14:58 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691039698.1414437, 1af9b9e3-b8aa-4060-8760-f0f9c73789d4 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:14:58 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] VM Started (Lifecycle Event)
Aug 03 05:14:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:14:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:14:58 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 05:14:58 user nova-compute[72444]: INFO nova.compute.manager [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Took 5.01 seconds to spawn the instance on the hypervisor.
Aug 03 05:14:58 user nova-compute[72444]: DEBUG nova.compute.manager [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:14:58 user nova-compute[72444]: INFO nova.compute.manager [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Took 13.19 seconds to build instance.
Aug 03 05:14:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-0216b576-363e-4819-a279-d455c91a7c07 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "1af9b9e3-b8aa-4060-8760-f0f9c73789d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.284s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:14:58 user nova-compute[72444]: DEBUG nova.compute.manager [req-88cb9c9a-c87d-4c69-b349-3c404fec5273 req-5e803eda-cc85-4280-b43e-fd64793dcf88 service nova] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Received event network-vif-plugged-3d419d24-f4aa-447f-9140-6285ddc07469 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:14:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-88cb9c9a-c87d-4c69-b349-3c404fec5273 req-5e803eda-cc85-4280-b43e-fd64793dcf88 service nova] Acquiring lock "1af9b9e3-b8aa-4060-8760-f0f9c73789d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:14:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-88cb9c9a-c87d-4c69-b349-3c404fec5273 req-5e803eda-cc85-4280-b43e-fd64793dcf88 service nova] Lock "1af9b9e3-b8aa-4060-8760-f0f9c73789d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:14:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-88cb9c9a-c87d-4c69-b349-3c404fec5273 req-5e803eda-cc85-4280-b43e-fd64793dcf88 service nova] Lock "1af9b9e3-b8aa-4060-8760-f0f9c73789d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:14:58 user nova-compute[72444]: DEBUG nova.compute.manager [req-88cb9c9a-c87d-4c69-b349-3c404fec5273 req-5e803eda-cc85-4280-b43e-fd64793dcf88 service nova] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] No waiting events found dispatching network-vif-plugged-3d419d24-f4aa-447f-9140-6285ddc07469 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:14:58 user nova-compute[72444]: WARNING nova.compute.manager [req-88cb9c9a-c87d-4c69-b349-3c404fec5273 req-5e803eda-cc85-4280-b43e-fd64793dcf88 service nova] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Received unexpected event network-vif-plugged-3d419d24-f4aa-447f-9140-6285ddc07469 for instance with vm_state active and task_state None.
Aug 03 05:14:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:15:09 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:15:12 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:15:12 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:15:12 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:15:12 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Rebuilding the list of instances to heal {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 05:15:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-685818c7-b515-4118-a952-a52a5942c4e3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:15:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-685818c7-b515-4118-a952-a52a5942c4e3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:15:13 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 05:15:13 user nova-compute[72444]: DEBUG nova.objects.instance [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lazy-loading 'info_cache' on Instance uuid 685818c7-b515-4118-a952-a52a5942c4e3 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:15:13 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Updating instance_info_cache with network_info: [{"id": "15762642-ded6-4ef6-90c7-46bf3a884904", "address": "fa:16:3e:9b:fd:92", "network": {"id": "7057d5fc-5467-4681-8ed0-5243099b3df3", "bridge": "br-int", "label": "tempest-TestShelveInstance-5073894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df9034b591f2496fbef89f59646a31cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15762642-de", "ovs_interfaceid": "15762642-ded6-4ef6-90c7-46bf3a884904", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:15:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-685818c7-b515-4118-a952-a52a5942c4e3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:15:13 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 05:15:13 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:15:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:15:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:15:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:15:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:15:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:14 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:15:14 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:15:14 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 05:15:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:16 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:15:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:15:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:15:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:15:16 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:15:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 05:15:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 05:15:17 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:15:17 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:15:17 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=8495MB free_disk=25.395065307617188GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:15:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:15:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:15:17 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 685818c7-b515-4118-a952-a52a5942c4e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:15:17 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 1af9b9e3-b8aa-4060-8760-f0f9c73789d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:15:17 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:15:17 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:15:17 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:15:17 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:15:17 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:15:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:15:18 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:15:18 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:15:19 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:20 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:15:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:22 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "06bccfea-4a42-4880-8712-e9a7c0cd2a13" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:15:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "06bccfea-4a42-4880-8712-e9a7c0cd2a13" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:15:25 user nova-compute[72444]: DEBUG nova.compute.manager [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 05:15:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:15:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:15:25 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 05:15:25 user nova-compute[72444]: INFO nova.compute.claims [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Claim successful on node user
Aug 03 05:15:25 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:15:25 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:15:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.269s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:15:25 user nova-compute[72444]: DEBUG nova.compute.manager [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 05:15:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:26 user nova-compute[72444]: DEBUG nova.compute.manager [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 05:15:26 user nova-compute[72444]: DEBUG nova.network.neutron [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 05:15:26 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 05:15:26 user nova-compute[72444]: DEBUG nova.compute.manager [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 05:15:26 user nova-compute[72444]: DEBUG nova.policy [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '39ca6b589ce84537984e0df64b6085f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8210385d97453ab4befb159a457772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 05:15:26 user nova-compute[72444]: DEBUG nova.compute.manager [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 05:15:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 05:15:26 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Creating image(s)
Aug 03 05:15:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "/opt/stack/data/nova/instances/06bccfea-4a42-4880-8712-e9a7c0cd2a13/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:15:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "/opt/stack/data/nova/instances/06bccfea-4a42-4880-8712-e9a7c0cd2a13/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:15:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "/opt/stack/data/nova/instances/06bccfea-4a42-4880-8712-e9a7c0cd2a13/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:15:26 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:15:26 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.135s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:15:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:15:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:15:26 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:15:26 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.132s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:15:26 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/06bccfea-4a42-4880-8712-e9a7c0cd2a13/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:15:26 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/06bccfea-4a42-4880-8712-e9a7c0cd2a13/disk 1073741824" returned: 0 in 0.049s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:15:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:15:26 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:15:26 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.133s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:15:26 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Checking if we can resize image /opt/stack/data/nova/instances/06bccfea-4a42-4880-8712-e9a7c0cd2a13/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 05:15:26 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06bccfea-4a42-4880-8712-e9a7c0cd2a13/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:15:26 user nova-compute[72444]: DEBUG nova.network.neutron [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Successfully created port: 51cc40fe-4c00-4266-94f7-6eb722f9253e {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 05:15:26 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06bccfea-4a42-4880-8712-e9a7c0cd2a13/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:15:26 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Cannot resize image /opt/stack/data/nova/instances/06bccfea-4a42-4880-8712-e9a7c0cd2a13/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 05:15:26 user nova-compute[72444]: DEBUG nova.objects.instance [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lazy-loading 'migration_context' on Instance uuid 06bccfea-4a42-4880-8712-e9a7c0cd2a13 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:15:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 05:15:26 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Ensure instance console log exists: /opt/stack/data/nova/instances/06bccfea-4a42-4880-8712-e9a7c0cd2a13/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 05:15:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:15:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:15:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG nova.network.neutron [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Successfully updated port: 51cc40fe-4c00-4266-94f7-6eb722f9253e {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "refresh_cache-06bccfea-4a42-4880-8712-e9a7c0cd2a13" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquired lock "refresh_cache-06bccfea-4a42-4880-8712-e9a7c0cd2a13" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG nova.network.neutron [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG nova.compute.manager [req-3f6d4e2e-128f-4a90-ba4a-304d5940d3b9 req-336bf033-fe3f-4faa-9a0a-8768e8db1ad1 service nova] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Received event network-changed-51cc40fe-4c00-4266-94f7-6eb722f9253e {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG nova.compute.manager [req-3f6d4e2e-128f-4a90-ba4a-304d5940d3b9 req-336bf033-fe3f-4faa-9a0a-8768e8db1ad1 service nova] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Refreshing instance network info cache due to event network-changed-51cc40fe-4c00-4266-94f7-6eb722f9253e. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3f6d4e2e-128f-4a90-ba4a-304d5940d3b9 req-336bf033-fe3f-4faa-9a0a-8768e8db1ad1 service nova] Acquiring lock "refresh_cache-06bccfea-4a42-4880-8712-e9a7c0cd2a13" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG nova.network.neutron [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG nova.network.neutron [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Updating instance_info_cache with network_info: [{"id": "51cc40fe-4c00-4266-94f7-6eb722f9253e", "address": "fa:16:3e:8b:f2:c5", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cc40fe-4c", "ovs_interfaceid": "51cc40fe-4c00-4266-94f7-6eb722f9253e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Releasing lock "refresh_cache-06bccfea-4a42-4880-8712-e9a7c0cd2a13" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG nova.compute.manager [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Instance network_info: |[{"id": "51cc40fe-4c00-4266-94f7-6eb722f9253e", "address": "fa:16:3e:8b:f2:c5", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cc40fe-4c", "ovs_interfaceid": "51cc40fe-4c00-4266-94f7-6eb722f9253e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3f6d4e2e-128f-4a90-ba4a-304d5940d3b9 req-336bf033-fe3f-4faa-9a0a-8768e8db1ad1 service nova] Acquired lock "refresh_cache-06bccfea-4a42-4880-8712-e9a7c0cd2a13" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG nova.network.neutron [req-3f6d4e2e-128f-4a90-ba4a-304d5940d3b9 req-336bf033-fe3f-4faa-9a0a-8768e8db1ad1 service nova] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Refreshing network info cache for port 51cc40fe-4c00-4266-94f7-6eb722f9253e {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Start _get_guest_xml network_info=[{"id": "51cc40fe-4c00-4266-94f7-6eb722f9253e", "address": "fa:16:3e:8b:f2:c5", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cc40fe-4c", "ovs_interfaceid": "51cc40fe-4c00-4266-94f7-6eb722f9253e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 05:15:27 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:15:27 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:15:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:15:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-460041083',display_name='tempest-AttachVolumeNegativeTest-server-460041083',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-460041083',id=46,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJmPnJyINGWpYMqvxC/BanrH9M8iIpPPriT33nKJSOoKaTYiRf4j7YAlLFYM04lSCEoEdjpCB6bwMDVq7HpDF4ElrIj62QvujlXp1fDsRq7o6+VO8DndDL1NwBo8wP2Dw==',key_name='tempest-keypair-484102651',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d8210385d97453ab4befb159a457772',ramdisk_id='',reservation_id='r-0856ltht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1998464271',owner_user_name='tempest-AttachVolumeNegativeTest-1998464271-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:15:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39ca6b589ce84537984e0df64b6085f3',uuid=06bccfea-4a42-4880-8712-e9a7c0cd2a13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51cc40fe-4c00-4266-94f7-6eb722f9253e", "address": "fa:16:3e:8b:f2:c5", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cc40fe-4c", "ovs_interfaceid": "51cc40fe-4c00-4266-94f7-6eb722f9253e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Converting VIF {"id": "51cc40fe-4c00-4266-94f7-6eb722f9253e", "address": "fa:16:3e:8b:f2:c5", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cc40fe-4c", "ovs_interfaceid": "51cc40fe-4c00-4266-94f7-6eb722f9253e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f2:c5,bridge_name='br-int',has_traffic_filtering=True,id=51cc40fe-4c00-4266-94f7-6eb722f9253e,network=Network(9605cf27-7ef3-4664-97b1-a6e1d093ce98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51cc40fe-4c') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG nova.objects.instance [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lazy-loading 'pci_devices' on Instance uuid 06bccfea-4a42-4880-8712-e9a7c0cd2a13 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] End _get_guest_xml xml=<domain type="kvm">
Aug 03 05:15:27 user nova-compute[72444]:   <uuid>06bccfea-4a42-4880-8712-e9a7c0cd2a13</uuid>
Aug 03 05:15:27 user nova-compute[72444]:   <name>instance-0000002e</name>
Aug 03 05:15:27 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 05:15:27 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 05:15:27 user nova-compute[72444]:   <metadata>
Aug 03 05:15:27 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 05:15:27 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 05:15:27 user nova-compute[72444]:       <nova:name>tempest-AttachVolumeNegativeTest-server-460041083</nova:name>
Aug 03 05:15:27 user nova-compute[72444]:       <nova:creationTime>2023-08-03 05:15:27</nova:creationTime>
Aug 03 05:15:27 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 05:15:27 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 05:15:27 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 05:15:27 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 05:15:27 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 05:15:27 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 05:15:27 user nova-compute[72444]:       </nova:flavor>
Aug 03 05:15:27 user nova-compute[72444]:       <nova:owner>
Aug 03 05:15:27 user nova-compute[72444]:         <nova:user uuid="39ca6b589ce84537984e0df64b6085f3">tempest-AttachVolumeNegativeTest-1998464271-project-member</nova:user>
Aug 03 05:15:27 user nova-compute[72444]:         <nova:project uuid="9d8210385d97453ab4befb159a457772">tempest-AttachVolumeNegativeTest-1998464271</nova:project>
Aug 03 05:15:27 user nova-compute[72444]:       </nova:owner>
Aug 03 05:15:27 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 05:15:27 user nova-compute[72444]:       <nova:ports>
Aug 03 05:15:27 user nova-compute[72444]:         <nova:port uuid="51cc40fe-4c00-4266-94f7-6eb722f9253e">
Aug 03 05:15:27 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 03 05:15:27 user nova-compute[72444]:         </nova:port>
Aug 03 05:15:27 user nova-compute[72444]:       </nova:ports>
Aug 03 05:15:27 user nova-compute[72444]:     </nova:instance>
Aug 03 05:15:27 user nova-compute[72444]:   </metadata>
Aug 03 05:15:27 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 05:15:27 user nova-compute[72444]:     <system>
Aug 03 05:15:27 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 05:15:27 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 05:15:27 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 05:15:27 user nova-compute[72444]:       <entry name="serial">06bccfea-4a42-4880-8712-e9a7c0cd2a13</entry>
Aug 03 05:15:27 user nova-compute[72444]:       <entry name="uuid">06bccfea-4a42-4880-8712-e9a7c0cd2a13</entry>
Aug 03 05:15:27 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 05:15:27 user nova-compute[72444]:     </system>
Aug 03 05:15:27 user nova-compute[72444]:   </sysinfo>
Aug 03 05:15:27 user nova-compute[72444]:   <os>
Aug 03 05:15:27 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 05:15:27 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 05:15:27 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 05:15:27 user nova-compute[72444]:   </os>
Aug 03 05:15:27 user nova-compute[72444]:   <features>
Aug 03 05:15:27 user nova-compute[72444]:     <acpi/>
Aug 03 05:15:27 user nova-compute[72444]:     <apic/>
Aug 03 05:15:27 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 05:15:27 user nova-compute[72444]:   </features>
Aug 03 05:15:27 user nova-compute[72444]:   <clock offset="utc">
Aug 03 05:15:27 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 05:15:27 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 05:15:27 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 05:15:27 user nova-compute[72444]:   </clock>
Aug 03 05:15:27 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 05:15:27 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 05:15:27 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 05:15:27 user nova-compute[72444]:   </cpu>
Aug 03 05:15:27 user nova-compute[72444]:   <devices>
Aug 03 05:15:27 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 05:15:27 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 05:15:27 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/06bccfea-4a42-4880-8712-e9a7c0cd2a13/disk"/>
Aug 03 05:15:27 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 05:15:27 user nova-compute[72444]:     </disk>
Aug 03 05:15:27 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 05:15:27 user nova-compute[72444]:       <mac address="fa:16:3e:8b:f2:c5"/>
Aug 03 05:15:27 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:15:27 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 05:15:27 user nova-compute[72444]:       <target dev="tap51cc40fe-4c"/>
Aug 03 05:15:27 user nova-compute[72444]:     </interface>
Aug 03 05:15:27 user nova-compute[72444]:     <serial type="pty">
Aug 03 05:15:27 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/06bccfea-4a42-4880-8712-e9a7c0cd2a13/console.log" append="off"/>
Aug 03 05:15:27 user nova-compute[72444]:     </serial>
Aug 03 05:15:27 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 05:15:27 user nova-compute[72444]:     <video>
Aug 03 05:15:27 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:15:27 user nova-compute[72444]:     </video>
Aug 03 05:15:27 user nova-compute[72444]:     <rng model="virtio">
Aug 03 05:15:27 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 05:15:27 user nova-compute[72444]:     </rng>
Aug 03 05:15:27 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 05:15:27 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 05:15:27 user nova-compute[72444]:       <stats period="10"/>
Aug 03 05:15:27 user nova-compute[72444]:     </memballoon>
Aug 03 05:15:27 user nova-compute[72444]:   </devices>
Aug 03 05:15:27 user nova-compute[72444]: </domain>
Aug 03 05:15:27 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:15:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-460041083',display_name='tempest-AttachVolumeNegativeTest-server-460041083',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-460041083',id=46,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJmPnJyINGWpYMqvxC/BanrH9M8iIpPPriT33nKJSOoKaTYiRf4j7YAlLFYM04lSCEoEdjpCB6bwMDVq7HpDF4ElrIj62QvujlXp1fDsRq7o6+VO8DndDL1NwBo8wP2Dw==',key_name='tempest-keypair-484102651',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d8210385d97453ab4befb159a457772',ramdisk_id='',reservation_id='r-0856ltht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1998464271',owner_user_name='tempest-AttachVolumeNegativeTest-1998464271-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:15:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39ca6b589ce84537984e0df64b6085f3',uuid=06bccfea-4a42-4880-8712-e9a7c0cd2a13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51cc40fe-4c00-4266-94f7-6eb722f9253e", "address": "fa:16:3e:8b:f2:c5", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cc40fe-4c", "ovs_interfaceid": "51cc40fe-4c00-4266-94f7-6eb722f9253e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Converting VIF {"id": "51cc40fe-4c00-4266-94f7-6eb722f9253e", "address": "fa:16:3e:8b:f2:c5", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cc40fe-4c", "ovs_interfaceid": "51cc40fe-4c00-4266-94f7-6eb722f9253e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f2:c5,bridge_name='br-int',has_traffic_filtering=True,id=51cc40fe-4c00-4266-94f7-6eb722f9253e,network=Network(9605cf27-7ef3-4664-97b1-a6e1d093ce98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51cc40fe-4c') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG os_vif [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f2:c5,bridge_name='br-int',has_traffic_filtering=True,id=51cc40fe-4c00-4266-94f7-6eb722f9253e,network=Network(9605cf27-7ef3-4664-97b1-a6e1d093ce98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51cc40fe-4c') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51cc40fe-4c, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap51cc40fe-4c, col_values=(('external_ids', {'iface-id': '51cc40fe-4c00-4266-94f7-6eb722f9253e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:f2:c5', 'vm-uuid': '06bccfea-4a42-4880-8712-e9a7c0cd2a13'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:27 user nova-compute[72444]: INFO os_vif [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f2:c5,bridge_name='br-int',has_traffic_filtering=True,id=51cc40fe-4c00-4266-94f7-6eb722f9253e,network=Network(9605cf27-7ef3-4664-97b1-a6e1d093ce98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51cc40fe-4c')
Aug 03 05:15:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:15:27 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] No VIF found with MAC fa:16:3e:8b:f2:c5, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 05:15:28 user nova-compute[72444]: DEBUG nova.network.neutron [req-3f6d4e2e-128f-4a90-ba4a-304d5940d3b9 req-336bf033-fe3f-4faa-9a0a-8768e8db1ad1 service nova] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Updated VIF entry in instance network info cache for port 51cc40fe-4c00-4266-94f7-6eb722f9253e. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:15:28 user nova-compute[72444]: DEBUG nova.network.neutron [req-3f6d4e2e-128f-4a90-ba4a-304d5940d3b9 req-336bf033-fe3f-4faa-9a0a-8768e8db1ad1 service nova] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Updating instance_info_cache with network_info: [{"id": "51cc40fe-4c00-4266-94f7-6eb722f9253e", "address": "fa:16:3e:8b:f2:c5", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cc40fe-4c", "ovs_interfaceid": "51cc40fe-4c00-4266-94f7-6eb722f9253e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:15:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3f6d4e2e-128f-4a90-ba4a-304d5940d3b9 req-336bf033-fe3f-4faa-9a0a-8768e8db1ad1 service nova] Releasing lock "refresh_cache-06bccfea-4a42-4880-8712-e9a7c0cd2a13" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:15:29 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:29 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:29 user nova-compute[72444]: DEBUG nova.compute.manager [req-39a4be74-9813-4348-a5ec-5eef5844944b req-f61f6699-697f-4d7c-9b9c-7a2bf622a170 service nova] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Received event network-vif-plugged-51cc40fe-4c00-4266-94f7-6eb722f9253e {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:15:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-39a4be74-9813-4348-a5ec-5eef5844944b req-f61f6699-697f-4d7c-9b9c-7a2bf622a170 service nova] Acquiring lock "06bccfea-4a42-4880-8712-e9a7c0cd2a13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:15:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-39a4be74-9813-4348-a5ec-5eef5844944b req-f61f6699-697f-4d7c-9b9c-7a2bf622a170 service nova] Lock "06bccfea-4a42-4880-8712-e9a7c0cd2a13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:15:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-39a4be74-9813-4348-a5ec-5eef5844944b req-f61f6699-697f-4d7c-9b9c-7a2bf622a170 service nova] Lock "06bccfea-4a42-4880-8712-e9a7c0cd2a13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:15:29 user nova-compute[72444]: DEBUG nova.compute.manager [req-39a4be74-9813-4348-a5ec-5eef5844944b req-f61f6699-697f-4d7c-9b9c-7a2bf622a170 service nova] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] No waiting events found dispatching network-vif-plugged-51cc40fe-4c00-4266-94f7-6eb722f9253e {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:15:29 user nova-compute[72444]: WARNING nova.compute.manager [req-39a4be74-9813-4348-a5ec-5eef5844944b req-f61f6699-697f-4d7c-9b9c-7a2bf622a170 service nova] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Received unexpected event network-vif-plugged-51cc40fe-4c00-4266-94f7-6eb722f9253e for instance with vm_state building and task_state spawning.
Aug 03 05:15:29 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:29 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:29 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:29 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:29 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:31 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691039731.3089864, 06bccfea-4a42-4880-8712-e9a7c0cd2a13 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:15:31 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] VM Resumed (Lifecycle Event)
Aug 03 05:15:31 user nova-compute[72444]: DEBUG nova.compute.manager [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 05:15:31 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 05:15:31 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Instance spawned successfully.
Aug 03 05:15:31 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 05:15:31 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:15:31 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:15:31 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:15:31 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:15:31 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:15:31 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:15:31 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:15:31 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:15:31 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 05:15:31 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691039731.3102515, 06bccfea-4a42-4880-8712-e9a7c0cd2a13 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:15:31 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] VM Started (Lifecycle Event)
Aug 03 05:15:31 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:15:31 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:15:31 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 05:15:31 user nova-compute[72444]: INFO nova.compute.manager [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Took 5.27 seconds to spawn the instance on the hypervisor.
Aug 03 05:15:31 user nova-compute[72444]: DEBUG nova.compute.manager [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:15:31 user nova-compute[72444]: DEBUG nova.compute.manager [req-ecf33743-467e-4966-a48f-c1ab593c8bd7 req-31b95183-c775-4071-ab46-673ca62dea41 service nova] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Received event network-vif-plugged-51cc40fe-4c00-4266-94f7-6eb722f9253e {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:15:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ecf33743-467e-4966-a48f-c1ab593c8bd7 req-31b95183-c775-4071-ab46-673ca62dea41 service nova] Acquiring lock "06bccfea-4a42-4880-8712-e9a7c0cd2a13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:15:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ecf33743-467e-4966-a48f-c1ab593c8bd7 req-31b95183-c775-4071-ab46-673ca62dea41 service nova] Lock "06bccfea-4a42-4880-8712-e9a7c0cd2a13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:15:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ecf33743-467e-4966-a48f-c1ab593c8bd7 req-31b95183-c775-4071-ab46-673ca62dea41 service nova] Lock "06bccfea-4a42-4880-8712-e9a7c0cd2a13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:15:31 user nova-compute[72444]: DEBUG nova.compute.manager [req-ecf33743-467e-4966-a48f-c1ab593c8bd7 req-31b95183-c775-4071-ab46-673ca62dea41 service nova] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] No waiting events found dispatching network-vif-plugged-51cc40fe-4c00-4266-94f7-6eb722f9253e {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:15:31 user nova-compute[72444]: WARNING nova.compute.manager [req-ecf33743-467e-4966-a48f-c1ab593c8bd7 req-31b95183-c775-4071-ab46-673ca62dea41 service nova] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Received unexpected event network-vif-plugged-51cc40fe-4c00-4266-94f7-6eb722f9253e for instance with vm_state building and task_state spawning.
Aug 03 05:15:31 user nova-compute[72444]: INFO nova.compute.manager [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Took 5.84 seconds to build instance.
Aug 03 05:15:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-1e75693e-bc04-469a-9fb7-0c7db124fff8 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "06bccfea-4a42-4880-8712-e9a7c0cd2a13" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.943s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:15:32 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:40 user nova-compute[72444]: DEBUG nova.compute.manager [req-03b5e1ee-8460-4601-9a4f-175428ce96f8 req-28d7f4ca-9e6b-432b-aa61-f4e0f87d63f1 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Received event network-changed-15762642-ded6-4ef6-90c7-46bf3a884904 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:15:40 user nova-compute[72444]: DEBUG nova.compute.manager [req-03b5e1ee-8460-4601-9a4f-175428ce96f8 req-28d7f4ca-9e6b-432b-aa61-f4e0f87d63f1 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Refreshing instance network info cache due to event network-changed-15762642-ded6-4ef6-90c7-46bf3a884904. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:15:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-03b5e1ee-8460-4601-9a4f-175428ce96f8 req-28d7f4ca-9e6b-432b-aa61-f4e0f87d63f1 service nova] Acquiring lock "refresh_cache-685818c7-b515-4118-a952-a52a5942c4e3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:15:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-03b5e1ee-8460-4601-9a4f-175428ce96f8 req-28d7f4ca-9e6b-432b-aa61-f4e0f87d63f1 service nova] Acquired lock "refresh_cache-685818c7-b515-4118-a952-a52a5942c4e3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:15:40 user nova-compute[72444]: DEBUG nova.network.neutron [req-03b5e1ee-8460-4601-9a4f-175428ce96f8 req-28d7f4ca-9e6b-432b-aa61-f4e0f87d63f1 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Refreshing network info cache for port 15762642-ded6-4ef6-90c7-46bf3a884904 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:15:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Acquiring lock "685818c7-b515-4118-a952-a52a5942c4e3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:15:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lock "685818c7-b515-4118-a952-a52a5942c4e3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:15:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Acquiring lock "685818c7-b515-4118-a952-a52a5942c4e3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:15:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lock "685818c7-b515-4118-a952-a52a5942c4e3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:15:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lock "685818c7-b515-4118-a952-a52a5942c4e3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:15:40 user nova-compute[72444]: INFO nova.compute.manager [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Terminating instance
Aug 03 05:15:40 user nova-compute[72444]: DEBUG nova.compute.manager [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 05:15:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:40 user nova-compute[72444]: DEBUG nova.compute.manager [req-d08824cd-2d85-4a02-bc26-a80d56160bcc req-a3885b29-38e9-420e-b3d7-5c718a6bb25b service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Received event network-vif-unplugged-15762642-ded6-4ef6-90c7-46bf3a884904 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:15:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d08824cd-2d85-4a02-bc26-a80d56160bcc req-a3885b29-38e9-420e-b3d7-5c718a6bb25b service nova] Acquiring lock "685818c7-b515-4118-a952-a52a5942c4e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:15:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d08824cd-2d85-4a02-bc26-a80d56160bcc req-a3885b29-38e9-420e-b3d7-5c718a6bb25b service nova] Lock "685818c7-b515-4118-a952-a52a5942c4e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:15:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d08824cd-2d85-4a02-bc26-a80d56160bcc req-a3885b29-38e9-420e-b3d7-5c718a6bb25b service nova] Lock "685818c7-b515-4118-a952-a52a5942c4e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:15:40 user nova-compute[72444]: DEBUG nova.compute.manager [req-d08824cd-2d85-4a02-bc26-a80d56160bcc req-a3885b29-38e9-420e-b3d7-5c718a6bb25b service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] No waiting events found dispatching network-vif-unplugged-15762642-ded6-4ef6-90c7-46bf3a884904 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:15:40 user nova-compute[72444]: DEBUG nova.compute.manager [req-d08824cd-2d85-4a02-bc26-a80d56160bcc req-a3885b29-38e9-420e-b3d7-5c718a6bb25b service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Received event network-vif-unplugged-15762642-ded6-4ef6-90c7-46bf3a884904 for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 05:15:40 user nova-compute[72444]: DEBUG nova.network.neutron [req-03b5e1ee-8460-4601-9a4f-175428ce96f8 req-28d7f4ca-9e6b-432b-aa61-f4e0f87d63f1 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Updated VIF entry in instance network info cache for port 15762642-ded6-4ef6-90c7-46bf3a884904. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:15:40 user nova-compute[72444]: DEBUG nova.network.neutron [req-03b5e1ee-8460-4601-9a4f-175428ce96f8 req-28d7f4ca-9e6b-432b-aa61-f4e0f87d63f1 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Updating instance_info_cache with network_info: [{"id": "15762642-ded6-4ef6-90c7-46bf3a884904", "address": "fa:16:3e:9b:fd:92", "network": {"id": "7057d5fc-5467-4681-8ed0-5243099b3df3", "bridge": "br-int", "label": "tempest-TestShelveInstance-5073894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df9034b591f2496fbef89f59646a31cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15762642-de", "ovs_interfaceid": "15762642-ded6-4ef6-90c7-46bf3a884904", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:15:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-03b5e1ee-8460-4601-9a4f-175428ce96f8 req-28d7f4ca-9e6b-432b-aa61-f4e0f87d63f1 service nova] Releasing lock "refresh_cache-685818c7-b515-4118-a952-a52a5942c4e3" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:15:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:41 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Instance destroyed successfully.
Aug 03 05:15:41 user nova-compute[72444]: DEBUG nova.objects.instance [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lazy-loading 'resources' on Instance uuid 685818c7-b515-4118-a952-a52a5942c4e3 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-03T05:10:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1129121706',display_name='tempest-TestShelveInstance-server-1129121706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1129121706',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhnSFVSYyIoliFKyFB/B2Z+tXspOpFn6D6+zix3bZV/aAGwrmK7q42wnCb91aouVv1HXPq8ltR87nVyNr/0W7/IY0epB+HwKN3DG0chjc7bQOjfwdtSWQxRujXjqbiSPQ==',key_name='tempest-TestShelveInstance-18244009',keypairs=<?>,launch_index=0,launched_at=2023-08-03T05:14:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df9034b591f2496fbef89f59646a31cc',ramdisk_id='',reservation_id='r-cyiehe4p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-98284952',owner_user_name='tempest-TestShelveInstance-98284952-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T05:14:03Z,user_data=None,user_id='566ccf33576b48dd8efe2427e8410d62',uuid=685818c7-b515-4118-a952-a52a5942c4e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15762642-ded6-4ef6-90c7-46bf3a884904", "address": "fa:16:3e:9b:fd:92", "network": {"id": "7057d5fc-5467-4681-8ed0-5243099b3df3", "bridge": "br-int", "label": "tempest-TestShelveInstance-5073894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df9034b591f2496fbef89f59646a31cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15762642-de", "ovs_interfaceid": "15762642-ded6-4ef6-90c7-46bf3a884904", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Converting VIF {"id": "15762642-ded6-4ef6-90c7-46bf3a884904", "address": "fa:16:3e:9b:fd:92", "network": {"id": "7057d5fc-5467-4681-8ed0-5243099b3df3", "bridge": "br-int", "label": "tempest-TestShelveInstance-5073894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df9034b591f2496fbef89f59646a31cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15762642-de", "ovs_interfaceid": "15762642-ded6-4ef6-90c7-46bf3a884904", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:fd:92,bridge_name='br-int',has_traffic_filtering=True,id=15762642-ded6-4ef6-90c7-46bf3a884904,network=Network(7057d5fc-5467-4681-8ed0-5243099b3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15762642-de') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG os_vif [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:fd:92,bridge_name='br-int',has_traffic_filtering=True,id=15762642-ded6-4ef6-90c7-46bf3a884904,network=Network(7057d5fc-5467-4681-8ed0-5243099b3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15762642-de') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15762642-de, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:15:41 user nova-compute[72444]: INFO os_vif [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:fd:92,bridge_name='br-int',has_traffic_filtering=True,id=15762642-ded6-4ef6-90c7-46bf3a884904,network=Network(7057d5fc-5467-4681-8ed0-5243099b3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15762642-de')
Aug 03 05:15:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MGJqnglX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:15:41 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:15:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1f916c-d9e2-47d3-97b0-48357aa45edb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42ec44f-93ad-44af-aec9-4e3352e040ad]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c (non-flash)
Aug 03 05:15:41 user nova-compute[72444]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed (non-flash)
Aug 03 05:15:41 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c (non-flash)
Aug 03 05:15:41 user nova-compute[72444]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed (non-flash)
Aug 03 05:15:41 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3094493640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c'): ({'sdb'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Removing single pathed devices sdb {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c658dda-b55a-46ef-9919-dc5bc1e2d5fd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[148db685-16dd-4479-9265-5a048cf78df4]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Flushing IO for device /dev/sdb {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7cfdaf1-caff-47e8-96eb-965b6b8061dd]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[325e6119-c7f6-4b7d-975c-9abb78d4d9a8]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOa71ee259-002c288d72418a2a', '/dev/disk/by-id/scsi-23030326332383864', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a71ee259') {{(pid=84280) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[70336f4a-6f17-4c55-8468-e99ac8b33cfe]: (4, None) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[302bb0ba-a064-4d1d-9f1b-c5b878c9ca47]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae54f0d6-7af4-4165-9c21-7c286c480eb8]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c, portal: 172.16.0.220,3260]
Aug 03 05:15:41 user nova-compute[72444]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c, portal: 172.16.0.220,3260] successful.
Aug 03 05:15:41 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0297ed59-1a10-41d1-8550-7e7cdc0b471c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[274055b2-92f1-47ef-aa16-5aa091d56192]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] <== disconnect_volume: return (283ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 05:15:41 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Deleting instance files /opt/stack/data/nova/instances/685818c7-b515-4118-a952-a52a5942c4e3_del
Aug 03 05:15:41 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Deletion of /opt/stack/data/nova/instances/685818c7-b515-4118-a952-a52a5942c4e3_del complete
Aug 03 05:15:41 user nova-compute[72444]: INFO nova.compute.manager [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 03 05:15:41 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 05:15:41 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 05:15:42 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:15:42 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Took 0.84 seconds to deallocate network for instance.
Aug 03 05:15:42 user nova-compute[72444]: DEBUG nova.compute.manager [req-ce4d26fa-df02-4e38-b0a9-48de8aaf8d33 req-94fe5ff8-cac0-452b-905c-1be518cff724 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Received event network-vif-deleted-15762642-ded6-4ef6-90c7-46bf3a884904 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:15:42 user nova-compute[72444]: INFO nova.compute.manager [req-ce4d26fa-df02-4e38-b0a9-48de8aaf8d33 req-94fe5ff8-cac0-452b-905c-1be518cff724 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Neutron deleted interface 15762642-ded6-4ef6-90c7-46bf3a884904; detaching it from the instance and deleting it from the info cache
Aug 03 05:15:42 user nova-compute[72444]: DEBUG nova.network.neutron [req-ce4d26fa-df02-4e38-b0a9-48de8aaf8d33 req-94fe5ff8-cac0-452b-905c-1be518cff724 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:15:42 user nova-compute[72444]: DEBUG nova.compute.manager [req-ce4d26fa-df02-4e38-b0a9-48de8aaf8d33 req-94fe5ff8-cac0-452b-905c-1be518cff724 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Detach interface failed, port_id=15762642-ded6-4ef6-90c7-46bf3a884904, reason: Instance 685818c7-b515-4118-a952-a52a5942c4e3 could not be found. {{(pid=72444) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 03 05:15:42 user nova-compute[72444]: DEBUG nova.compute.manager [req-70c53c01-41f1-44f9-a1c9-73a75f2a585e req-2376a1e3-0743-41fc-991f-0a0de7559165 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Received event network-vif-plugged-15762642-ded6-4ef6-90c7-46bf3a884904 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:15:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-70c53c01-41f1-44f9-a1c9-73a75f2a585e req-2376a1e3-0743-41fc-991f-0a0de7559165 service nova] Acquiring lock "685818c7-b515-4118-a952-a52a5942c4e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:15:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-70c53c01-41f1-44f9-a1c9-73a75f2a585e req-2376a1e3-0743-41fc-991f-0a0de7559165 service nova] Lock "685818c7-b515-4118-a952-a52a5942c4e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:15:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-70c53c01-41f1-44f9-a1c9-73a75f2a585e req-2376a1e3-0743-41fc-991f-0a0de7559165 service nova] Lock "685818c7-b515-4118-a952-a52a5942c4e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:15:42 user nova-compute[72444]: DEBUG nova.compute.manager [req-70c53c01-41f1-44f9-a1c9-73a75f2a585e req-2376a1e3-0743-41fc-991f-0a0de7559165 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] No waiting events found dispatching network-vif-plugged-15762642-ded6-4ef6-90c7-46bf3a884904 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:15:42 user nova-compute[72444]: WARNING nova.compute.manager [req-70c53c01-41f1-44f9-a1c9-73a75f2a585e req-2376a1e3-0743-41fc-991f-0a0de7559165 service nova] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Received unexpected event network-vif-plugged-15762642-ded6-4ef6-90c7-46bf3a884904 for instance with vm_state active and task_state deleting.
Aug 03 05:15:43 user nova-compute[72444]: INFO nova.compute.manager [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Took 0.73 seconds to detach 1 volumes for instance.
Aug 03 05:15:43 user nova-compute[72444]: DEBUG nova.compute.manager [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Deleting volume: 0297ed59-1a10-41d1-8550-7e7cdc0b471c {{(pid=72444) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 03 05:15:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:15:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:15:43 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:15:43 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:15:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.153s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:15:43 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Deleted allocations for instance 685818c7-b515-4118-a952-a52a5942c4e3
Aug 03 05:15:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-dadc28e1-c960-43ff-a860-47ec4c6b8fef tempest-TestShelveInstance-98284952 tempest-TestShelveInstance-98284952-project-member] Lock "685818c7-b515-4118-a952-a52a5942c4e3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.143s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:15:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:46 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:15:56 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691039741.145989, 685818c7-b515-4118-a952-a52a5942c4e3 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:15:56 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] VM Stopped (Lifecycle Event)
Aug 03 05:15:56 user nova-compute[72444]: DEBUG nova.compute.manager [None req-42ce683e-0bbe-4349-82f6-671df768a0f6 None None] [instance: 685818c7-b515-4118-a952-a52a5942c4e3] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:15:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:16:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:16:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:16:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:16:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:16:11 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:16:11 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:16:12 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:16:12 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:16:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-1af9b9e3-b8aa-4060-8760-f0f9c73789d4" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:16:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-1af9b9e3-b8aa-4060-8760-f0f9c73789d4" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:16:13 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 05:16:13 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Updating instance_info_cache with network_info: [{"id": "3d419d24-f4aa-447f-9140-6285ddc07469", "address": "fa:16:3e:40:7a:e5", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d419d24-f4", "ovs_interfaceid": "3d419d24-f4aa-447f-9140-6285ddc07469", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:16:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-1af9b9e3-b8aa-4060-8760-f0f9c73789d4" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:16:13 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 05:16:13 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:16:14 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:16:14 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:16:14 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 05:16:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:16:16 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:16:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:16:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:16:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:16:16 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:16:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 05:16:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06bccfea-4a42-4880-8712-e9a7c0cd2a13/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:16:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06bccfea-4a42-4880-8712-e9a7c0cd2a13/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:16:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06bccfea-4a42-4880-8712-e9a7c0cd2a13/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:16:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06bccfea-4a42-4880-8712-e9a7c0cd2a13/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:16:17 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:16:17 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:16:17 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=8593MB free_disk=25.364673614501953GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:16:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:16:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:16:17 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 1af9b9e3-b8aa-4060-8760-f0f9c73789d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:16:17 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 06bccfea-4a42-4880-8712-e9a7c0cd2a13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:16:17 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:16:17 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:16:17 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:16:18 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:16:18 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:16:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.270s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:16:20 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:16:20 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:16:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:16:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:16:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:16:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:16:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:16:33 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:16:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:16:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:16:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:16:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:16:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:16:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:16:33 user nova-compute[72444]: DEBUG nova.virt.libvirt.imagecache [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Verify base images {{(pid=72444) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 03 05:16:33 user nova-compute[72444]: DEBUG nova.virt.libvirt.imagecache [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Image id 9a69e530-bd68-45b7-bffb-f7168139ceb0 yields fingerprint 28c6862ec5faf5161485750919ad7d82dae2ae3e {{(pid=72444) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 03 05:16:33 user nova-compute[72444]: INFO nova.virt.libvirt.imagecache [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] image 9a69e530-bd68-45b7-bffb-f7168139ceb0 at (/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e): checking
Aug 03 05:16:33 user nova-compute[72444]: DEBUG nova.virt.libvirt.imagecache [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] image 9a69e530-bd68-45b7-bffb-f7168139ceb0 at (/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e): image is in use {{(pid=72444) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 03 05:16:33 user nova-compute[72444]: DEBUG nova.virt.libvirt.imagecache [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=72444) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 03 05:16:33 user nova-compute[72444]: DEBUG nova.virt.libvirt.imagecache [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] 1af9b9e3-b8aa-4060-8760-f0f9c73789d4 is a valid instance name {{(pid=72444) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 03 05:16:33 user nova-compute[72444]: DEBUG nova.virt.libvirt.imagecache [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] 06bccfea-4a42-4880-8712-e9a7c0cd2a13 is a valid instance name {{(pid=72444) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 03 05:16:33 user nova-compute[72444]: DEBUG nova.virt.libvirt.imagecache [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] 06bccfea-4a42-4880-8712-e9a7c0cd2a13 has a disk file {{(pid=72444) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 03 05:16:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06bccfea-4a42-4880-8712-e9a7c0cd2a13/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:16:34 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06bccfea-4a42-4880-8712-e9a7c0cd2a13/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:16:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.imagecache [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 06bccfea-4a42-4880-8712-e9a7c0cd2a13 is backed by 28c6862ec5faf5161485750919ad7d82dae2ae3e {{(pid=72444) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 03 05:16:34 user nova-compute[72444]: WARNING nova.virt.libvirt.imagecache [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b33b805235558cefcc6f2c9dad0d690fac5bda52
Aug 03 05:16:34 user nova-compute[72444]: WARNING nova.virt.libvirt.imagecache [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Unknown base file: /opt/stack/data/nova/instances/_base/6a8c40599f74054742e318f5913d29f10740fe8a
Aug 03 05:16:34 user nova-compute[72444]: WARNING nova.virt.libvirt.imagecache [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e268fc11716d4f0234addcf0a05158bc52f1db71
Aug 03 05:16:34 user nova-compute[72444]: WARNING nova.virt.libvirt.imagecache [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8fa9e0e0ea39b028e5ad74be808f9bc31b3cef4d
Aug 03 05:16:34 user nova-compute[72444]: WARNING nova.virt.libvirt.imagecache [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Unknown base file: /opt/stack/data/nova/instances/_base/897dc89e7f234b25f627c191ee97deed1b2070f4
Aug 03 05:16:34 user nova-compute[72444]: WARNING nova.virt.libvirt.imagecache [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Unknown base file: /opt/stack/data/nova/instances/_base/af0d1ccff0235893ba423a6081b39968740a7d75
Aug 03 05:16:34 user nova-compute[72444]: WARNING nova.virt.libvirt.imagecache [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3655f7fe9631b1da9a81c3a279bedb099ef0165c
Aug 03 05:16:34 user nova-compute[72444]: WARNING nova.virt.libvirt.imagecache [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1efdd16df76198a83b6a587f7e5bfa6e644bed95
Aug 03 05:16:34 user nova-compute[72444]: WARNING nova.virt.libvirt.imagecache [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f696e590c80c2ec2521c55acdfb83162490dcdde
Aug 03 05:16:34 user nova-compute[72444]: INFO nova.virt.libvirt.imagecache [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Active base files: /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e
Aug 03 05:16:34 user nova-compute[72444]: INFO nova.virt.libvirt.imagecache [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Removable base files: /opt/stack/data/nova/instances/_base/b33b805235558cefcc6f2c9dad0d690fac5bda52 /opt/stack/data/nova/instances/_base/6a8c40599f74054742e318f5913d29f10740fe8a /opt/stack/data/nova/instances/_base/e268fc11716d4f0234addcf0a05158bc52f1db71 /opt/stack/data/nova/instances/_base/8fa9e0e0ea39b028e5ad74be808f9bc31b3cef4d /opt/stack/data/nova/instances/_base/897dc89e7f234b25f627c191ee97deed1b2070f4 /opt/stack/data/nova/instances/_base/af0d1ccff0235893ba423a6081b39968740a7d75 /opt/stack/data/nova/instances/_base/3655f7fe9631b1da9a81c3a279bedb099ef0165c /opt/stack/data/nova/instances/_base/1efdd16df76198a83b6a587f7e5bfa6e644bed95 /opt/stack/data/nova/instances/_base/f696e590c80c2ec2521c55acdfb83162490dcdde
Aug 03 05:16:34 user nova-compute[72444]: INFO nova.virt.libvirt.imagecache [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b33b805235558cefcc6f2c9dad0d690fac5bda52
Aug 03 05:16:34 user nova-compute[72444]: INFO nova.virt.libvirt.imagecache [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6a8c40599f74054742e318f5913d29f10740fe8a
Aug 03 05:16:34 user nova-compute[72444]: INFO nova.virt.libvirt.imagecache [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e268fc11716d4f0234addcf0a05158bc52f1db71
Aug 03 05:16:34 user nova-compute[72444]: INFO nova.virt.libvirt.imagecache [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8fa9e0e0ea39b028e5ad74be808f9bc31b3cef4d
Aug 03 05:16:34 user nova-compute[72444]: INFO nova.virt.libvirt.imagecache [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/897dc89e7f234b25f627c191ee97deed1b2070f4
Aug 03 05:16:34 user nova-compute[72444]: INFO nova.virt.libvirt.imagecache [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/af0d1ccff0235893ba423a6081b39968740a7d75
Aug 03 05:16:34 user nova-compute[72444]: INFO nova.virt.libvirt.imagecache [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3655f7fe9631b1da9a81c3a279bedb099ef0165c
Aug 03 05:16:34 user nova-compute[72444]: INFO nova.virt.libvirt.imagecache [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1efdd16df76198a83b6a587f7e5bfa6e644bed95
Aug 03 05:16:34 user nova-compute[72444]: INFO nova.virt.libvirt.imagecache [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f696e590c80c2ec2521c55acdfb83162490dcdde
Aug 03 05:16:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.imagecache [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Verification complete {{(pid=72444) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 03 05:16:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.imagecache [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Verify swap images {{(pid=72444) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 03 05:16:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.imagecache [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Verify ephemeral images {{(pid=72444) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 03 05:16:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:16:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:16:37 user nova-compute[72444]: DEBUG nova.compute.manager [req-cd583062-95c7-4217-acba-f01d579b4cab req-23d17258-e5be-487b-bffc-1b5d475bd0a0 service nova] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Received event network-changed-3d419d24-f4aa-447f-9140-6285ddc07469 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:16:37 user nova-compute[72444]: DEBUG nova.compute.manager [req-cd583062-95c7-4217-acba-f01d579b4cab req-23d17258-e5be-487b-bffc-1b5d475bd0a0 service nova] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Refreshing instance network info cache due to event network-changed-3d419d24-f4aa-447f-9140-6285ddc07469. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:16:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-cd583062-95c7-4217-acba-f01d579b4cab req-23d17258-e5be-487b-bffc-1b5d475bd0a0 service nova] Acquiring lock "refresh_cache-1af9b9e3-b8aa-4060-8760-f0f9c73789d4" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:16:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-cd583062-95c7-4217-acba-f01d579b4cab req-23d17258-e5be-487b-bffc-1b5d475bd0a0 service nova] Acquired lock "refresh_cache-1af9b9e3-b8aa-4060-8760-f0f9c73789d4" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:16:37 user nova-compute[72444]: DEBUG nova.network.neutron [req-cd583062-95c7-4217-acba-f01d579b4cab req-23d17258-e5be-487b-bffc-1b5d475bd0a0 service nova] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Refreshing network info cache for port 3d419d24-f4aa-447f-9140-6285ddc07469 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:16:37 user nova-compute[72444]: DEBUG nova.network.neutron [req-cd583062-95c7-4217-acba-f01d579b4cab req-23d17258-e5be-487b-bffc-1b5d475bd0a0 service nova] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Updated VIF entry in instance network info cache for port 3d419d24-f4aa-447f-9140-6285ddc07469. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:16:37 user nova-compute[72444]: DEBUG nova.network.neutron [req-cd583062-95c7-4217-acba-f01d579b4cab req-23d17258-e5be-487b-bffc-1b5d475bd0a0 service nova] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Updating instance_info_cache with network_info: [{"id": "3d419d24-f4aa-447f-9140-6285ddc07469", "address": "fa:16:3e:40:7a:e5", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d419d24-f4", "ovs_interfaceid": "3d419d24-f4aa-447f-9140-6285ddc07469", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:16:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "1af9b9e3-b8aa-4060-8760-f0f9c73789d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:16:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "1af9b9e3-b8aa-4060-8760-f0f9c73789d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:16:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "1af9b9e3-b8aa-4060-8760-f0f9c73789d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:16:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "1af9b9e3-b8aa-4060-8760-f0f9c73789d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:16:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "1af9b9e3-b8aa-4060-8760-f0f9c73789d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:16:37 user nova-compute[72444]: INFO nova.compute.manager [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Terminating instance
Aug 03 05:16:37 user nova-compute[72444]: DEBUG nova.compute.manager [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 05:16:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-cd583062-95c7-4217-acba-f01d579b4cab req-23d17258-e5be-487b-bffc-1b5d475bd0a0 service nova] Releasing lock "refresh_cache-1af9b9e3-b8aa-4060-8760-f0f9c73789d4" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:16:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:16:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:16:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:16:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:16:38 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Instance destroyed successfully.
Aug 03 05:16:38 user nova-compute[72444]: DEBUG nova.objects.instance [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lazy-loading 'resources' on Instance uuid 1af9b9e3-b8aa-4060-8760-f0f9c73789d4 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-126063360',display_name='tempest-TestVolumeBootPattern-server-126063360',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-126063360',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJb/ucac2bYqYTTpUwHVlINSI4Sfb+N0MYWJk4BUfIgi24wGpfawX18lRHaBUwUNuvA9BvzcrJArj3JZ6r/WP+myl5DP/2VX4xcdyXqMaH1gGJv8NyGzE7tn1ggSM7aa7A==',key_name='tempest-TestVolumeBootPattern-1711073489',keypairs=<?>,launch_index=0,launched_at=2023-08-03T05:14:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae931112fcda4e2f8dfd4f540d905139',ramdisk_id='',reservation_id='r-bef6tsz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1788747136',owner_user_name='tempest-TestVolumeBootPattern-1788747136-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T05:14:58Z,user_data=None,user_id='ef4d8130e33c4d9ea44c29be12f18234',uuid=1af9b9e3-b8aa-4060-8760-f0f9c73789d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d419d24-f4aa-447f-9140-6285ddc07469", "address": "fa:16:3e:40:7a:e5", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d419d24-f4", "ovs_interfaceid": "3d419d24-f4aa-447f-9140-6285ddc07469", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Converting VIF {"id": "3d419d24-f4aa-447f-9140-6285ddc07469", "address": "fa:16:3e:40:7a:e5", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d419d24-f4", "ovs_interfaceid": "3d419d24-f4aa-447f-9140-6285ddc07469", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:7a:e5,bridge_name='br-int',has_traffic_filtering=True,id=3d419d24-f4aa-447f-9140-6285ddc07469,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d419d24-f4') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG os_vif [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:7a:e5,bridge_name='br-int',has_traffic_filtering=True,id=3d419d24-f4aa-447f-9140-6285ddc07469,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d419d24-f4') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d419d24-f4, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:16:38 user nova-compute[72444]: INFO os_vif [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:7a:e5,bridge_name='br-int',has_traffic_filtering=True,id=3d419d24-f4aa-447f-9140-6285ddc07469,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d419d24-f4')
Aug 03 05:16:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDySbitl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:16:38 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:16:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f47965-04f6-4f6b-828c-70d5b281e751]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe026d58-7ada-4d14-ba9c-931bbf8d5c64]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed (non-flash)
Aug 03 05:16:38 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed (non-flash)
Aug 03 05:16:38 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308c13df30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed'): ({'sdc'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Removing single pathed devices sdc {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c869b7e4-d283-4e95-975b-6982dfe05ecd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c003cd42-b08b-4da1-be35-92e16447f6c0]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Flushing IO for device /dev/sdc {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a535aae8-e5c0-46e1-8a02-6ab8c4d01139]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[db27c87b-e25d-447f-a1c4-6a9efd0d298f]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] SCSI volumes sdc have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO1607314b-51b20e3ba7842e48', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_1607314b', '/dev/disk/by-id/scsi-23531623230653362') {{(pid=84280) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[888e5f49-ec40-4b3e-91d4-c327eb0914e7]: (4, None) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af19417-3727-4cb3-8ca7-c3db51f75c83]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c40cd5e-436c-46cd-bba8-bf567fd99d23]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed, portal: 172.16.0.220,3260]
Aug 03 05:16:38 user nova-compute[72444]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed, portal: 172.16.0.220,3260] successful.
Aug 03 05:16:38 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e39986-c2e6-4970-ad8a-d5f176d4eb28]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] <== disconnect_volume: return (337ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 05:16:38 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Deleting instance files /opt/stack/data/nova/instances/1af9b9e3-b8aa-4060-8760-f0f9c73789d4_del
Aug 03 05:16:38 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Deletion of /opt/stack/data/nova/instances/1af9b9e3-b8aa-4060-8760-f0f9c73789d4_del complete
Aug 03 05:16:38 user nova-compute[72444]: INFO nova.compute.manager [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Took 1.21 seconds to destroy the instance on the hypervisor.
Aug 03 05:16:38 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 05:16:38 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 05:16:39 user nova-compute[72444]: DEBUG nova.compute.manager [req-d5d8e01e-23f9-4e45-b58e-c08ff516ea87 req-9540ce55-3317-4e35-a131-1cebdc0e4308 service nova] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Received event network-vif-unplugged-3d419d24-f4aa-447f-9140-6285ddc07469 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:16:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d5d8e01e-23f9-4e45-b58e-c08ff516ea87 req-9540ce55-3317-4e35-a131-1cebdc0e4308 service nova] Acquiring lock "1af9b9e3-b8aa-4060-8760-f0f9c73789d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:16:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d5d8e01e-23f9-4e45-b58e-c08ff516ea87 req-9540ce55-3317-4e35-a131-1cebdc0e4308 service nova] Lock "1af9b9e3-b8aa-4060-8760-f0f9c73789d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:16:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d5d8e01e-23f9-4e45-b58e-c08ff516ea87 req-9540ce55-3317-4e35-a131-1cebdc0e4308 service nova] Lock "1af9b9e3-b8aa-4060-8760-f0f9c73789d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:16:39 user nova-compute[72444]: DEBUG nova.compute.manager [req-d5d8e01e-23f9-4e45-b58e-c08ff516ea87 req-9540ce55-3317-4e35-a131-1cebdc0e4308 service nova] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] No waiting events found dispatching network-vif-unplugged-3d419d24-f4aa-447f-9140-6285ddc07469 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:16:39 user nova-compute[72444]: DEBUG nova.compute.manager [req-d5d8e01e-23f9-4e45-b58e-c08ff516ea87 req-9540ce55-3317-4e35-a131-1cebdc0e4308 service nova] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Received event network-vif-unplugged-3d419d24-f4aa-447f-9140-6285ddc07469 for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 05:16:39 user nova-compute[72444]: DEBUG nova.compute.manager [req-d5d8e01e-23f9-4e45-b58e-c08ff516ea87 req-9540ce55-3317-4e35-a131-1cebdc0e4308 service nova] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Received event network-vif-plugged-3d419d24-f4aa-447f-9140-6285ddc07469 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:16:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d5d8e01e-23f9-4e45-b58e-c08ff516ea87 req-9540ce55-3317-4e35-a131-1cebdc0e4308 service nova] Acquiring lock "1af9b9e3-b8aa-4060-8760-f0f9c73789d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:16:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d5d8e01e-23f9-4e45-b58e-c08ff516ea87 req-9540ce55-3317-4e35-a131-1cebdc0e4308 service nova] Lock "1af9b9e3-b8aa-4060-8760-f0f9c73789d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:16:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d5d8e01e-23f9-4e45-b58e-c08ff516ea87 req-9540ce55-3317-4e35-a131-1cebdc0e4308 service nova] Lock "1af9b9e3-b8aa-4060-8760-f0f9c73789d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:16:39 user nova-compute[72444]: DEBUG nova.compute.manager [req-d5d8e01e-23f9-4e45-b58e-c08ff516ea87 req-9540ce55-3317-4e35-a131-1cebdc0e4308 service nova] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] No waiting events found dispatching network-vif-plugged-3d419d24-f4aa-447f-9140-6285ddc07469 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:16:39 user nova-compute[72444]: WARNING nova.compute.manager [req-d5d8e01e-23f9-4e45-b58e-c08ff516ea87 req-9540ce55-3317-4e35-a131-1cebdc0e4308 service nova] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Received unexpected event network-vif-plugged-3d419d24-f4aa-447f-9140-6285ddc07469 for instance with vm_state active and task_state deleting.
Aug 03 05:16:39 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:16:39 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Took 0.95 seconds to deallocate network for instance.
Aug 03 05:16:40 user nova-compute[72444]: INFO nova.compute.manager [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Took 0.76 seconds to detach 1 volumes for instance.
Aug 03 05:16:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:16:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:16:40 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:16:40 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:16:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.156s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:16:40 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Deleted allocations for instance 1af9b9e3-b8aa-4060-8760-f0f9c73789d4
Aug 03 05:16:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:16:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-54ae189b-7311-4d3b-a9c8-83c94c54210c tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "1af9b9e3-b8aa-4060-8760-f0f9c73789d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.252s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:16:41 user nova-compute[72444]: DEBUG nova.compute.manager [req-33ebf43a-6000-41c0-86da-51c4948c4912 req-9c83406d-b406-4e32-a858-8d418ac74b93 service nova] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Received event network-vif-deleted-3d419d24-f4aa-447f-9140-6285ddc07469 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:16:43 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:16:48 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:16:53 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691039798.5283072, 1af9b9e3-b8aa-4060-8760-f0f9c73789d4 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:16:53 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] VM Stopped (Lifecycle Event)
Aug 03 05:16:53 user nova-compute[72444]: DEBUG nova.compute.manager [None req-19d94ba3-d020-4496-ad28-79284e7aa100 None None] [instance: 1af9b9e3-b8aa-4060-8760-f0f9c73789d4] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:16:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:16:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:16:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:16:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:16:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:16:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:16:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:17:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:17:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:17:09 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:17:09 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Cleaning up deleted instances {{(pid=72444) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 03 05:17:09 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] There are 0 instances to clean {{(pid=72444) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 03 05:17:11 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:17:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:17:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:17:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:17:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:17:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:17:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:17:13 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:17:13 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:17:13 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Rebuilding the list of instances to heal {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 05:17:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-06bccfea-4a42-4880-8712-e9a7c0cd2a13" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:17:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-06bccfea-4a42-4880-8712-e9a7c0cd2a13" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:17:13 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 05:17:13 user nova-compute[72444]: DEBUG nova.objects.instance [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lazy-loading 'info_cache' on Instance uuid 06bccfea-4a42-4880-8712-e9a7c0cd2a13 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:17:14 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Updating instance_info_cache with network_info: [{"id": "51cc40fe-4c00-4266-94f7-6eb722f9253e", "address": "fa:16:3e:8b:f2:c5", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cc40fe-4c", "ovs_interfaceid": "51cc40fe-4c00-4266-94f7-6eb722f9253e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:17:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-06bccfea-4a42-4880-8712-e9a7c0cd2a13" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:17:14 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 05:17:14 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:17:14 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:17:16 user nova-compute[72444]: DEBUG nova.compute.manager [req-75b9038e-58f5-4f45-a809-6195f9ac3b61 req-3fc1084b-6e2b-45b9-b642-2d4332c9aeef service nova] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Received event network-changed-51cc40fe-4c00-4266-94f7-6eb722f9253e {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:17:16 user nova-compute[72444]: DEBUG nova.compute.manager [req-75b9038e-58f5-4f45-a809-6195f9ac3b61 req-3fc1084b-6e2b-45b9-b642-2d4332c9aeef service nova] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Refreshing instance network info cache due to event network-changed-51cc40fe-4c00-4266-94f7-6eb722f9253e. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:17:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-75b9038e-58f5-4f45-a809-6195f9ac3b61 req-3fc1084b-6e2b-45b9-b642-2d4332c9aeef service nova] Acquiring lock "refresh_cache-06bccfea-4a42-4880-8712-e9a7c0cd2a13" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:17:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-75b9038e-58f5-4f45-a809-6195f9ac3b61 req-3fc1084b-6e2b-45b9-b642-2d4332c9aeef service nova] Acquired lock "refresh_cache-06bccfea-4a42-4880-8712-e9a7c0cd2a13" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:17:16 user nova-compute[72444]: DEBUG nova.network.neutron [req-75b9038e-58f5-4f45-a809-6195f9ac3b61 req-3fc1084b-6e2b-45b9-b642-2d4332c9aeef service nova] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Refreshing network info cache for port 51cc40fe-4c00-4266-94f7-6eb722f9253e {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:17:16 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:17:16 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:17:16 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 05:17:16 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:17:16 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72444) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 03 05:17:16 user nova-compute[72444]: DEBUG nova.network.neutron [req-75b9038e-58f5-4f45-a809-6195f9ac3b61 req-3fc1084b-6e2b-45b9-b642-2d4332c9aeef service nova] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Updated VIF entry in instance network info cache for port 51cc40fe-4c00-4266-94f7-6eb722f9253e. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:17:16 user nova-compute[72444]: DEBUG nova.network.neutron [req-75b9038e-58f5-4f45-a809-6195f9ac3b61 req-3fc1084b-6e2b-45b9-b642-2d4332c9aeef service nova] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Updating instance_info_cache with network_info: [{"id": "51cc40fe-4c00-4266-94f7-6eb722f9253e", "address": "fa:16:3e:8b:f2:c5", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cc40fe-4c", "ovs_interfaceid": "51cc40fe-4c00-4266-94f7-6eb722f9253e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:17:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-75b9038e-58f5-4f45-a809-6195f9ac3b61 req-3fc1084b-6e2b-45b9-b642-2d4332c9aeef service nova] Releasing lock "refresh_cache-06bccfea-4a42-4880-8712-e9a7c0cd2a13" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:17:18 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:17:18 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:17:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:17:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:17:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:17:18 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:17:19 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06bccfea-4a42-4880-8712-e9a7c0cd2a13/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:17:19 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06bccfea-4a42-4880-8712-e9a7c0cd2a13/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:17:19 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06bccfea-4a42-4880-8712-e9a7c0cd2a13/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:17:19 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06bccfea-4a42-4880-8712-e9a7c0cd2a13/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:17:19 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:17:19 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:17:19 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=8668MB free_disk=25.354557037353516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:17:19 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:17:19 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:17:19 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 06bccfea-4a42-4880-8712-e9a7c0cd2a13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:17:19 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:17:19 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:17:19 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Refreshing inventories for resource provider b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 03 05:17:20 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Updating ProviderTree inventory for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 03 05:17:20 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Updating inventory in ProviderTree for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 03 05:17:20 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Refreshing aggregate associations for resource provider b624a913-bb6b-4a17-8cd7-7b0950cff161, aggregates: None {{(pid=72444) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 03 05:17:20 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Refreshing trait associations for resource provider b624a913-bb6b-4a17-8cd7-7b0950cff161, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=72444) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 03 05:17:20 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:17:20 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:17:20 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:17:20 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.467s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:17:20 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "06bccfea-4a42-4880-8712-e9a7c0cd2a13" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:17:20 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "06bccfea-4a42-4880-8712-e9a7c0cd2a13" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:17:20 user nova-compute[72444]: DEBUG nova.objects.instance [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lazy-loading 'flavor' on Instance uuid 06bccfea-4a42-4880-8712-e9a7c0cd2a13 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:17:20 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "06bccfea-4a42-4880-8712-e9a7c0cd2a13" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:17:20 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "06bccfea-4a42-4880-8712-e9a7c0cd2a13" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:17:20 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "06bccfea-4a42-4880-8712-e9a7c0cd2a13" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:17:20 user nova-compute[72444]: INFO nova.compute.manager [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Attaching volume 11a0035f-0cda-438e-8671-af5f4b663f71 to /dev/vdb
Aug 03 05:17:20 user nova-compute[72444]: DEBUG os_brick.utils [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:17:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:17:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:17:20 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfa398f-3237-4350-8d7d-5afa758497ec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:17:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:17:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:17:20 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[299cac86-9789-451e-abb7-f28d41b4ae48]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:17:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:17:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:17:20 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c2d1dc-71ca-4b66-afea-8274298027f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:17:20 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b38f3e-e769-4daf-8c54-77325654b5c8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:17:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:17:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:17:20 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 05:17:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:17:20 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:17:20 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 05:17:20 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b4a470-aaf7-444a-af7e-c1aea05ddbeb]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:17:20 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 05:17:20 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 05:17:20 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 05:17:20 user nova-compute[72444]: DEBUG os_brick.utils [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:17:20 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Updating existing volume attachment record: fcef555e-aba2-49c7-aa08-1a8886821603 {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 05:17:20 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:17:20 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:17:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:17:22 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:17:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:17:23 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:17:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:17:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:17:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "2a778b55-8481-43cb-a628-b6c3c0690933" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:17:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "2a778b55-8481-43cb-a628-b6c3c0690933" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:17:30 user nova-compute[72444]: DEBUG nova.compute.manager [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 05:17:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:17:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:17:30 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 05:17:30 user nova-compute[72444]: INFO nova.compute.claims [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Claim successful on node user
Aug 03 05:17:30 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:17:30 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:17:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.229s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:17:30 user nova-compute[72444]: DEBUG nova.compute.manager [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 05:17:30 user nova-compute[72444]: DEBUG nova.compute.manager [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 05:17:30 user nova-compute[72444]: DEBUG nova.network.neutron [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 05:17:30 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 05:17:30 user nova-compute[72444]: DEBUG nova.compute.manager [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 05:17:30 user nova-compute[72444]: DEBUG nova.policy [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ef4d8130e33c4d9ea44c29be12f18234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae931112fcda4e2f8dfd4f540d905139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 05:17:30 user nova-compute[72444]: INFO nova.virt.block_device [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Booting with volume 6eeb498c-9c47-4bd7-96cf-95f826712fed at /dev/vda
Aug 03 05:17:30 user nova-compute[72444]: DEBUG os_brick.utils [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:17:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:17:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:17:30 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd3d6dd-1f4a-464c-b665-0de2adeb9c08]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:17:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:17:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:17:30 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf825f06-feca-4890-8816-1de998523421]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:17:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:17:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:17:30 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[240fa440-e892-4028-8c8c-aa532c585fc7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:17:30 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e2a1b7-d7b8-4753-ad59-30a13dd01c02]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:17:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:17:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:17:30 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 05:17:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:17:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:17:30 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 05:17:30 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d44fc73-b135-41f0-8918-97b111b1323a]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:17:30 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 05:17:30 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 05:17:30 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 05:17:30 user nova-compute[72444]: DEBUG os_brick.utils [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:17:30 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Updating existing volume attachment record: 77ae3dd4-3868-4c8e-b0c7-7db5593d6afc {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 05:17:31 user nova-compute[72444]: DEBUG nova.network.neutron [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Successfully created port: d9d18ac0-7b2c-4672-8b38-c792c15fb294 {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 05:17:32 user nova-compute[72444]: DEBUG nova.network.neutron [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Successfully updated port: d9d18ac0-7b2c-4672-8b38-c792c15fb294 {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 05:17:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "refresh_cache-2a778b55-8481-43cb-a628-b6c3c0690933" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:17:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquired lock "refresh_cache-2a778b55-8481-43cb-a628-b6c3c0690933" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:17:32 user nova-compute[72444]: DEBUG nova.network.neutron [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 05:17:32 user nova-compute[72444]: DEBUG nova.compute.manager [req-4f66ad8e-b889-4e1e-9259-3e4cdb6e8ae9 req-4a24c0c8-8b4e-4ee7-b18e-f6df6a88ab39 service nova] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Received event network-changed-d9d18ac0-7b2c-4672-8b38-c792c15fb294 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:17:32 user nova-compute[72444]: DEBUG nova.compute.manager [req-4f66ad8e-b889-4e1e-9259-3e4cdb6e8ae9 req-4a24c0c8-8b4e-4ee7-b18e-f6df6a88ab39 service nova] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Refreshing instance network info cache due to event network-changed-d9d18ac0-7b2c-4672-8b38-c792c15fb294. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:17:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4f66ad8e-b889-4e1e-9259-3e4cdb6e8ae9 req-4a24c0c8-8b4e-4ee7-b18e-f6df6a88ab39 service nova] Acquiring lock "refresh_cache-2a778b55-8481-43cb-a628-b6c3c0690933" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:17:32 user nova-compute[72444]: DEBUG nova.network.neutron [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 05:17:32 user nova-compute[72444]: DEBUG nova.network.neutron [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Updating instance_info_cache with network_info: [{"id": "d9d18ac0-7b2c-4672-8b38-c792c15fb294", "address": "fa:16:3e:af:09:a0", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d18ac0-7b", "ovs_interfaceid": "d9d18ac0-7b2c-4672-8b38-c792c15fb294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:17:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Releasing lock "refresh_cache-2a778b55-8481-43cb-a628-b6c3c0690933" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:17:32 user nova-compute[72444]: DEBUG nova.compute.manager [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Instance network_info: |[{"id": "d9d18ac0-7b2c-4672-8b38-c792c15fb294", "address": "fa:16:3e:af:09:a0", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d18ac0-7b", "ovs_interfaceid": "d9d18ac0-7b2c-4672-8b38-c792c15fb294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 05:17:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4f66ad8e-b889-4e1e-9259-3e4cdb6e8ae9 req-4a24c0c8-8b4e-4ee7-b18e-f6df6a88ab39 service nova] Acquired lock "refresh_cache-2a778b55-8481-43cb-a628-b6c3c0690933" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:17:32 user nova-compute[72444]: DEBUG nova.network.neutron [req-4f66ad8e-b889-4e1e-9259-3e4cdb6e8ae9 req-4a24c0c8-8b4e-4ee7-b18e-f6df6a88ab39 service nova] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Refreshing network info cache for port d9d18ac0-7b2c-4672-8b38-c792c15fb294 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:17:32 user nova-compute[72444]: DEBUG nova.network.neutron [req-4f66ad8e-b889-4e1e-9259-3e4cdb6e8ae9 req-4a24c0c8-8b4e-4ee7-b18e-f6df6a88ab39 service nova] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Updated VIF entry in instance network info cache for port d9d18ac0-7b2c-4672-8b38-c792c15fb294. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:17:32 user nova-compute[72444]: DEBUG nova.network.neutron [req-4f66ad8e-b889-4e1e-9259-3e4cdb6e8ae9 req-4a24c0c8-8b4e-4ee7-b18e-f6df6a88ab39 service nova] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Updating instance_info_cache with network_info: [{"id": "d9d18ac0-7b2c-4672-8b38-c792c15fb294", "address": "fa:16:3e:af:09:a0", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d18ac0-7b", "ovs_interfaceid": "d9d18ac0-7b2c-4672-8b38-c792c15fb294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:17:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4f66ad8e-b889-4e1e-9259-3e4cdb6e8ae9 req-4a24c0c8-8b4e-4ee7-b18e-f6df6a88ab39 service nova] Releasing lock "refresh_cache-2a778b55-8481-43cb-a628-b6c3c0690933" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GxcSkYiR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:17:33 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:17:33 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:17:33 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:17:33 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:17:33 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 05:17:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16ef549-cf96-42fd-8e3e-eb477b35de58]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 05:17:33 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0ae6f0-eba0-4d6a-94b0-d4a9535dd377]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71] added
Aug 03 05:17:33 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2a0dca-6111-465c-abbb-7578f19662ef]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d393026-49aa-40a2-9cbd-8c7b68514f1b]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GxcSkYiR {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GxcSkYiR" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[11413353-c4d6-4f0c-a793-386a998028fa]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GxcSkYiR'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[42163678-66ac-405d-a05d-59fa73fd9446]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[963ad0d1-75ed-4be5-83b3-acaaaff2cdab]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 03 05:17:33 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 03 05:17:33 user nova-compute[72444]:  {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:17:33 user nova-compute[72444]: WARNING os_brick.initiator.connectors.iscsi [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 03 05:17:33 user nova-compute[72444]: 
Aug 03 05:17:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[75914bc8-28c5-41c6-845c-f3a78dabca5e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71, portal: 172.16.0.220,3260]
Aug 03 05:17:33 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71, portal: 172.16.0.220,3260] successful.
Aug 03 05:17:33 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e986afa-18aa-4570-9c21-b0cb728aa049]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[06554d2e-d847-4a8b-aad1-5c62014802fd]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 (non-flash)
Aug 03 05:17:33 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 (non-flash)
Aug 03 05:17:33 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01f2b30-3145-4da6-8baf-65c75f1a72e7]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GxcSkYiR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 05:17:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:17:34 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:17:34 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '26139613261373331', 'path': '/dev/sdb'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:17:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139613261373331', 'path': '/dev/sdb'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 05:17:34 user nova-compute[72444]: DEBUG nova.objects.instance [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lazy-loading 'flavor' on Instance uuid 06bccfea-4a42-4880-8712-e9a7c0cd2a13 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:17:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 05:17:34 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:17:34 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 05:17:34 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 05:17:34 user nova-compute[72444]:   <serial>11a0035f-0cda-438e-8671-af5f4b663f71</serial>
Aug 03 05:17:34 user nova-compute[72444]: </disk>
Aug 03 05:17:34 user nova-compute[72444]:  {{(pid=72444) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 05:17:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:17:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:17:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] No VIF found with MAC fa:16:3e:8b:f2:c5, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 05:17:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-3c91c70f-ac30-4e03-8f01-f6dbefb10f9f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "06bccfea-4a42-4880-8712-e9a7c0cd2a13" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.365s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:17:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:17:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG nova.compute.manager [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 05:17:38 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Creating image(s)
Aug 03 05:17:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Did not create local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Ensure instance console log exists: /opt/stack/data/nova/instances/2a778b55-8481-43cb-a628-b6c3c0690933/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Start _get_guest_xml network_info=[{"id": "d9d18ac0-7b2c-4672-8b38-c792c15fb294", "address": "fa:16:3e:af:09:a0", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d18ac0-7b", "ovs_interfaceid": "d9d18ac0-7b2c-4672-8b38-c792c15fb294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDySbitl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2a778b55-8481-43cb-a628-b6c3c0690933', 'attached_at': '', 'detached_at': '', 'volume_id': '6eeb498c-9c47-4bd7-96cf-95f826712fed', 'serial': '6eeb498c-9c47-4bd7-96cf-95f826712fed'}, 'disk_bus': 'virtio', 'attachment_id': '77ae3dd4-3868-4c8e-b0c7-7db5593d6afc', 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 05:17:38 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:17:38 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:17:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDySbitl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:17:38 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:17:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:17:38 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:17:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:17:38 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 05:17:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16a3468-9c74-4e6a-93b5-02ee7eead045]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 05:17:38 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[11314bdc-c932-4aec-8ce3-e82de20c9707]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed] added
Aug 03 05:17:38 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a6308d-9bc3-4e97-8cf7-f8e43bdbaac6]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7908c4f2-2065-419d-ba72-4c6a16938db9]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gDySbitl {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gDySbitl" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[06efe4c7-a797-4aa2-87c4-2429210f34bf]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gDySbitl'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6905289c-7807-4f57-95d6-13c8889166df]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d388f4-3541-4d3f-a030-9a0f4ceb2a11]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 (non-flash)
Aug 03 05:17:38 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 (non-flash)
Aug 03 05:17:38 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3828f864-e175-4de5-bafc-395b4bc76491]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed, portal: 172.16.0.220,3260]
Aug 03 05:17:38 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed, portal: 172.16.0.220,3260] successful.
Aug 03 05:17:38 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:17:38 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:17:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:17:39 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e60f101-5dcc-490e-aaf5-a5e7af461f46]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:17:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:17:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:17:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:17:39 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f7a792-ce91-4bfc-be8c-c1e0601373f2]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:17:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 (non-flash)
Aug 03 05:17:39 user nova-compute[72444]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed (non-flash)
Aug 03 05:17:39 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:17:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 (non-flash)
Aug 03 05:17:39 user nova-compute[72444]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed (non-flash)
Aug 03 05:17:39 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:17:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:17:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 05:17:39 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 05:17:39 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 05:17:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:17:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:17:39 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa5d445-62a5-4fdb-b021-9092cf297597]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:17:39 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: None {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 05:17:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "b20dc75b-a699-4d76-bfa7-a62d2f7ef731" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:17:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "b20dc75b-a699-4d76-bfa7-a62d2f7ef731" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:17:39 user nova-compute[72444]: DEBUG nova.compute.manager [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 05:17:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:17:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:17:39 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 05:17:39 user nova-compute[72444]: INFO nova.compute.claims [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Claim successful on node user
Aug 03 05:17:39 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:17:39 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:17:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.293s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:17:39 user nova-compute[72444]: DEBUG nova.compute.manager [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 05:17:39 user nova-compute[72444]: DEBUG nova.compute.manager [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 05:17:39 user nova-compute[72444]: DEBUG nova.network.neutron [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 05:17:39 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 05:17:39 user nova-compute[72444]: DEBUG nova.compute.manager [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG nova.policy [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '39ca6b589ce84537984e0df64b6085f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8210385d97453ab4befb159a457772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDySbitl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23531623230653362', 'path': '/dev/sdc'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531623230653362', 'path': '/dev/sdc'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG nova.compute.manager [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 05:17:40 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Creating image(s)
Aug 03 05:17:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "/opt/stack/data/nova/instances/b20dc75b-a699-4d76-bfa7-a62d2f7ef731/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "/opt/stack/data/nova/instances/b20dc75b-a699-4d76-bfa7-a62d2f7ef731/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "/opt/stack/data/nova/instances/b20dc75b-a699-4d76-bfa7-a62d2f7ef731/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:17:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2013951057',display_name='tempest-TestVolumeBootPattern-server-2013951057',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2013951057',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJb/ucac2bYqYTTpUwHVlINSI4Sfb+N0MYWJk4BUfIgi24wGpfawX18lRHaBUwUNuvA9BvzcrJArj3JZ6r/WP+myl5DP/2VX4xcdyXqMaH1gGJv8NyGzE7tn1ggSM7aa7A==',key_name='tempest-TestVolumeBootPattern-1711073489',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae931112fcda4e2f8dfd4f540d905139',ramdisk_id='',reservation_id='r-ib50cllz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1788747136',owner_user_name='tempest-TestVolumeBootPattern-1788747136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:17:31Z,user_data=None,user_id='ef4d8130e33c4d9ea44c29be12f18234',uuid=2a778b55-8481-43cb-a628-b6c3c0690933,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9d18ac0-7b2c-4672-8b38-c792c15fb294", "address": "fa:16:3e:af:09:a0", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d18ac0-7b", "ovs_interfaceid": "d9d18ac0-7b2c-4672-8b38-c792c15fb294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Converting VIF {"id": "d9d18ac0-7b2c-4672-8b38-c792c15fb294", "address": "fa:16:3e:af:09:a0", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d18ac0-7b", "ovs_interfaceid": "d9d18ac0-7b2c-4672-8b38-c792c15fb294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:09:a0,bridge_name='br-int',has_traffic_filtering=True,id=d9d18ac0-7b2c-4672-8b38-c792c15fb294,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9d18ac0-7b') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG nova.objects.instance [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a778b55-8481-43cb-a628-b6c3c0690933 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] End _get_guest_xml xml=<domain type="kvm">
Aug 03 05:17:40 user nova-compute[72444]:   <uuid>2a778b55-8481-43cb-a628-b6c3c0690933</uuid>
Aug 03 05:17:40 user nova-compute[72444]:   <name>instance-0000002f</name>
Aug 03 05:17:40 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 05:17:40 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 05:17:40 user nova-compute[72444]:   <metadata>
Aug 03 05:17:40 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 05:17:40 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 05:17:40 user nova-compute[72444]:       <nova:name>tempest-TestVolumeBootPattern-server-2013951057</nova:name>
Aug 03 05:17:40 user nova-compute[72444]:       <nova:creationTime>2023-08-03 05:17:38</nova:creationTime>
Aug 03 05:17:40 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 05:17:40 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 05:17:40 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 05:17:40 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 05:17:40 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 05:17:40 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 05:17:40 user nova-compute[72444]:       </nova:flavor>
Aug 03 05:17:40 user nova-compute[72444]:       <nova:owner>
Aug 03 05:17:40 user nova-compute[72444]:         <nova:user uuid="ef4d8130e33c4d9ea44c29be12f18234">tempest-TestVolumeBootPattern-1788747136-project-member</nova:user>
Aug 03 05:17:40 user nova-compute[72444]:         <nova:project uuid="ae931112fcda4e2f8dfd4f540d905139">tempest-TestVolumeBootPattern-1788747136</nova:project>
Aug 03 05:17:40 user nova-compute[72444]:       </nova:owner>
Aug 03 05:17:40 user nova-compute[72444]:       <nova:ports>
Aug 03 05:17:40 user nova-compute[72444]:         <nova:port uuid="d9d18ac0-7b2c-4672-8b38-c792c15fb294">
Aug 03 05:17:40 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 03 05:17:40 user nova-compute[72444]:         </nova:port>
Aug 03 05:17:40 user nova-compute[72444]:       </nova:ports>
Aug 03 05:17:40 user nova-compute[72444]:     </nova:instance>
Aug 03 05:17:40 user nova-compute[72444]:   </metadata>
Aug 03 05:17:40 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 05:17:40 user nova-compute[72444]:     <system>
Aug 03 05:17:40 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 05:17:40 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 05:17:40 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 05:17:40 user nova-compute[72444]:       <entry name="serial">2a778b55-8481-43cb-a628-b6c3c0690933</entry>
Aug 03 05:17:40 user nova-compute[72444]:       <entry name="uuid">2a778b55-8481-43cb-a628-b6c3c0690933</entry>
Aug 03 05:17:40 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 05:17:40 user nova-compute[72444]:     </system>
Aug 03 05:17:40 user nova-compute[72444]:   </sysinfo>
Aug 03 05:17:40 user nova-compute[72444]:   <os>
Aug 03 05:17:40 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 05:17:40 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 05:17:40 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 05:17:40 user nova-compute[72444]:   </os>
Aug 03 05:17:40 user nova-compute[72444]:   <features>
Aug 03 05:17:40 user nova-compute[72444]:     <acpi/>
Aug 03 05:17:40 user nova-compute[72444]:     <apic/>
Aug 03 05:17:40 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 05:17:40 user nova-compute[72444]:   </features>
Aug 03 05:17:40 user nova-compute[72444]:   <clock offset="utc">
Aug 03 05:17:40 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 05:17:40 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 05:17:40 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 05:17:40 user nova-compute[72444]:   </clock>
Aug 03 05:17:40 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 05:17:40 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 05:17:40 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 05:17:40 user nova-compute[72444]:   </cpu>
Aug 03 05:17:40 user nova-compute[72444]:   <devices>
Aug 03 05:17:40 user nova-compute[72444]:     <disk type="block" device="disk">
Aug 03 05:17:40 user nova-compute[72444]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:17:40 user nova-compute[72444]:       <source dev="/dev/sdc"/>
Aug 03 05:17:40 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 05:17:40 user nova-compute[72444]:       <serial>6eeb498c-9c47-4bd7-96cf-95f826712fed</serial>
Aug 03 05:17:40 user nova-compute[72444]:     </disk>
Aug 03 05:17:40 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 05:17:40 user nova-compute[72444]:       <mac address="fa:16:3e:af:09:a0"/>
Aug 03 05:17:40 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:17:40 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 05:17:40 user nova-compute[72444]:       <target dev="tapd9d18ac0-7b"/>
Aug 03 05:17:40 user nova-compute[72444]:     </interface>
Aug 03 05:17:40 user nova-compute[72444]:     <serial type="pty">
Aug 03 05:17:40 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/2a778b55-8481-43cb-a628-b6c3c0690933/console.log" append="off"/>
Aug 03 05:17:40 user nova-compute[72444]:     </serial>
Aug 03 05:17:40 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 05:17:40 user nova-compute[72444]:     <video>
Aug 03 05:17:40 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:17:40 user nova-compute[72444]:     </video>
Aug 03 05:17:40 user nova-compute[72444]:     <rng model="virtio">
Aug 03 05:17:40 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 05:17:40 user nova-compute[72444]:     </rng>
Aug 03 05:17:40 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 05:17:40 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 05:17:40 user nova-compute[72444]:       <stats period="10"/>
Aug 03 05:17:40 user nova-compute[72444]:     </memballoon>
Aug 03 05:17:40 user nova-compute[72444]:   </devices>
Aug 03 05:17:40 user nova-compute[72444]: </domain>
Aug 03 05:17:40 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:17:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2013951057',display_name='tempest-TestVolumeBootPattern-server-2013951057',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2013951057',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJb/ucac2bYqYTTpUwHVlINSI4Sfb+N0MYWJk4BUfIgi24wGpfawX18lRHaBUwUNuvA9BvzcrJArj3JZ6r/WP+myl5DP/2VX4xcdyXqMaH1gGJv8NyGzE7tn1ggSM7aa7A==',key_name='tempest-TestVolumeBootPattern-1711073489',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae931112fcda4e2f8dfd4f540d905139',ramdisk_id='',reservation_id='r-ib50cllz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1788747136',owner_user_name='tempest-TestVolumeBootPattern-1788747136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:17:31Z,user_data=None,user_id='ef4d8130e33c4d9ea44c29be12f18234',uuid=2a778b55-8481-43cb-a628-b6c3c0690933,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9d18ac0-7b2c-4672-8b38-c792c15fb294", "address": "fa:16:3e:af:09:a0", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d18ac0-7b", "ovs_interfaceid": "d9d18ac0-7b2c-4672-8b38-c792c15fb294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Converting VIF {"id": "d9d18ac0-7b2c-4672-8b38-c792c15fb294", "address": "fa:16:3e:af:09:a0", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d18ac0-7b", "ovs_interfaceid": "d9d18ac0-7b2c-4672-8b38-c792c15fb294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:09:a0,bridge_name='br-int',has_traffic_filtering=True,id=d9d18ac0-7b2c-4672-8b38-c792c15fb294,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9d18ac0-7b') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG os_vif [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:09:a0,bridge_name='br-int',has_traffic_filtering=True,id=d9d18ac0-7b2c-4672-8b38-c792c15fb294,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9d18ac0-7b') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9d18ac0-7b, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd9d18ac0-7b, col_values=(('external_ids', {'iface-id': 'd9d18ac0-7b2c-4672-8b38-c792c15fb294', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:09:a0', 'vm-uuid': '2a778b55-8481-43cb-a628-b6c3c0690933'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:17:40 user nova-compute[72444]: INFO os_vif [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:09:a0,bridge_name='br-int',has_traffic_filtering=True,id=d9d18ac0-7b2c-4672-8b38-c792c15fb294,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9d18ac0-7b')
Aug 03 05:17:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.156s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] No VIF found with MAC fa:16:3e:af:09:a0, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.148s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/b20dc75b-a699-4d76-bfa7-a62d2f7ef731/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/b20dc75b-a699-4d76-bfa7-a62d2f7ef731/disk 1073741824" returned: 0 in 0.049s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.133s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b20dc75b-a699-4d76-bfa7-a62d2f7ef731/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b20dc75b-a699-4d76-bfa7-a62d2f7ef731/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG nova.network.neutron [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Successfully created port: 00304e44-34f5-459c-8d38-45947dedc2bd {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b20dc75b-a699-4d76-bfa7-a62d2f7ef731/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Cannot resize image /opt/stack/data/nova/instances/b20dc75b-a699-4d76-bfa7-a62d2f7ef731/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG nova.objects.instance [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lazy-loading 'migration_context' on Instance uuid b20dc75b-a699-4d76-bfa7-a62d2f7ef731 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Ensure instance console log exists: /opt/stack/data/nova/instances/b20dc75b-a699-4d76-bfa7-a62d2f7ef731/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:17:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:17:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:17:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:17:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:17:41 user nova-compute[72444]: DEBUG nova.network.neutron [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Successfully updated port: 00304e44-34f5-459c-8d38-45947dedc2bd {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 05:17:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "refresh_cache-b20dc75b-a699-4d76-bfa7-a62d2f7ef731" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:17:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquired lock "refresh_cache-b20dc75b-a699-4d76-bfa7-a62d2f7ef731" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:17:41 user nova-compute[72444]: DEBUG nova.network.neutron [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 05:17:41 user nova-compute[72444]: DEBUG nova.compute.manager [req-900dc924-e5f8-4f86-9732-d01434343322 req-530ece30-1d10-48c7-a540-1bc47528f292 service nova] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Received event network-changed-00304e44-34f5-459c-8d38-45947dedc2bd {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:17:41 user nova-compute[72444]: DEBUG nova.compute.manager [req-900dc924-e5f8-4f86-9732-d01434343322 req-530ece30-1d10-48c7-a540-1bc47528f292 service nova] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Refreshing instance network info cache due to event network-changed-00304e44-34f5-459c-8d38-45947dedc2bd. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:17:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-900dc924-e5f8-4f86-9732-d01434343322 req-530ece30-1d10-48c7-a540-1bc47528f292 service nova] Acquiring lock "refresh_cache-b20dc75b-a699-4d76-bfa7-a62d2f7ef731" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:17:41 user nova-compute[72444]: DEBUG nova.network.neutron [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 05:17:41 user nova-compute[72444]: DEBUG nova.compute.manager [req-b65990c7-a7aa-41f4-ab83-349b8a02a3de req-d4bd6ce3-34ed-465f-95d7-3f32a623176f service nova] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Received event network-vif-plugged-d9d18ac0-7b2c-4672-8b38-c792c15fb294 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:17:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b65990c7-a7aa-41f4-ab83-349b8a02a3de req-d4bd6ce3-34ed-465f-95d7-3f32a623176f service nova] Acquiring lock "2a778b55-8481-43cb-a628-b6c3c0690933-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:17:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b65990c7-a7aa-41f4-ab83-349b8a02a3de req-d4bd6ce3-34ed-465f-95d7-3f32a623176f service nova] Lock "2a778b55-8481-43cb-a628-b6c3c0690933-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:17:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-b65990c7-a7aa-41f4-ab83-349b8a02a3de req-d4bd6ce3-34ed-465f-95d7-3f32a623176f service nova] Lock "2a778b55-8481-43cb-a628-b6c3c0690933-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:17:41 user nova-compute[72444]: DEBUG nova.compute.manager [req-b65990c7-a7aa-41f4-ab83-349b8a02a3de req-d4bd6ce3-34ed-465f-95d7-3f32a623176f service nova] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] No waiting events found dispatching network-vif-plugged-d9d18ac0-7b2c-4672-8b38-c792c15fb294 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:17:41 user nova-compute[72444]: WARNING nova.compute.manager [req-b65990c7-a7aa-41f4-ab83-349b8a02a3de req-d4bd6ce3-34ed-465f-95d7-3f32a623176f service nova] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Received unexpected event network-vif-plugged-d9d18ac0-7b2c-4672-8b38-c792c15fb294 for instance with vm_state building and task_state spawning.
Aug 03 05:17:41 user nova-compute[72444]: DEBUG nova.network.neutron [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Updating instance_info_cache with network_info: [{"id": "00304e44-34f5-459c-8d38-45947dedc2bd", "address": "fa:16:3e:4b:38:7d", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00304e44-34", "ovs_interfaceid": "00304e44-34f5-459c-8d38-45947dedc2bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Releasing lock "refresh_cache-b20dc75b-a699-4d76-bfa7-a62d2f7ef731" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG nova.compute.manager [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Instance network_info: |[{"id": "00304e44-34f5-459c-8d38-45947dedc2bd", "address": "fa:16:3e:4b:38:7d", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00304e44-34", "ovs_interfaceid": "00304e44-34f5-459c-8d38-45947dedc2bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-900dc924-e5f8-4f86-9732-d01434343322 req-530ece30-1d10-48c7-a540-1bc47528f292 service nova] Acquired lock "refresh_cache-b20dc75b-a699-4d76-bfa7-a62d2f7ef731" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG nova.network.neutron [req-900dc924-e5f8-4f86-9732-d01434343322 req-530ece30-1d10-48c7-a540-1bc47528f292 service nova] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Refreshing network info cache for port 00304e44-34f5-459c-8d38-45947dedc2bd {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Start _get_guest_xml network_info=[{"id": "00304e44-34f5-459c-8d38-45947dedc2bd", "address": "fa:16:3e:4b:38:7d", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00304e44-34", "ovs_interfaceid": "00304e44-34f5-459c-8d38-45947dedc2bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 05:17:42 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:17:42 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:17:42 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-631927254',display_name='tempest-AttachVolumeNegativeTest-server-631927254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-631927254',id=48,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUkO6/u5Huz1QIJUyyO5hP3ByAL35F9SxTMt+z8VTgqrY5/0bO0jKcLI+UnWjb11BUR/94KHkqYzUIhkPzVijiuEmUnOvYU0GFAsXlrlWIqpGrkLo8UTjaPLUIa/XX+0w==',key_name='tempest-keypair-1743240977',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d8210385d97453ab4befb159a457772',ramdisk_id='',reservation_id='r-lnrb2i0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1998464271',owner_user_name='tempest-AttachVolumeNegativeTest-1998464271-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:17:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39ca6b589ce84537984e0df64b6085f3',uuid=b20dc75b-a699-4d76-bfa7-a62d2f7ef731,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00304e44-34f5-459c-8d38-45947dedc2bd", "address": "fa:16:3e:4b:38:7d", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00304e44-34", "ovs_interfaceid": "00304e44-34f5-459c-8d38-45947dedc2bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Converting VIF {"id": "00304e44-34f5-459c-8d38-45947dedc2bd", "address": "fa:16:3e:4b:38:7d", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00304e44-34", "ovs_interfaceid": "00304e44-34f5-459c-8d38-45947dedc2bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:38:7d,bridge_name='br-int',has_traffic_filtering=True,id=00304e44-34f5-459c-8d38-45947dedc2bd,network=Network(9605cf27-7ef3-4664-97b1-a6e1d093ce98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00304e44-34') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG nova.objects.instance [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lazy-loading 'pci_devices' on Instance uuid b20dc75b-a699-4d76-bfa7-a62d2f7ef731 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] End _get_guest_xml xml=<domain type="kvm">
Aug 03 05:17:42 user nova-compute[72444]:   <uuid>b20dc75b-a699-4d76-bfa7-a62d2f7ef731</uuid>
Aug 03 05:17:42 user nova-compute[72444]:   <name>instance-00000030</name>
Aug 03 05:17:42 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 05:17:42 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 05:17:42 user nova-compute[72444]:   <metadata>
Aug 03 05:17:42 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 05:17:42 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 05:17:42 user nova-compute[72444]:       <nova:name>tempest-AttachVolumeNegativeTest-server-631927254</nova:name>
Aug 03 05:17:42 user nova-compute[72444]:       <nova:creationTime>2023-08-03 05:17:42</nova:creationTime>
Aug 03 05:17:42 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 05:17:42 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 05:17:42 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 05:17:42 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 05:17:42 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 05:17:42 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 05:17:42 user nova-compute[72444]:       </nova:flavor>
Aug 03 05:17:42 user nova-compute[72444]:       <nova:owner>
Aug 03 05:17:42 user nova-compute[72444]:         <nova:user uuid="39ca6b589ce84537984e0df64b6085f3">tempest-AttachVolumeNegativeTest-1998464271-project-member</nova:user>
Aug 03 05:17:42 user nova-compute[72444]:         <nova:project uuid="9d8210385d97453ab4befb159a457772">tempest-AttachVolumeNegativeTest-1998464271</nova:project>
Aug 03 05:17:42 user nova-compute[72444]:       </nova:owner>
Aug 03 05:17:42 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 05:17:42 user nova-compute[72444]:       <nova:ports>
Aug 03 05:17:42 user nova-compute[72444]:         <nova:port uuid="00304e44-34f5-459c-8d38-45947dedc2bd">
Aug 03 05:17:42 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 03 05:17:42 user nova-compute[72444]:         </nova:port>
Aug 03 05:17:42 user nova-compute[72444]:       </nova:ports>
Aug 03 05:17:42 user nova-compute[72444]:     </nova:instance>
Aug 03 05:17:42 user nova-compute[72444]:   </metadata>
Aug 03 05:17:42 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 05:17:42 user nova-compute[72444]:     <system>
Aug 03 05:17:42 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 05:17:42 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 05:17:42 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 05:17:42 user nova-compute[72444]:       <entry name="serial">b20dc75b-a699-4d76-bfa7-a62d2f7ef731</entry>
Aug 03 05:17:42 user nova-compute[72444]:       <entry name="uuid">b20dc75b-a699-4d76-bfa7-a62d2f7ef731</entry>
Aug 03 05:17:42 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 05:17:42 user nova-compute[72444]:     </system>
Aug 03 05:17:42 user nova-compute[72444]:   </sysinfo>
Aug 03 05:17:42 user nova-compute[72444]:   <os>
Aug 03 05:17:42 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 05:17:42 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 05:17:42 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 05:17:42 user nova-compute[72444]:   </os>
Aug 03 05:17:42 user nova-compute[72444]:   <features>
Aug 03 05:17:42 user nova-compute[72444]:     <acpi/>
Aug 03 05:17:42 user nova-compute[72444]:     <apic/>
Aug 03 05:17:42 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 05:17:42 user nova-compute[72444]:   </features>
Aug 03 05:17:42 user nova-compute[72444]:   <clock offset="utc">
Aug 03 05:17:42 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 05:17:42 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 05:17:42 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 05:17:42 user nova-compute[72444]:   </clock>
Aug 03 05:17:42 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 05:17:42 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 05:17:42 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 05:17:42 user nova-compute[72444]:   </cpu>
Aug 03 05:17:42 user nova-compute[72444]:   <devices>
Aug 03 05:17:42 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 05:17:42 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 05:17:42 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/b20dc75b-a699-4d76-bfa7-a62d2f7ef731/disk"/>
Aug 03 05:17:42 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 05:17:42 user nova-compute[72444]:     </disk>
Aug 03 05:17:42 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 05:17:42 user nova-compute[72444]:       <mac address="fa:16:3e:4b:38:7d"/>
Aug 03 05:17:42 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:17:42 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 05:17:42 user nova-compute[72444]:       <target dev="tap00304e44-34"/>
Aug 03 05:17:42 user nova-compute[72444]:     </interface>
Aug 03 05:17:42 user nova-compute[72444]:     <serial type="pty">
Aug 03 05:17:42 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/b20dc75b-a699-4d76-bfa7-a62d2f7ef731/console.log" append="off"/>
Aug 03 05:17:42 user nova-compute[72444]:     </serial>
Aug 03 05:17:42 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 05:17:42 user nova-compute[72444]:     <video>
Aug 03 05:17:42 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:17:42 user nova-compute[72444]:     </video>
Aug 03 05:17:42 user nova-compute[72444]:     <rng model="virtio">
Aug 03 05:17:42 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 05:17:42 user nova-compute[72444]:     </rng>
Aug 03 05:17:42 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 05:17:42 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 05:17:42 user nova-compute[72444]:       <stats period="10"/>
Aug 03 05:17:42 user nova-compute[72444]:     </memballoon>
Aug 03 05:17:42 user nova-compute[72444]:   </devices>
Aug 03 05:17:42 user nova-compute[72444]: </domain>
Aug 03 05:17:42 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-631927254',display_name='tempest-AttachVolumeNegativeTest-server-631927254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-631927254',id=48,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUkO6/u5Huz1QIJUyyO5hP3ByAL35F9SxTMt+z8VTgqrY5/0bO0jKcLI+UnWjb11BUR/94KHkqYzUIhkPzVijiuEmUnOvYU0GFAsXlrlWIqpGrkLo8UTjaPLUIa/XX+0w==',key_name='tempest-keypair-1743240977',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d8210385d97453ab4befb159a457772',ramdisk_id='',reservation_id='r-lnrb2i0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1998464271',owner_user_name='tempest-AttachVolumeNegativeTest-1998464271-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:17:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39ca6b589ce84537984e0df64b6085f3',uuid=b20dc75b-a699-4d76-bfa7-a62d2f7ef731,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00304e44-34f5-459c-8d38-45947dedc2bd", "address": "fa:16:3e:4b:38:7d", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00304e44-34", "ovs_interfaceid": "00304e44-34f5-459c-8d38-45947dedc2bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Converting VIF {"id": "00304e44-34f5-459c-8d38-45947dedc2bd", "address": "fa:16:3e:4b:38:7d", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00304e44-34", "ovs_interfaceid": "00304e44-34f5-459c-8d38-45947dedc2bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:38:7d,bridge_name='br-int',has_traffic_filtering=True,id=00304e44-34f5-459c-8d38-45947dedc2bd,network=Network(9605cf27-7ef3-4664-97b1-a6e1d093ce98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00304e44-34') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG os_vif [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:38:7d,bridge_name='br-int',has_traffic_filtering=True,id=00304e44-34f5-459c-8d38-45947dedc2bd,network=Network(9605cf27-7ef3-4664-97b1-a6e1d093ce98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00304e44-34') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00304e44-34, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap00304e44-34, col_values=(('external_ids', {'iface-id': '00304e44-34f5-459c-8d38-45947dedc2bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:38:7d', 'vm-uuid': 'b20dc75b-a699-4d76-bfa7-a62d2f7ef731'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:17:42 user nova-compute[72444]: INFO os_vif [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:38:7d,bridge_name='br-int',has_traffic_filtering=True,id=00304e44-34f5-459c-8d38-45947dedc2bd,network=Network(9605cf27-7ef3-4664-97b1-a6e1d093ce98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00304e44-34')
Aug 03 05:17:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] No VIF found with MAC fa:16:3e:4b:38:7d, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG nova.network.neutron [req-900dc924-e5f8-4f86-9732-d01434343322 req-530ece30-1d10-48c7-a540-1bc47528f292 service nova] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Updated VIF entry in instance network info cache for port 00304e44-34f5-459c-8d38-45947dedc2bd. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG nova.network.neutron [req-900dc924-e5f8-4f86-9732-d01434343322 req-530ece30-1d10-48c7-a540-1bc47528f292 service nova] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Updating instance_info_cache with network_info: [{"id": "00304e44-34f5-459c-8d38-45947dedc2bd", "address": "fa:16:3e:4b:38:7d", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00304e44-34", "ovs_interfaceid": "00304e44-34f5-459c-8d38-45947dedc2bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:17:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-900dc924-e5f8-4f86-9732-d01434343322 req-530ece30-1d10-48c7-a540-1bc47528f292 service nova] Releasing lock "refresh_cache-b20dc75b-a699-4d76-bfa7-a62d2f7ef731" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:17:43 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:17:43 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:17:43 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:17:43 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:17:43 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:17:43 user nova-compute[72444]: DEBUG nova.compute.manager [req-e5b0fbb1-8b57-4712-a1ad-607ab6d90718 req-f22fbf65-fb0d-4e28-9b7f-df72f6eae901 service nova] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Received event network-vif-plugged-00304e44-34f5-459c-8d38-45947dedc2bd {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:17:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e5b0fbb1-8b57-4712-a1ad-607ab6d90718 req-f22fbf65-fb0d-4e28-9b7f-df72f6eae901 service nova] Acquiring lock "b20dc75b-a699-4d76-bfa7-a62d2f7ef731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:17:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e5b0fbb1-8b57-4712-a1ad-607ab6d90718 req-f22fbf65-fb0d-4e28-9b7f-df72f6eae901 service nova] Lock "b20dc75b-a699-4d76-bfa7-a62d2f7ef731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:17:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e5b0fbb1-8b57-4712-a1ad-607ab6d90718 req-f22fbf65-fb0d-4e28-9b7f-df72f6eae901 service nova] Lock "b20dc75b-a699-4d76-bfa7-a62d2f7ef731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:17:43 user nova-compute[72444]: DEBUG nova.compute.manager [req-e5b0fbb1-8b57-4712-a1ad-607ab6d90718 req-f22fbf65-fb0d-4e28-9b7f-df72f6eae901 service nova] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] No waiting events found dispatching network-vif-plugged-00304e44-34f5-459c-8d38-45947dedc2bd {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:17:43 user nova-compute[72444]: WARNING nova.compute.manager [req-e5b0fbb1-8b57-4712-a1ad-607ab6d90718 req-f22fbf65-fb0d-4e28-9b7f-df72f6eae901 service nova] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Received unexpected event network-vif-plugged-00304e44-34f5-459c-8d38-45947dedc2bd for instance with vm_state building and task_state spawning.
Aug 03 05:17:43 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691039863.750588, 2a778b55-8481-43cb-a628-b6c3c0690933 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:17:43 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] VM Resumed (Lifecycle Event)
Aug 03 05:17:43 user nova-compute[72444]: DEBUG nova.compute.manager [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 05:17:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 05:17:43 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Instance spawned successfully.
Aug 03 05:17:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 05:17:43 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:17:43 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:17:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:17:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:17:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:17:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:17:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:17:43 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:17:43 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 05:17:43 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691039863.7544663, 2a778b55-8481-43cb-a628-b6c3c0690933 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:17:43 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] VM Started (Lifecycle Event)
Aug 03 05:17:43 user nova-compute[72444]: DEBUG nova.compute.manager [req-abdb6423-bb3b-4386-83cb-bf0820947fd1 req-64783af1-eb51-41b6-854f-ee47e6661826 service nova] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Received event network-vif-plugged-d9d18ac0-7b2c-4672-8b38-c792c15fb294 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:17:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-abdb6423-bb3b-4386-83cb-bf0820947fd1 req-64783af1-eb51-41b6-854f-ee47e6661826 service nova] Acquiring lock "2a778b55-8481-43cb-a628-b6c3c0690933-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:17:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-abdb6423-bb3b-4386-83cb-bf0820947fd1 req-64783af1-eb51-41b6-854f-ee47e6661826 service nova] Lock "2a778b55-8481-43cb-a628-b6c3c0690933-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:17:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-abdb6423-bb3b-4386-83cb-bf0820947fd1 req-64783af1-eb51-41b6-854f-ee47e6661826 service nova] Lock "2a778b55-8481-43cb-a628-b6c3c0690933-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:17:43 user nova-compute[72444]: DEBUG nova.compute.manager [req-abdb6423-bb3b-4386-83cb-bf0820947fd1 req-64783af1-eb51-41b6-854f-ee47e6661826 service nova] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] No waiting events found dispatching network-vif-plugged-d9d18ac0-7b2c-4672-8b38-c792c15fb294 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:17:43 user nova-compute[72444]: WARNING nova.compute.manager [req-abdb6423-bb3b-4386-83cb-bf0820947fd1 req-64783af1-eb51-41b6-854f-ee47e6661826 service nova] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Received unexpected event network-vif-plugged-d9d18ac0-7b2c-4672-8b38-c792c15fb294 for instance with vm_state building and task_state spawning.
Aug 03 05:17:43 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:17:43 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:17:43 user nova-compute[72444]: INFO nova.compute.manager [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Took 5.19 seconds to spawn the instance on the hypervisor.
Aug 03 05:17:43 user nova-compute[72444]: DEBUG nova.compute.manager [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:17:43 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 05:17:43 user nova-compute[72444]: INFO nova.compute.manager [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Took 13.88 seconds to build instance.
Aug 03 05:17:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f17aa52a-680a-4254-bb6f-559ca5e4c342 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "2a778b55-8481-43cb-a628-b6c3c0690933" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.974s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:17:45 user nova-compute[72444]: DEBUG nova.compute.manager [req-4c371d37-6038-4433-8b00-e57e9b8688a1 req-ed10f43a-4be2-4b42-87ae-f0928cf531c4 service nova] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Received event network-vif-plugged-00304e44-34f5-459c-8d38-45947dedc2bd {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:17:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4c371d37-6038-4433-8b00-e57e9b8688a1 req-ed10f43a-4be2-4b42-87ae-f0928cf531c4 service nova] Acquiring lock "b20dc75b-a699-4d76-bfa7-a62d2f7ef731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:17:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4c371d37-6038-4433-8b00-e57e9b8688a1 req-ed10f43a-4be2-4b42-87ae-f0928cf531c4 service nova] Lock "b20dc75b-a699-4d76-bfa7-a62d2f7ef731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:17:45 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4c371d37-6038-4433-8b00-e57e9b8688a1 req-ed10f43a-4be2-4b42-87ae-f0928cf531c4 service nova] Lock "b20dc75b-a699-4d76-bfa7-a62d2f7ef731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:17:45 user nova-compute[72444]: DEBUG nova.compute.manager [req-4c371d37-6038-4433-8b00-e57e9b8688a1 req-ed10f43a-4be2-4b42-87ae-f0928cf531c4 service nova] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] No waiting events found dispatching network-vif-plugged-00304e44-34f5-459c-8d38-45947dedc2bd {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:17:45 user nova-compute[72444]: WARNING nova.compute.manager [req-4c371d37-6038-4433-8b00-e57e9b8688a1 req-ed10f43a-4be2-4b42-87ae-f0928cf531c4 service nova] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Received unexpected event network-vif-plugged-00304e44-34f5-459c-8d38-45947dedc2bd for instance with vm_state building and task_state spawning.
Aug 03 05:17:45 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691039865.77625, b20dc75b-a699-4d76-bfa7-a62d2f7ef731 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:17:45 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] VM Resumed (Lifecycle Event)
Aug 03 05:17:45 user nova-compute[72444]: DEBUG nova.compute.manager [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 05:17:45 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 05:17:45 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:17:45 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Instance spawned successfully.
Aug 03 05:17:45 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 05:17:45 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:17:45 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:17:45 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:17:45 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:17:45 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:17:45 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:17:45 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:17:45 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 05:17:45 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691039865.7774558, b20dc75b-a699-4d76-bfa7-a62d2f7ef731 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:17:45 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] VM Started (Lifecycle Event)
Aug 03 05:17:45 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:17:45 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:17:45 user nova-compute[72444]: INFO nova.compute.manager [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Took 5.83 seconds to spawn the instance on the hypervisor.
Aug 03 05:17:45 user nova-compute[72444]: DEBUG nova.compute.manager [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:17:45 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 05:17:45 user nova-compute[72444]: INFO nova.compute.manager [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Took 6.50 seconds to build instance.
Aug 03 05:17:46 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:17:46 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f006a42a-cca7-4fcc-9ba5-11f4191518e6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "b20dc75b-a699-4d76-bfa7-a62d2f7ef731" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.586s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:17:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:17:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:17:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:17:57 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:17:57 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:17:57 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:17:57 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:17:57 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:17:57 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:18:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:18:02 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:18:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:18:07 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:18:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:18:12 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:18:12 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:18:13 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:18:15 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:18:15 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:18:15 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Rebuilding the list of instances to heal {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 05:18:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-06bccfea-4a42-4880-8712-e9a7c0cd2a13" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:18:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-06bccfea-4a42-4880-8712-e9a7c0cd2a13" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:18:15 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 05:18:15 user nova-compute[72444]: DEBUG nova.objects.instance [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lazy-loading 'info_cache' on Instance uuid 06bccfea-4a42-4880-8712-e9a7c0cd2a13 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:18:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:18:16 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Updating instance_info_cache with network_info: [{"id": "51cc40fe-4c00-4266-94f7-6eb722f9253e", "address": "fa:16:3e:8b:f2:c5", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cc40fe-4c", "ovs_interfaceid": "51cc40fe-4c00-4266-94f7-6eb722f9253e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:18:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-06bccfea-4a42-4880-8712-e9a7c0cd2a13" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:18:16 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 05:18:16 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:18:17 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:18:18 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:18:18 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:18:18 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 05:18:20 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:18:20 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:18:20 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:18:20 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:18:20 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:18:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:18:21 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 05:18:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b20dc75b-a699-4d76-bfa7-a62d2f7ef731/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:18:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b20dc75b-a699-4d76-bfa7-a62d2f7ef731/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:18:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b20dc75b-a699-4d76-bfa7-a62d2f7ef731/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:18:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b20dc75b-a699-4d76-bfa7-a62d2f7ef731/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:18:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06bccfea-4a42-4880-8712-e9a7c0cd2a13/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:18:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06bccfea-4a42-4880-8712-e9a7c0cd2a13/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:18:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06bccfea-4a42-4880-8712-e9a7c0cd2a13/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:18:21 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06bccfea-4a42-4880-8712-e9a7c0cd2a13/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:18:21 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 05:18:22 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:18:22 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:18:22 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=8507MB free_disk=25.32278060913086GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:18:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:18:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:18:22 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 06bccfea-4a42-4880-8712-e9a7c0cd2a13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:18:22 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 2a778b55-8481-43cb-a628-b6c3c0690933 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:18:22 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance b20dc75b-a699-4d76-bfa7-a62d2f7ef731 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:18:22 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:18:22 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:18:22 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:18:22 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:18:22 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:18:22 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:18:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.259s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:18:23 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:18:23 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:18:23 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Triggering sync for uuid 06bccfea-4a42-4880-8712-e9a7c0cd2a13 {{(pid=72444) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 03 05:18:23 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Triggering sync for uuid 2a778b55-8481-43cb-a628-b6c3c0690933 {{(pid=72444) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 03 05:18:23 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Triggering sync for uuid b20dc75b-a699-4d76-bfa7-a62d2f7ef731 {{(pid=72444) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 03 05:18:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "06bccfea-4a42-4880-8712-e9a7c0cd2a13" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:18:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "06bccfea-4a42-4880-8712-e9a7c0cd2a13" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:18:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "2a778b55-8481-43cb-a628-b6c3c0690933" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:18:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "2a778b55-8481-43cb-a628-b6c3c0690933" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:18:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "b20dc75b-a699-4d76-bfa7-a62d2f7ef731" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:18:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "b20dc75b-a699-4d76-bfa7-a62d2f7ef731" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:18:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "06bccfea-4a42-4880-8712-e9a7c0cd2a13" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:18:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "2a778b55-8481-43cb-a628-b6c3c0690933" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:18:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "b20dc75b-a699-4d76-bfa7-a62d2f7ef731" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:18:24 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:18:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:18:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:18:32 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:18:32 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:18:32 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:18:32 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:18:32 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:18:32 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:18:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:18:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:18:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:18:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:18:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:18:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:18:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:18:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:18:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:18:57 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:19:02 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:19:07 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:19:07 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:19:07 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:19:07 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:19:07 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:19:07 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:19:12 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:19:12 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:19:14 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:19:15 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:19:17 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:19:17 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:19:17 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:19:17 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:19:17 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:19:17 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:19:17 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:19:17 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:19:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-2a778b55-8481-43cb-a628-b6c3c0690933" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:19:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-2a778b55-8481-43cb-a628-b6c3c0690933" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:19:18 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 05:19:18 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Updating instance_info_cache with network_info: [{"id": "d9d18ac0-7b2c-4672-8b38-c792c15fb294", "address": "fa:16:3e:af:09:a0", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d18ac0-7b", "ovs_interfaceid": "d9d18ac0-7b2c-4672-8b38-c792c15fb294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:19:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-2a778b55-8481-43cb-a628-b6c3c0690933" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:19:18 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 05:19:19 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:19:19 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 05:19:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:19:20 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:19:21 user nova-compute[72444]: DEBUG nova.compute.manager [req-81420298-8ffb-407f-94b6-f7c474764293 req-541867c0-6c7e-4c12-b061-50383d8378c5 service nova] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Received event network-changed-d9d18ac0-7b2c-4672-8b38-c792c15fb294 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:19:21 user nova-compute[72444]: DEBUG nova.compute.manager [req-81420298-8ffb-407f-94b6-f7c474764293 req-541867c0-6c7e-4c12-b061-50383d8378c5 service nova] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Refreshing instance network info cache due to event network-changed-d9d18ac0-7b2c-4672-8b38-c792c15fb294. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:19:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-81420298-8ffb-407f-94b6-f7c474764293 req-541867c0-6c7e-4c12-b061-50383d8378c5 service nova] Acquiring lock "refresh_cache-2a778b55-8481-43cb-a628-b6c3c0690933" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:19:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-81420298-8ffb-407f-94b6-f7c474764293 req-541867c0-6c7e-4c12-b061-50383d8378c5 service nova] Acquired lock "refresh_cache-2a778b55-8481-43cb-a628-b6c3c0690933" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:19:21 user nova-compute[72444]: DEBUG nova.network.neutron [req-81420298-8ffb-407f-94b6-f7c474764293 req-541867c0-6c7e-4c12-b061-50383d8378c5 service nova] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Refreshing network info cache for port d9d18ac0-7b2c-4672-8b38-c792c15fb294 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:19:21 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:19:21 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:19:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:19:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:19:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:19:21 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:19:22 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 05:19:22 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b20dc75b-a699-4d76-bfa7-a62d2f7ef731/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:19:22 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:19:22 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b20dc75b-a699-4d76-bfa7-a62d2f7ef731/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:19:22 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b20dc75b-a699-4d76-bfa7-a62d2f7ef731/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:19:22 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b20dc75b-a699-4d76-bfa7-a62d2f7ef731/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:19:22 user nova-compute[72444]: DEBUG nova.network.neutron [req-81420298-8ffb-407f-94b6-f7c474764293 req-541867c0-6c7e-4c12-b061-50383d8378c5 service nova] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Updated VIF entry in instance network info cache for port d9d18ac0-7b2c-4672-8b38-c792c15fb294. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:19:22 user nova-compute[72444]: DEBUG nova.network.neutron [req-81420298-8ffb-407f-94b6-f7c474764293 req-541867c0-6c7e-4c12-b061-50383d8378c5 service nova] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Updating instance_info_cache with network_info: [{"id": "d9d18ac0-7b2c-4672-8b38-c792c15fb294", "address": "fa:16:3e:af:09:a0", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d18ac0-7b", "ovs_interfaceid": "d9d18ac0-7b2c-4672-8b38-c792c15fb294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:19:22 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06bccfea-4a42-4880-8712-e9a7c0cd2a13/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:19:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-81420298-8ffb-407f-94b6-f7c474764293 req-541867c0-6c7e-4c12-b061-50383d8378c5 service nova] Releasing lock "refresh_cache-2a778b55-8481-43cb-a628-b6c3c0690933" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:19:22 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06bccfea-4a42-4880-8712-e9a7c0cd2a13/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:19:22 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06bccfea-4a42-4880-8712-e9a7c0cd2a13/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:19:22 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06bccfea-4a42-4880-8712-e9a7c0cd2a13/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:19:22 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 05:19:23 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:19:23 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:19:23 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=8576MB free_disk=25.322052001953125GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:19:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:19:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:19:23 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 06bccfea-4a42-4880-8712-e9a7c0cd2a13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:19:23 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 2a778b55-8481-43cb-a628-b6c3c0690933 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:19:23 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance b20dc75b-a699-4d76-bfa7-a62d2f7ef731 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:19:23 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:19:23 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:19:23 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:19:23 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:19:23 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:19:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.217s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:19:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:19:26 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:19:26 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:19:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:19:30 user nova-compute[72444]: DEBUG nova.compute.manager [req-8ce040ad-0d28-4059-b264-0c6684bb3d18 req-ceff67d0-5271-4feb-bb19-2106b668767c service nova] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Received event network-changed-00304e44-34f5-459c-8d38-45947dedc2bd {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:19:30 user nova-compute[72444]: DEBUG nova.compute.manager [req-8ce040ad-0d28-4059-b264-0c6684bb3d18 req-ceff67d0-5271-4feb-bb19-2106b668767c service nova] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Refreshing instance network info cache due to event network-changed-00304e44-34f5-459c-8d38-45947dedc2bd. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:19:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8ce040ad-0d28-4059-b264-0c6684bb3d18 req-ceff67d0-5271-4feb-bb19-2106b668767c service nova] Acquiring lock "refresh_cache-b20dc75b-a699-4d76-bfa7-a62d2f7ef731" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:19:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8ce040ad-0d28-4059-b264-0c6684bb3d18 req-ceff67d0-5271-4feb-bb19-2106b668767c service nova] Acquired lock "refresh_cache-b20dc75b-a699-4d76-bfa7-a62d2f7ef731" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:19:30 user nova-compute[72444]: DEBUG nova.network.neutron [req-8ce040ad-0d28-4059-b264-0c6684bb3d18 req-ceff67d0-5271-4feb-bb19-2106b668767c service nova] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Refreshing network info cache for port 00304e44-34f5-459c-8d38-45947dedc2bd {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d8ded3d2-8fa6-4561-b29d-175ab819fba4 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "b20dc75b-a699-4d76-bfa7-a62d2f7ef731" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d8ded3d2-8fa6-4561-b29d-175ab819fba4 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "b20dc75b-a699-4d76-bfa7-a62d2f7ef731" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d8ded3d2-8fa6-4561-b29d-175ab819fba4 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "b20dc75b-a699-4d76-bfa7-a62d2f7ef731-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d8ded3d2-8fa6-4561-b29d-175ab819fba4 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "b20dc75b-a699-4d76-bfa7-a62d2f7ef731-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d8ded3d2-8fa6-4561-b29d-175ab819fba4 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "b20dc75b-a699-4d76-bfa7-a62d2f7ef731-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:19:31 user nova-compute[72444]: INFO nova.compute.manager [None req-d8ded3d2-8fa6-4561-b29d-175ab819fba4 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Terminating instance
Aug 03 05:19:31 user nova-compute[72444]: DEBUG nova.compute.manager [None req-d8ded3d2-8fa6-4561-b29d-175ab819fba4 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "fca2180e-32c1-4280-b8a4-6bafb2112d02" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "fca2180e-32c1-4280-b8a4-6bafb2112d02" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG nova.compute.manager [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 05:19:31 user nova-compute[72444]: INFO nova.compute.claims [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Claim successful on node user
Aug 03 05:19:31 user nova-compute[72444]: DEBUG nova.network.neutron [req-8ce040ad-0d28-4059-b264-0c6684bb3d18 req-ceff67d0-5271-4feb-bb19-2106b668767c service nova] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Updated VIF entry in instance network info cache for port 00304e44-34f5-459c-8d38-45947dedc2bd. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG nova.network.neutron [req-8ce040ad-0d28-4059-b264-0c6684bb3d18 req-ceff67d0-5271-4feb-bb19-2106b668767c service nova] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Updating instance_info_cache with network_info: [{"id": "00304e44-34f5-459c-8d38-45947dedc2bd", "address": "fa:16:3e:4b:38:7d", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00304e44-34", "ovs_interfaceid": "00304e44-34f5-459c-8d38-45947dedc2bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8ce040ad-0d28-4059-b264-0c6684bb3d18 req-ceff67d0-5271-4feb-bb19-2106b668767c service nova] Releasing lock "refresh_cache-b20dc75b-a699-4d76-bfa7-a62d2f7ef731" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG nova.compute.manager [req-80051c99-cd59-40c3-bbd4-96eaa00c32e2 req-331a5949-e2da-44a1-98b7-9198a8e8dde8 service nova] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Received event network-vif-unplugged-00304e44-34f5-459c-8d38-45947dedc2bd {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-80051c99-cd59-40c3-bbd4-96eaa00c32e2 req-331a5949-e2da-44a1-98b7-9198a8e8dde8 service nova] Acquiring lock "b20dc75b-a699-4d76-bfa7-a62d2f7ef731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-80051c99-cd59-40c3-bbd4-96eaa00c32e2 req-331a5949-e2da-44a1-98b7-9198a8e8dde8 service nova] Lock "b20dc75b-a699-4d76-bfa7-a62d2f7ef731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-80051c99-cd59-40c3-bbd4-96eaa00c32e2 req-331a5949-e2da-44a1-98b7-9198a8e8dde8 service nova] Lock "b20dc75b-a699-4d76-bfa7-a62d2f7ef731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG nova.compute.manager [req-80051c99-cd59-40c3-bbd4-96eaa00c32e2 req-331a5949-e2da-44a1-98b7-9198a8e8dde8 service nova] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] No waiting events found dispatching network-vif-unplugged-00304e44-34f5-459c-8d38-45947dedc2bd {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG nova.compute.manager [req-80051c99-cd59-40c3-bbd4-96eaa00c32e2 req-331a5949-e2da-44a1-98b7-9198a8e8dde8 service nova] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Received event network-vif-unplugged-00304e44-34f5-459c-8d38-45947dedc2bd for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.290s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG nova.compute.manager [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG nova.compute.manager [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG nova.network.neutron [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 05:19:31 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 05:19:31 user nova-compute[72444]: DEBUG nova.compute.manager [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 05:19:31 user nova-compute[72444]: INFO nova.virt.block_device [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Booting with volume e1b7bc13-5c08-40f3-abd7-3567b07a875c at /dev/vda
Aug 03 05:19:31 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Instance destroyed successfully.
Aug 03 05:19:31 user nova-compute[72444]: DEBUG nova.objects.instance [None req-d8ded3d2-8fa6-4561-b29d-175ab819fba4 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lazy-loading 'resources' on Instance uuid b20dc75b-a699-4d76-bfa7-a62d2f7ef731 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG nova.policy [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ef4d8130e33c4d9ea44c29be12f18234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae931112fcda4e2f8dfd4f540d905139', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-d8ded3d2-8fa6-4561-b29d-175ab819fba4 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-631927254',display_name='tempest-AttachVolumeNegativeTest-server-631927254',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-631927254',id=48,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUkO6/u5Huz1QIJUyyO5hP3ByAL35F9SxTMt+z8VTgqrY5/0bO0jKcLI+UnWjb11BUR/94KHkqYzUIhkPzVijiuEmUnOvYU0GFAsXlrlWIqpGrkLo8UTjaPLUIa/XX+0w==',key_name='tempest-keypair-1743240977',keypairs=<?>,launch_index=0,launched_at=2023-08-03T05:17:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d8210385d97453ab4befb159a457772',ramdisk_id='',reservation_id='r-lnrb2i0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1998464271',owner_user_name='tempest-AttachVolumeNegativeTest-1998464271-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T05:17:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39ca6b589ce84537984e0df64b6085f3',uuid=b20dc75b-a699-4d76-bfa7-a62d2f7ef731,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00304e44-34f5-459c-8d38-45947dedc2bd", "address": "fa:16:3e:4b:38:7d", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00304e44-34", "ovs_interfaceid": "00304e44-34f5-459c-8d38-45947dedc2bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-d8ded3d2-8fa6-4561-b29d-175ab819fba4 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Converting VIF {"id": "00304e44-34f5-459c-8d38-45947dedc2bd", "address": "fa:16:3e:4b:38:7d", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00304e44-34", "ovs_interfaceid": "00304e44-34f5-459c-8d38-45947dedc2bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-d8ded3d2-8fa6-4561-b29d-175ab819fba4 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:38:7d,bridge_name='br-int',has_traffic_filtering=True,id=00304e44-34f5-459c-8d38-45947dedc2bd,network=Network(9605cf27-7ef3-4664-97b1-a6e1d093ce98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00304e44-34') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG os_vif [None req-d8ded3d2-8fa6-4561-b29d-175ab819fba4 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:38:7d,bridge_name='br-int',has_traffic_filtering=True,id=00304e44-34f5-459c-8d38-45947dedc2bd,network=Network(9605cf27-7ef3-4664-97b1-a6e1d093ce98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00304e44-34') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00304e44-34, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:19:31 user nova-compute[72444]: INFO os_vif [None req-d8ded3d2-8fa6-4561-b29d-175ab819fba4 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:38:7d,bridge_name='br-int',has_traffic_filtering=True,id=00304e44-34f5-459c-8d38-45947dedc2bd,network=Network(9605cf27-7ef3-4664-97b1-a6e1d093ce98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00304e44-34')
Aug 03 05:19:31 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-d8ded3d2-8fa6-4561-b29d-175ab819fba4 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Deleting instance files /opt/stack/data/nova/instances/b20dc75b-a699-4d76-bfa7-a62d2f7ef731_del
Aug 03 05:19:31 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-d8ded3d2-8fa6-4561-b29d-175ab819fba4 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Deletion of /opt/stack/data/nova/instances/b20dc75b-a699-4d76-bfa7-a62d2f7ef731_del complete
Aug 03 05:19:31 user nova-compute[72444]: DEBUG os_brick.utils [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de2cb7c-553f-43c1-bf0c-81b7f1710a79]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02d24c8-ab57-4477-9bf3-96d46eb62477]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:19:31 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:19:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:19:32 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa72073f-87b2-4c54-b133-95ae6d307b9d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:19:32 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0adbb041-9919-4482-8800-1883da9a897d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:19:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:19:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:19:32 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 05:19:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:19:32 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:19:32 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 05:19:32 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e79c7d-cf78-4c92-b4f3-822658428651]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:19:32 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 05:19:32 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 05:19:32 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 05:19:32 user nova-compute[72444]: DEBUG os_brick.utils [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:19:32 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Updating existing volume attachment record: 5d38407e-0f02-4e7b-94d8-e0eefdfec650 {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 05:19:32 user nova-compute[72444]: INFO nova.compute.manager [None req-d8ded3d2-8fa6-4561-b29d-175ab819fba4 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 03 05:19:32 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-d8ded3d2-8fa6-4561-b29d-175ab819fba4 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 05:19:32 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 05:19:32 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 05:19:32 user nova-compute[72444]: DEBUG nova.network.neutron [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Successfully created port: 79a5a765-6bb6-40a8-8a87-0cf8fc83049f {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 05:19:33 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:19:33 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Took 1.03 seconds to deallocate network for instance.
Aug 03 05:19:33 user nova-compute[72444]: DEBUG nova.compute.manager [req-2db186b8-d5b4-42c3-8f52-da60ac218696 req-ad60d35f-2889-4815-9152-4b12ae5cf395 service nova] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Received event network-vif-deleted-00304e44-34f5-459c-8d38-45947dedc2bd {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:19:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d8ded3d2-8fa6-4561-b29d-175ab819fba4 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:19:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d8ded3d2-8fa6-4561-b29d-175ab819fba4 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:19:33 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-d8ded3d2-8fa6-4561-b29d-175ab819fba4 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:19:33 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-d8ded3d2-8fa6-4561-b29d-175ab819fba4 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:19:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d8ded3d2-8fa6-4561-b29d-175ab819fba4 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.183s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:19:33 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-d8ded3d2-8fa6-4561-b29d-175ab819fba4 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Deleted allocations for instance b20dc75b-a699-4d76-bfa7-a62d2f7ef731
Aug 03 05:19:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d8ded3d2-8fa6-4561-b29d-175ab819fba4 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "b20dc75b-a699-4d76-bfa7-a62d2f7ef731" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.363s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:19:33 user nova-compute[72444]: DEBUG nova.compute.manager [req-263d2577-855b-4bb6-b109-5fb951ddf620 req-63962dff-0908-44ee-8824-a02e7f70fe04 service nova] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Received event network-vif-plugged-00304e44-34f5-459c-8d38-45947dedc2bd {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:19:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-263d2577-855b-4bb6-b109-5fb951ddf620 req-63962dff-0908-44ee-8824-a02e7f70fe04 service nova] Acquiring lock "b20dc75b-a699-4d76-bfa7-a62d2f7ef731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:19:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-263d2577-855b-4bb6-b109-5fb951ddf620 req-63962dff-0908-44ee-8824-a02e7f70fe04 service nova] Lock "b20dc75b-a699-4d76-bfa7-a62d2f7ef731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:19:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-263d2577-855b-4bb6-b109-5fb951ddf620 req-63962dff-0908-44ee-8824-a02e7f70fe04 service nova] Lock "b20dc75b-a699-4d76-bfa7-a62d2f7ef731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:19:33 user nova-compute[72444]: DEBUG nova.compute.manager [req-263d2577-855b-4bb6-b109-5fb951ddf620 req-63962dff-0908-44ee-8824-a02e7f70fe04 service nova] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] No waiting events found dispatching network-vif-plugged-00304e44-34f5-459c-8d38-45947dedc2bd {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:19:33 user nova-compute[72444]: WARNING nova.compute.manager [req-263d2577-855b-4bb6-b109-5fb951ddf620 req-63962dff-0908-44ee-8824-a02e7f70fe04 service nova] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Received unexpected event network-vif-plugged-00304e44-34f5-459c-8d38-45947dedc2bd for instance with vm_state deleted and task_state None.
Aug 03 05:19:33 user nova-compute[72444]: DEBUG nova.network.neutron [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Successfully updated port: 79a5a765-6bb6-40a8-8a87-0cf8fc83049f {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 05:19:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "refresh_cache-fca2180e-32c1-4280-b8a4-6bafb2112d02" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:19:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquired lock "refresh_cache-fca2180e-32c1-4280-b8a4-6bafb2112d02" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:19:33 user nova-compute[72444]: DEBUG nova.network.neutron [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 05:19:33 user nova-compute[72444]: DEBUG nova.network.neutron [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 05:19:34 user nova-compute[72444]: DEBUG nova.network.neutron [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Updating instance_info_cache with network_info: [{"id": "79a5a765-6bb6-40a8-8a87-0cf8fc83049f", "address": "fa:16:3e:76:8a:69", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79a5a765-6b", "ovs_interfaceid": "79a5a765-6bb6-40a8-8a87-0cf8fc83049f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:19:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Releasing lock "refresh_cache-fca2180e-32c1-4280-b8a4-6bafb2112d02" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:19:34 user nova-compute[72444]: DEBUG nova.compute.manager [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Instance network_info: |[{"id": "79a5a765-6bb6-40a8-8a87-0cf8fc83049f", "address": "fa:16:3e:76:8a:69", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79a5a765-6b", "ovs_interfaceid": "79a5a765-6bb6-40a8-8a87-0cf8fc83049f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 05:19:35 user nova-compute[72444]: DEBUG nova.compute.manager [req-6b45df4e-e86e-4e7a-b4df-27d95d9c2ac3 req-a72b5a3c-ebda-4475-898e-2a972f72a2a7 service nova] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Received event network-changed-79a5a765-6bb6-40a8-8a87-0cf8fc83049f {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:19:35 user nova-compute[72444]: DEBUG nova.compute.manager [req-6b45df4e-e86e-4e7a-b4df-27d95d9c2ac3 req-a72b5a3c-ebda-4475-898e-2a972f72a2a7 service nova] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Refreshing instance network info cache due to event network-changed-79a5a765-6bb6-40a8-8a87-0cf8fc83049f. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:19:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6b45df4e-e86e-4e7a-b4df-27d95d9c2ac3 req-a72b5a3c-ebda-4475-898e-2a972f72a2a7 service nova] Acquiring lock "refresh_cache-fca2180e-32c1-4280-b8a4-6bafb2112d02" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:19:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6b45df4e-e86e-4e7a-b4df-27d95d9c2ac3 req-a72b5a3c-ebda-4475-898e-2a972f72a2a7 service nova] Acquired lock "refresh_cache-fca2180e-32c1-4280-b8a4-6bafb2112d02" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:19:35 user nova-compute[72444]: DEBUG nova.network.neutron [req-6b45df4e-e86e-4e7a-b4df-27d95d9c2ac3 req-a72b5a3c-ebda-4475-898e-2a972f72a2a7 service nova] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Refreshing network info cache for port 79a5a765-6bb6-40a8-8a87-0cf8fc83049f {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:19:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:19:36 user nova-compute[72444]: DEBUG nova.network.neutron [req-6b45df4e-e86e-4e7a-b4df-27d95d9c2ac3 req-a72b5a3c-ebda-4475-898e-2a972f72a2a7 service nova] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Updated VIF entry in instance network info cache for port 79a5a765-6bb6-40a8-8a87-0cf8fc83049f. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:19:36 user nova-compute[72444]: DEBUG nova.network.neutron [req-6b45df4e-e86e-4e7a-b4df-27d95d9c2ac3 req-a72b5a3c-ebda-4475-898e-2a972f72a2a7 service nova] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Updating instance_info_cache with network_info: [{"id": "79a5a765-6bb6-40a8-8a87-0cf8fc83049f", "address": "fa:16:3e:76:8a:69", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79a5a765-6b", "ovs_interfaceid": "79a5a765-6bb6-40a8-8a87-0cf8fc83049f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:19:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-6b45df4e-e86e-4e7a-b4df-27d95d9c2ac3 req-a72b5a3c-ebda-4475-898e-2a972f72a2a7 service nova] Releasing lock "refresh_cache-fca2180e-32c1-4280-b8a4-6bafb2112d02" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:19:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG nova.compute.manager [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 05:19:39 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Creating image(s)
Aug 03 05:19:39 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Did not create local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Ensure instance console log exists: /opt/stack/data/nova/instances/fca2180e-32c1-4280-b8a4-6bafb2112d02/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Start _get_guest_xml network_info=[{"id": "79a5a765-6bb6-40a8-8a87-0cf8fc83049f", "address": "fa:16:3e:76:8a:69", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79a5a765-6b", "ovs_interfaceid": "79a5a765-6bb6-40a8-8a87-0cf8fc83049f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RCSkOmlX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fca2180e-32c1-4280-b8a4-6bafb2112d02', 'attached_at': '', 'detached_at': '', 'volume_id': 'e1b7bc13-5c08-40f3-abd7-3567b07a875c', 'serial': 'e1b7bc13-5c08-40f3-abd7-3567b07a875c'}, 'disk_bus': 'virtio', 'attachment_id': '5d38407e-0f02-4e7b-94d8-e0eefdfec650', 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 05:19:39 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:19:39 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:19:39 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RCSkOmlX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:19:39 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:19:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:19:39 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:19:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:19:39 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 05:19:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[287a5218-2ae7-498d-8f62-9424874db034]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 05:19:39 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd58b42c-9275-4a52-bfbf-96fbc1edd555]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c] added
Aug 03 05:19:39 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[788dfc26-c130-4c3f-a9b2-ca3d8d418aa8]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4540519-10d9-47fd-9791-051021bc1921]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RCSkOmlX {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RCSkOmlX" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9425b62d-a934-4a36-b540-d87c4dfc71b7]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RCSkOmlX'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ca5be0-7855-4afa-90af-75f805535b22]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccf55c3-f2c9-4736-9cb9-0bda88c22864]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 (non-flash)
Aug 03 05:19:39 user nova-compute[72444]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed (non-flash)
Aug 03 05:19:39 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 (non-flash)
Aug 03 05:19:39 user nova-compute[72444]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed (non-flash)
Aug 03 05:19:39 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc5613d-e07f-4eec-a54b-357da8711148]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c, portal: 172.16.0.220,3260]
Aug 03 05:19:39 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c, portal: 172.16.0.220,3260] successful.
Aug 03 05:19:39 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb8f059-7060-4b52-a176-e10db4475428]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50777bd-bc27-4ffa-8618-861e45039181]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 (non-flash)
Aug 03 05:19:39 user nova-compute[72444]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed (non-flash)
Aug 03 05:19:39 user nova-compute[72444]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c (non-flash)
Aug 03 05:19:39 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 (non-flash)
Aug 03 05:19:39 user nova-compute[72444]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed (non-flash)
Aug 03 05:19:39 user nova-compute[72444]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c (non-flash)
Aug 03 05:19:39 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] HCTL ('35', '-', '-', 0) found on session 58 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[59da1a55-a672-4491-a457-634d0d9aa8b2]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:19:39 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Searching for a device in session 58 and hctl ['35', '*', '*', 0] yield: None {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 05:19:40 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Searching for a device in session 58 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 05:19:40 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RCSkOmlX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 05:19:40 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:19:40 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26331353531333535', 'path': '/dev/sdd'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:19:40 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331353531333535', 'path': '/dev/sdd'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 05:19:40 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:19:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-155256941',display_name='tempest-TestVolumeBootPattern-server-155256941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-155256941',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJb/ucac2bYqYTTpUwHVlINSI4Sfb+N0MYWJk4BUfIgi24wGpfawX18lRHaBUwUNuvA9BvzcrJArj3JZ6r/WP+myl5DP/2VX4xcdyXqMaH1gGJv8NyGzE7tn1ggSM7aa7A==',key_name='tempest-TestVolumeBootPattern-1711073489',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae931112fcda4e2f8dfd4f540d905139',ramdisk_id='',reservation_id='r-zyk20wby',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1788747136',owner_user_name='tempest-TestVolumeBootPattern-1788747136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:19:32Z,user_data=None,user_id='ef4d8130e33c4d9ea44c29be12f18234',uuid=fca2180e-32c1-4280-b8a4-6bafb2112d02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79a5a765-6bb6-40a8-8a87-0cf8fc83049f", "address": "fa:16:3e:76:8a:69", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79a5a765-6b", "ovs_interfaceid": "79a5a765-6bb6-40a8-8a87-0cf8fc83049f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 05:19:40 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Converting VIF {"id": "79a5a765-6bb6-40a8-8a87-0cf8fc83049f", "address": "fa:16:3e:76:8a:69", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79a5a765-6b", "ovs_interfaceid": "79a5a765-6bb6-40a8-8a87-0cf8fc83049f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:19:40 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:8a:69,bridge_name='br-int',has_traffic_filtering=True,id=79a5a765-6bb6-40a8-8a87-0cf8fc83049f,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79a5a765-6b') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:19:40 user nova-compute[72444]: DEBUG nova.objects.instance [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lazy-loading 'pci_devices' on Instance uuid fca2180e-32c1-4280-b8a4-6bafb2112d02 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:19:40 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] End _get_guest_xml xml=<domain type="kvm">
Aug 03 05:19:40 user nova-compute[72444]:   <uuid>fca2180e-32c1-4280-b8a4-6bafb2112d02</uuid>
Aug 03 05:19:40 user nova-compute[72444]:   <name>instance-00000031</name>
Aug 03 05:19:40 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 05:19:40 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 05:19:40 user nova-compute[72444]:   <metadata>
Aug 03 05:19:40 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 05:19:40 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 05:19:40 user nova-compute[72444]:       <nova:name>tempest-TestVolumeBootPattern-server-155256941</nova:name>
Aug 03 05:19:40 user nova-compute[72444]:       <nova:creationTime>2023-08-03 05:19:39</nova:creationTime>
Aug 03 05:19:40 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 05:19:40 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 05:19:40 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 05:19:40 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 05:19:40 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 05:19:40 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 05:19:40 user nova-compute[72444]:       </nova:flavor>
Aug 03 05:19:40 user nova-compute[72444]:       <nova:owner>
Aug 03 05:19:40 user nova-compute[72444]:         <nova:user uuid="ef4d8130e33c4d9ea44c29be12f18234">tempest-TestVolumeBootPattern-1788747136-project-member</nova:user>
Aug 03 05:19:40 user nova-compute[72444]:         <nova:project uuid="ae931112fcda4e2f8dfd4f540d905139">tempest-TestVolumeBootPattern-1788747136</nova:project>
Aug 03 05:19:40 user nova-compute[72444]:       </nova:owner>
Aug 03 05:19:40 user nova-compute[72444]:       <nova:ports>
Aug 03 05:19:40 user nova-compute[72444]:         <nova:port uuid="79a5a765-6bb6-40a8-8a87-0cf8fc83049f">
Aug 03 05:19:40 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 03 05:19:40 user nova-compute[72444]:         </nova:port>
Aug 03 05:19:40 user nova-compute[72444]:       </nova:ports>
Aug 03 05:19:40 user nova-compute[72444]:     </nova:instance>
Aug 03 05:19:40 user nova-compute[72444]:   </metadata>
Aug 03 05:19:40 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 05:19:40 user nova-compute[72444]:     <system>
Aug 03 05:19:40 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 05:19:40 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 05:19:40 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 05:19:40 user nova-compute[72444]:       <entry name="serial">fca2180e-32c1-4280-b8a4-6bafb2112d02</entry>
Aug 03 05:19:40 user nova-compute[72444]:       <entry name="uuid">fca2180e-32c1-4280-b8a4-6bafb2112d02</entry>
Aug 03 05:19:40 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 05:19:40 user nova-compute[72444]:     </system>
Aug 03 05:19:40 user nova-compute[72444]:   </sysinfo>
Aug 03 05:19:40 user nova-compute[72444]:   <os>
Aug 03 05:19:40 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 05:19:40 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 05:19:40 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 05:19:40 user nova-compute[72444]:   </os>
Aug 03 05:19:40 user nova-compute[72444]:   <features>
Aug 03 05:19:40 user nova-compute[72444]:     <acpi/>
Aug 03 05:19:40 user nova-compute[72444]:     <apic/>
Aug 03 05:19:40 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 05:19:40 user nova-compute[72444]:   </features>
Aug 03 05:19:40 user nova-compute[72444]:   <clock offset="utc">
Aug 03 05:19:40 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 05:19:40 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 05:19:40 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 05:19:40 user nova-compute[72444]:   </clock>
Aug 03 05:19:40 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 05:19:40 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 05:19:40 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 05:19:40 user nova-compute[72444]:   </cpu>
Aug 03 05:19:40 user nova-compute[72444]:   <devices>
Aug 03 05:19:40 user nova-compute[72444]:     <disk type="block" device="disk">
Aug 03 05:19:40 user nova-compute[72444]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:19:40 user nova-compute[72444]:       <source dev="/dev/sdd"/>
Aug 03 05:19:40 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 05:19:40 user nova-compute[72444]:       <serial>e1b7bc13-5c08-40f3-abd7-3567b07a875c</serial>
Aug 03 05:19:40 user nova-compute[72444]:     </disk>
Aug 03 05:19:40 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 05:19:40 user nova-compute[72444]:       <mac address="fa:16:3e:76:8a:69"/>
Aug 03 05:19:40 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:19:40 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 05:19:40 user nova-compute[72444]:       <target dev="tap79a5a765-6b"/>
Aug 03 05:19:40 user nova-compute[72444]:     </interface>
Aug 03 05:19:40 user nova-compute[72444]:     <serial type="pty">
Aug 03 05:19:40 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/fca2180e-32c1-4280-b8a4-6bafb2112d02/console.log" append="off"/>
Aug 03 05:19:40 user nova-compute[72444]:     </serial>
Aug 03 05:19:40 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 05:19:40 user nova-compute[72444]:     <video>
Aug 03 05:19:40 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:19:40 user nova-compute[72444]:     </video>
Aug 03 05:19:40 user nova-compute[72444]:     <rng model="virtio">
Aug 03 05:19:40 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 05:19:40 user nova-compute[72444]:     </rng>
Aug 03 05:19:40 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 05:19:40 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 05:19:40 user nova-compute[72444]:       <stats period="10"/>
Aug 03 05:19:40 user nova-compute[72444]:     </memballoon>
Aug 03 05:19:40 user nova-compute[72444]:   </devices>
Aug 03 05:19:40 user nova-compute[72444]: </domain>
Aug 03 05:19:40 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 05:19:40 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:19:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-155256941',display_name='tempest-TestVolumeBootPattern-server-155256941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-155256941',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJb/ucac2bYqYTTpUwHVlINSI4Sfb+N0MYWJk4BUfIgi24wGpfawX18lRHaBUwUNuvA9BvzcrJArj3JZ6r/WP+myl5DP/2VX4xcdyXqMaH1gGJv8NyGzE7tn1ggSM7aa7A==',key_name='tempest-TestVolumeBootPattern-1711073489',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae931112fcda4e2f8dfd4f540d905139',ramdisk_id='',reservation_id='r-zyk20wby',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1788747136',owner_user_name='tempest-TestVolumeBootPattern-1788747136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:19:32Z,user_data=None,user_id='ef4d8130e33c4d9ea44c29be12f18234',uuid=fca2180e-32c1-4280-b8a4-6bafb2112d02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79a5a765-6bb6-40a8-8a87-0cf8fc83049f", "address": "fa:16:3e:76:8a:69", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79a5a765-6b", "ovs_interfaceid": "79a5a765-6bb6-40a8-8a87-0cf8fc83049f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 05:19:40 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Converting VIF {"id": "79a5a765-6bb6-40a8-8a87-0cf8fc83049f", "address": "fa:16:3e:76:8a:69", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79a5a765-6b", "ovs_interfaceid": "79a5a765-6bb6-40a8-8a87-0cf8fc83049f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:19:40 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:8a:69,bridge_name='br-int',has_traffic_filtering=True,id=79a5a765-6bb6-40a8-8a87-0cf8fc83049f,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79a5a765-6b') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:19:40 user nova-compute[72444]: DEBUG os_vif [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:8a:69,bridge_name='br-int',has_traffic_filtering=True,id=79a5a765-6bb6-40a8-8a87-0cf8fc83049f,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79a5a765-6b') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 05:19:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:19:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:19:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 05:19:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:19:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79a5a765-6b, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:19:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap79a5a765-6b, col_values=(('external_ids', {'iface-id': '79a5a765-6bb6-40a8-8a87-0cf8fc83049f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:8a:69', 'vm-uuid': 'fca2180e-32c1-4280-b8a4-6bafb2112d02'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:19:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:19:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:19:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:19:40 user nova-compute[72444]: INFO os_vif [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:8a:69,bridge_name='br-int',has_traffic_filtering=True,id=79a5a765-6bb6-40a8-8a87-0cf8fc83049f,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79a5a765-6b')
Aug 03 05:19:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:19:41 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] No VIF found with MAC fa:16:3e:76:8a:69, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 05:19:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:19:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:19:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:19:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:19:42 user nova-compute[72444]: DEBUG nova.compute.manager [req-8876bd99-5663-4452-9773-74e529d82ae8 req-61b0f5f8-74be-47f9-b132-ea5edd61019c service nova] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Received event network-vif-plugged-79a5a765-6bb6-40a8-8a87-0cf8fc83049f {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:19:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8876bd99-5663-4452-9773-74e529d82ae8 req-61b0f5f8-74be-47f9-b132-ea5edd61019c service nova] Acquiring lock "fca2180e-32c1-4280-b8a4-6bafb2112d02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:19:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8876bd99-5663-4452-9773-74e529d82ae8 req-61b0f5f8-74be-47f9-b132-ea5edd61019c service nova] Lock "fca2180e-32c1-4280-b8a4-6bafb2112d02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:19:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-8876bd99-5663-4452-9773-74e529d82ae8 req-61b0f5f8-74be-47f9-b132-ea5edd61019c service nova] Lock "fca2180e-32c1-4280-b8a4-6bafb2112d02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:19:42 user nova-compute[72444]: DEBUG nova.compute.manager [req-8876bd99-5663-4452-9773-74e529d82ae8 req-61b0f5f8-74be-47f9-b132-ea5edd61019c service nova] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] No waiting events found dispatching network-vif-plugged-79a5a765-6bb6-40a8-8a87-0cf8fc83049f {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:19:42 user nova-compute[72444]: WARNING nova.compute.manager [req-8876bd99-5663-4452-9773-74e529d82ae8 req-61b0f5f8-74be-47f9-b132-ea5edd61019c service nova] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Received unexpected event network-vif-plugged-79a5a765-6bb6-40a8-8a87-0cf8fc83049f for instance with vm_state building and task_state spawning.
Aug 03 05:19:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:19:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:19:44 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691039984.348967, fca2180e-32c1-4280-b8a4-6bafb2112d02 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:19:44 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] VM Resumed (Lifecycle Event)
Aug 03 05:19:44 user nova-compute[72444]: DEBUG nova.compute.manager [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 05:19:44 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 05:19:44 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Instance spawned successfully.
Aug 03 05:19:44 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 05:19:44 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:19:44 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:19:44 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:19:44 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:19:44 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:19:44 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:19:44 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:19:44 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:19:44 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 05:19:44 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691039984.350226, fca2180e-32c1-4280-b8a4-6bafb2112d02 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:19:44 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] VM Started (Lifecycle Event)
Aug 03 05:19:44 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:19:44 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:19:44 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 05:19:44 user nova-compute[72444]: INFO nova.compute.manager [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Took 4.95 seconds to spawn the instance on the hypervisor.
Aug 03 05:19:44 user nova-compute[72444]: DEBUG nova.compute.manager [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:19:44 user nova-compute[72444]: DEBUG nova.compute.manager [req-0ebee513-ae8a-4716-8916-ab7294e4f021 req-3b8b76d0-598c-4872-be25-513f6e7460a3 service nova] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Received event network-vif-plugged-79a5a765-6bb6-40a8-8a87-0cf8fc83049f {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:19:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0ebee513-ae8a-4716-8916-ab7294e4f021 req-3b8b76d0-598c-4872-be25-513f6e7460a3 service nova] Acquiring lock "fca2180e-32c1-4280-b8a4-6bafb2112d02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:19:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0ebee513-ae8a-4716-8916-ab7294e4f021 req-3b8b76d0-598c-4872-be25-513f6e7460a3 service nova] Lock "fca2180e-32c1-4280-b8a4-6bafb2112d02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:19:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0ebee513-ae8a-4716-8916-ab7294e4f021 req-3b8b76d0-598c-4872-be25-513f6e7460a3 service nova] Lock "fca2180e-32c1-4280-b8a4-6bafb2112d02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:19:44 user nova-compute[72444]: DEBUG nova.compute.manager [req-0ebee513-ae8a-4716-8916-ab7294e4f021 req-3b8b76d0-598c-4872-be25-513f6e7460a3 service nova] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] No waiting events found dispatching network-vif-plugged-79a5a765-6bb6-40a8-8a87-0cf8fc83049f {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:19:44 user nova-compute[72444]: WARNING nova.compute.manager [req-0ebee513-ae8a-4716-8916-ab7294e4f021 req-3b8b76d0-598c-4872-be25-513f6e7460a3 service nova] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Received unexpected event network-vif-plugged-79a5a765-6bb6-40a8-8a87-0cf8fc83049f for instance with vm_state building and task_state spawning.
Aug 03 05:19:44 user nova-compute[72444]: INFO nova.compute.manager [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Took 13.26 seconds to build instance.
Aug 03 05:19:44 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-833c78d8-59f2-4b9e-b882-b52a6b6997b7 tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "fca2180e-32c1-4280-b8a4-6bafb2112d02" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.379s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:19:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:19:46 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:19:46 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691039971.8916283, b20dc75b-a699-4d76-bfa7-a62d2f7ef731 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:19:46 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] VM Stopped (Lifecycle Event)
Aug 03 05:19:46 user nova-compute[72444]: DEBUG nova.compute.manager [None req-1678689b-ac18-4980-886f-f37394ea6a0f None None] [instance: b20dc75b-a699-4d76-bfa7-a62d2f7ef731] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:19:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:19:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:19:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:20:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:20:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:20:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:20:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:20:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:20:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:20:13 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:20:14 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:20:15 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:20:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:20:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:20:18 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:20:18 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:20:18 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Didn't find any instances for network info cache update. {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 03 05:20:20 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:20:20 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:20:20 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 05:20:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:20:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:20:21 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:20:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-917a6aa3-0b12-4206-ae69-7c86c1ee16a7 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "06bccfea-4a42-4880-8712-e9a7c0cd2a13" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:20:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-917a6aa3-0b12-4206-ae69-7c86c1ee16a7 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "06bccfea-4a42-4880-8712-e9a7c0cd2a13" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:20:22 user nova-compute[72444]: INFO nova.compute.manager [None req-917a6aa3-0b12-4206-ae69-7c86c1ee16a7 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Detaching volume 11a0035f-0cda-438e-8671-af5f4b663f71
Aug 03 05:20:22 user nova-compute[72444]: INFO nova.virt.block_device [None req-917a6aa3-0b12-4206-ae69-7c86c1ee16a7 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Attempting to driver detach volume 11a0035f-0cda-438e-8671-af5f4b663f71 from mountpoint /dev/vdb
Aug 03 05:20:22 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-917a6aa3-0b12-4206-ae69-7c86c1ee16a7 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Attempting to detach device vdb from instance 06bccfea-4a42-4880-8712-e9a7c0cd2a13 from the persistent domain config. {{(pid=72444) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 05:20:22 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-917a6aa3-0b12-4206-ae69-7c86c1ee16a7 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 05:20:22 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:20:22 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 05:20:22 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 05:20:22 user nova-compute[72444]:   <serial>11a0035f-0cda-438e-8671-af5f4b663f71</serial>
Aug 03 05:20:22 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 05:20:22 user nova-compute[72444]: </disk>
Aug 03 05:20:22 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 05:20:22 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-917a6aa3-0b12-4206-ae69-7c86c1ee16a7 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Successfully detached device vdb from instance 06bccfea-4a42-4880-8712-e9a7c0cd2a13 from the persistent domain config.
Aug 03 05:20:22 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-917a6aa3-0b12-4206-ae69-7c86c1ee16a7 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 06bccfea-4a42-4880-8712-e9a7c0cd2a13 from the live domain config. {{(pid=72444) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 05:20:22 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-917a6aa3-0b12-4206-ae69-7c86c1ee16a7 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 05:20:22 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:20:22 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 05:20:22 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 05:20:22 user nova-compute[72444]:   <serial>11a0035f-0cda-438e-8671-af5f4b663f71</serial>
Aug 03 05:20:22 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 05:20:22 user nova-compute[72444]: </disk>
Aug 03 05:20:22 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 05:20:22 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Received event <DeviceRemovedEvent: 1691040022.8162246, 06bccfea-4a42-4880-8712-e9a7c0cd2a13 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72444) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 05:20:22 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-917a6aa3-0b12-4206-ae69-7c86c1ee16a7 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 06bccfea-4a42-4880-8712-e9a7c0cd2a13 {{(pid=72444) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 05:20:22 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-917a6aa3-0b12-4206-ae69-7c86c1ee16a7 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Successfully detached device vdb from instance 06bccfea-4a42-4880-8712-e9a7c0cd2a13 from the live domain config.
Aug 03 05:20:22 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-917a6aa3-0b12-4206-ae69-7c86c1ee16a7 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 05:20:22 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-917a6aa3-0b12-4206-ae69-7c86c1ee16a7 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GxcSkYiR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:20:22 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-917a6aa3-0b12-4206-ae69-7c86c1ee16a7 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:20:22 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-917a6aa3-0b12-4206-ae69-7c86c1ee16a7 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:20:22 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-917a6aa3-0b12-4206-ae69-7c86c1ee16a7 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:20:22 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-917a6aa3-0b12-4206-ae69-7c86c1ee16a7 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 05:20:22 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:20:22 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:20:22 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0187a3-438f-4bbb-bcd4-3f7c0d43cbfb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:20:22 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:20:22 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:20:22 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa6c207-69bc-4662-84fe-acbbcb5fc7c8]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:20:22 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-917a6aa3-0b12-4206-ae69-7c86c1ee16a7 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 (non-flash)
Aug 03 05:20:22 user nova-compute[72444]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed (non-flash)
Aug 03 05:20:22 user nova-compute[72444]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c (non-flash)
Aug 03 05:20:22 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:20:22 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-917a6aa3-0b12-4206-ae69-7c86c1ee16a7 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 (non-flash)
Aug 03 05:20:22 user nova-compute[72444]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed (non-flash)
Aug 03 05:20:22 user nova-compute[72444]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c (non-flash)
Aug 03 05:20:22 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:20:22 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-917a6aa3-0b12-4206-ae69-7c86c1ee16a7 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30943057e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71'): ({'sdb'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 05:20:22 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-917a6aa3-0b12-4206-ae69-7c86c1ee16a7 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Removing single pathed devices sdb {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 05:20:22 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:20:22 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:20:22 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd91f762-502a-4459-a2cc-85c31ddc75a6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:20:22 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:20:22 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:20:22 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00e18df-ab21-4a15-9c75-bbed67d8457b]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:20:22 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-917a6aa3-0b12-4206-ae69-7c86c1ee16a7 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Flushing IO for device /dev/sdb {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 05:20:22 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:20:22 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:20:22 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8403bc-d497-43dc-9a7d-3e9043a1c5a5]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:20:22 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-917a6aa3-0b12-4206-ae69-7c86c1ee16a7 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 05:20:22 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:20:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:20:23 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9035c4e6-89e7-40e8-9026-71e0a85939b6]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:20:23 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-917a6aa3-0b12-4206-ae69-7c86c1ee16a7 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 05:20:23 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-917a6aa3-0b12-4206-ae69-7c86c1ee16a7 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 05:20:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-917a6aa3-0b12-4206-ae69-7c86c1ee16a7 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 05:20:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:20:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:20:23 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0485a076-6587-4776-9624-308c32f3d180]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:20:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-917a6aa3-0b12-4206-ae69-7c86c1ee16a7 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:20:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:20:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:20:23 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5444736f-f135-4fdc-8f73-b82ca6dae8ca]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:20:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-917a6aa3-0b12-4206-ae69-7c86c1ee16a7 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71, portal: 172.16.0.220,3260]
Aug 03 05:20:23 user nova-compute[72444]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71, portal: 172.16.0.220,3260] successful.
Aug 03 05:20:23 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:20:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:20:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11a0035f-0cda-438e-8671-af5f4b663f71 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:20:23 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f1d84c-2deb-489b-ba11-4f5c3d8e4939]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:20:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-917a6aa3-0b12-4206-ae69-7c86c1ee16a7 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:20:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-917a6aa3-0b12-4206-ae69-7c86c1ee16a7 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:20:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-917a6aa3-0b12-4206-ae69-7c86c1ee16a7 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] <== disconnect_volume: return (274ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:20:23 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-917a6aa3-0b12-4206-ae69-7c86c1ee16a7 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 05:20:23 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:20:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:20:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:20:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:20:23 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:20:24 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 05:20:24 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 05:20:24 user nova-compute[72444]: DEBUG nova.objects.instance [None req-917a6aa3-0b12-4206-ae69-7c86c1ee16a7 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lazy-loading 'flavor' on Instance uuid 06bccfea-4a42-4880-8712-e9a7c0cd2a13 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:20:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06bccfea-4a42-4880-8712-e9a7c0cd2a13/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:20:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-917a6aa3-0b12-4206-ae69-7c86c1ee16a7 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "06bccfea-4a42-4880-8712-e9a7c0cd2a13" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.823s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:20:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06bccfea-4a42-4880-8712-e9a7c0cd2a13/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:20:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06bccfea-4a42-4880-8712-e9a7c0cd2a13/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:20:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06bccfea-4a42-4880-8712-e9a7c0cd2a13/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:20:24 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:20:24 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:20:24 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=8556MB free_disk=25.3399658203125GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:20:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:20:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:20:24 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 06bccfea-4a42-4880-8712-e9a7c0cd2a13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:20:24 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 2a778b55-8481-43cb-a628-b6c3c0690933 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:20:24 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance fca2180e-32c1-4280-b8a4-6bafb2112d02 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:20:24 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:20:24 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:20:24 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:20:24 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:20:24 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:20:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.261s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:20:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:20:26 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:20:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:20:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:20:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:20:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:20:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:20:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:20:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:20:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:20:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:20:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:20:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:20:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:20:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:20:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:20:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:20:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:20:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:20:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:20:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:20:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:20:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:20:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:20:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:20:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:20:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:20:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:21:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:21:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:21:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:21:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:21:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:21:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:21:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:21:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:21:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:21:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:21:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:21:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:21:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:21:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-54b43569-4261-4167-9fc4-1e2fb4c5b984 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "06bccfea-4a42-4880-8712-e9a7c0cd2a13" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:21:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-54b43569-4261-4167-9fc4-1e2fb4c5b984 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "06bccfea-4a42-4880-8712-e9a7c0cd2a13" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:21:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-54b43569-4261-4167-9fc4-1e2fb4c5b984 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "06bccfea-4a42-4880-8712-e9a7c0cd2a13-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:21:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-54b43569-4261-4167-9fc4-1e2fb4c5b984 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "06bccfea-4a42-4880-8712-e9a7c0cd2a13-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:21:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-54b43569-4261-4167-9fc4-1e2fb4c5b984 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "06bccfea-4a42-4880-8712-e9a7c0cd2a13-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:21:12 user nova-compute[72444]: INFO nova.compute.manager [None req-54b43569-4261-4167-9fc4-1e2fb4c5b984 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Terminating instance
Aug 03 05:21:12 user nova-compute[72444]: DEBUG nova.compute.manager [None req-54b43569-4261-4167-9fc4-1e2fb4c5b984 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 05:21:12 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:21:12 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:21:12 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:21:12 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:21:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:21:13 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Instance destroyed successfully.
Aug 03 05:21:13 user nova-compute[72444]: DEBUG nova.objects.instance [None req-54b43569-4261-4167-9fc4-1e2fb4c5b984 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lazy-loading 'resources' on Instance uuid 06bccfea-4a42-4880-8712-e9a7c0cd2a13 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:21:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-54b43569-4261-4167-9fc4-1e2fb4c5b984 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:15:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-460041083',display_name='tempest-AttachVolumeNegativeTest-server-460041083',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-460041083',id=46,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJmPnJyINGWpYMqvxC/BanrH9M8iIpPPriT33nKJSOoKaTYiRf4j7YAlLFYM04lSCEoEdjpCB6bwMDVq7HpDF4ElrIj62QvujlXp1fDsRq7o6+VO8DndDL1NwBo8wP2Dw==',key_name='tempest-keypair-484102651',keypairs=<?>,launch_index=0,launched_at=2023-08-03T05:15:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d8210385d97453ab4befb159a457772',ramdisk_id='',reservation_id='r-0856ltht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1998464271',owner_user_name='tempest-AttachVolumeNegativeTest-1998464271-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T05:15:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39ca6b589ce84537984e0df64b6085f3',uuid=06bccfea-4a42-4880-8712-e9a7c0cd2a13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51cc40fe-4c00-4266-94f7-6eb722f9253e", "address": "fa:16:3e:8b:f2:c5", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cc40fe-4c", "ovs_interfaceid": "51cc40fe-4c00-4266-94f7-6eb722f9253e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 05:21:13 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-54b43569-4261-4167-9fc4-1e2fb4c5b984 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Converting VIF {"id": "51cc40fe-4c00-4266-94f7-6eb722f9253e", "address": "fa:16:3e:8b:f2:c5", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cc40fe-4c", "ovs_interfaceid": "51cc40fe-4c00-4266-94f7-6eb722f9253e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:21:13 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-54b43569-4261-4167-9fc4-1e2fb4c5b984 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:f2:c5,bridge_name='br-int',has_traffic_filtering=True,id=51cc40fe-4c00-4266-94f7-6eb722f9253e,network=Network(9605cf27-7ef3-4664-97b1-a6e1d093ce98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51cc40fe-4c') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:21:13 user nova-compute[72444]: DEBUG os_vif [None req-54b43569-4261-4167-9fc4-1e2fb4c5b984 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:f2:c5,bridge_name='br-int',has_traffic_filtering=True,id=51cc40fe-4c00-4266-94f7-6eb722f9253e,network=Network(9605cf27-7ef3-4664-97b1-a6e1d093ce98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51cc40fe-4c') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 05:21:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:21:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51cc40fe-4c, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:21:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:21:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:21:13 user nova-compute[72444]: INFO os_vif [None req-54b43569-4261-4167-9fc4-1e2fb4c5b984 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:f2:c5,bridge_name='br-int',has_traffic_filtering=True,id=51cc40fe-4c00-4266-94f7-6eb722f9253e,network=Network(9605cf27-7ef3-4664-97b1-a6e1d093ce98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51cc40fe-4c')
Aug 03 05:21:13 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-54b43569-4261-4167-9fc4-1e2fb4c5b984 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Deleting instance files /opt/stack/data/nova/instances/06bccfea-4a42-4880-8712-e9a7c0cd2a13_del
Aug 03 05:21:13 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-54b43569-4261-4167-9fc4-1e2fb4c5b984 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Deletion of /opt/stack/data/nova/instances/06bccfea-4a42-4880-8712-e9a7c0cd2a13_del complete
Aug 03 05:21:13 user nova-compute[72444]: DEBUG nova.compute.manager [req-51474ed7-aae9-44d2-9c10-eb8777c9e34e req-98f3dd41-fd76-4328-a9f5-df0feaef907e service nova] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Received event network-vif-unplugged-51cc40fe-4c00-4266-94f7-6eb722f9253e {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:21:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-51474ed7-aae9-44d2-9c10-eb8777c9e34e req-98f3dd41-fd76-4328-a9f5-df0feaef907e service nova] Acquiring lock "06bccfea-4a42-4880-8712-e9a7c0cd2a13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:21:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-51474ed7-aae9-44d2-9c10-eb8777c9e34e req-98f3dd41-fd76-4328-a9f5-df0feaef907e service nova] Lock "06bccfea-4a42-4880-8712-e9a7c0cd2a13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:21:13 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-51474ed7-aae9-44d2-9c10-eb8777c9e34e req-98f3dd41-fd76-4328-a9f5-df0feaef907e service nova] Lock "06bccfea-4a42-4880-8712-e9a7c0cd2a13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:21:13 user nova-compute[72444]: DEBUG nova.compute.manager [req-51474ed7-aae9-44d2-9c10-eb8777c9e34e req-98f3dd41-fd76-4328-a9f5-df0feaef907e service nova] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] No waiting events found dispatching network-vif-unplugged-51cc40fe-4c00-4266-94f7-6eb722f9253e {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:21:13 user nova-compute[72444]: DEBUG nova.compute.manager [req-51474ed7-aae9-44d2-9c10-eb8777c9e34e req-98f3dd41-fd76-4328-a9f5-df0feaef907e service nova] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Received event network-vif-unplugged-51cc40fe-4c00-4266-94f7-6eb722f9253e for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 05:21:13 user nova-compute[72444]: INFO nova.compute.manager [None req-54b43569-4261-4167-9fc4-1e2fb4c5b984 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 03 05:21:13 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-54b43569-4261-4167-9fc4-1e2fb4c5b984 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 05:21:13 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 05:21:13 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 05:21:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:21:14 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:21:14 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Took 0.83 seconds to deallocate network for instance.
Aug 03 05:21:14 user nova-compute[72444]: DEBUG nova.compute.manager [req-6654d057-4a35-46c1-8cd6-d53d857535f4 req-a4c330b0-fba2-4ce3-9427-08ff6ec7cd19 service nova] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Received event network-vif-deleted-51cc40fe-4c00-4266-94f7-6eb722f9253e {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:21:14 user nova-compute[72444]: INFO nova.compute.manager [req-6654d057-4a35-46c1-8cd6-d53d857535f4 req-a4c330b0-fba2-4ce3-9427-08ff6ec7cd19 service nova] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Neutron deleted interface 51cc40fe-4c00-4266-94f7-6eb722f9253e; detaching it from the instance and deleting it from the info cache
Aug 03 05:21:14 user nova-compute[72444]: DEBUG nova.network.neutron [req-6654d057-4a35-46c1-8cd6-d53d857535f4 req-a4c330b0-fba2-4ce3-9427-08ff6ec7cd19 service nova] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:21:14 user nova-compute[72444]: DEBUG nova.compute.manager [req-6654d057-4a35-46c1-8cd6-d53d857535f4 req-a4c330b0-fba2-4ce3-9427-08ff6ec7cd19 service nova] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Detach interface failed, port_id=51cc40fe-4c00-4266-94f7-6eb722f9253e, reason: Instance 06bccfea-4a42-4880-8712-e9a7c0cd2a13 could not be found. {{(pid=72444) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 03 05:21:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-54b43569-4261-4167-9fc4-1e2fb4c5b984 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:21:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-54b43569-4261-4167-9fc4-1e2fb4c5b984 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:21:14 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-54b43569-4261-4167-9fc4-1e2fb4c5b984 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:21:14 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-54b43569-4261-4167-9fc4-1e2fb4c5b984 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:21:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-54b43569-4261-4167-9fc4-1e2fb4c5b984 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.152s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:21:14 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-54b43569-4261-4167-9fc4-1e2fb4c5b984 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Deleted allocations for instance 06bccfea-4a42-4880-8712-e9a7c0cd2a13
Aug 03 05:21:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-54b43569-4261-4167-9fc4-1e2fb4c5b984 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "06bccfea-4a42-4880-8712-e9a7c0cd2a13" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.009s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:21:14 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:21:14 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:21:15 user nova-compute[72444]: DEBUG nova.compute.manager [req-0b1c4c57-8d85-42f0-85b3-48729ff2eeb0 req-fbcf5ff3-fe2a-4756-b02c-4eb1586157fd service nova] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Received event network-vif-plugged-51cc40fe-4c00-4266-94f7-6eb722f9253e {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:21:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0b1c4c57-8d85-42f0-85b3-48729ff2eeb0 req-fbcf5ff3-fe2a-4756-b02c-4eb1586157fd service nova] Acquiring lock "06bccfea-4a42-4880-8712-e9a7c0cd2a13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:21:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0b1c4c57-8d85-42f0-85b3-48729ff2eeb0 req-fbcf5ff3-fe2a-4756-b02c-4eb1586157fd service nova] Lock "06bccfea-4a42-4880-8712-e9a7c0cd2a13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:21:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0b1c4c57-8d85-42f0-85b3-48729ff2eeb0 req-fbcf5ff3-fe2a-4756-b02c-4eb1586157fd service nova] Lock "06bccfea-4a42-4880-8712-e9a7c0cd2a13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:21:15 user nova-compute[72444]: DEBUG nova.compute.manager [req-0b1c4c57-8d85-42f0-85b3-48729ff2eeb0 req-fbcf5ff3-fe2a-4756-b02c-4eb1586157fd service nova] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] No waiting events found dispatching network-vif-plugged-51cc40fe-4c00-4266-94f7-6eb722f9253e {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:21:15 user nova-compute[72444]: WARNING nova.compute.manager [req-0b1c4c57-8d85-42f0-85b3-48729ff2eeb0 req-fbcf5ff3-fe2a-4756-b02c-4eb1586157fd service nova] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Received unexpected event network-vif-plugged-51cc40fe-4c00-4266-94f7-6eb722f9253e for instance with vm_state deleted and task_state None.
Aug 03 05:21:15 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:21:18 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:21:20 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:21:20 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:21:20 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Rebuilding the list of instances to heal {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 05:21:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-2a778b55-8481-43cb-a628-b6c3c0690933" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:21:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-2a778b55-8481-43cb-a628-b6c3c0690933" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:21:21 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 05:21:21 user nova-compute[72444]: DEBUG nova.objects.instance [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lazy-loading 'info_cache' on Instance uuid 2a778b55-8481-43cb-a628-b6c3c0690933 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:21:21 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Updating instance_info_cache with network_info: [{"id": "d9d18ac0-7b2c-4672-8b38-c792c15fb294", "address": "fa:16:3e:af:09:a0", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d18ac0-7b", "ovs_interfaceid": "d9d18ac0-7b2c-4672-8b38-c792c15fb294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:21:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-2a778b55-8481-43cb-a628-b6c3c0690933" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:21:21 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 05:21:21 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:21:21 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 05:21:22 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:21:23 user nova-compute[72444]: DEBUG nova.compute.manager [req-deb8cc64-c569-471e-ae8c-1964eddf50d6 req-7bbec800-eea5-4b0c-af4b-28c8dd80ba45 service nova] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Received event network-changed-79a5a765-6bb6-40a8-8a87-0cf8fc83049f {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:21:23 user nova-compute[72444]: DEBUG nova.compute.manager [req-deb8cc64-c569-471e-ae8c-1964eddf50d6 req-7bbec800-eea5-4b0c-af4b-28c8dd80ba45 service nova] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Refreshing instance network info cache due to event network-changed-79a5a765-6bb6-40a8-8a87-0cf8fc83049f. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:21:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-deb8cc64-c569-471e-ae8c-1964eddf50d6 req-7bbec800-eea5-4b0c-af4b-28c8dd80ba45 service nova] Acquiring lock "refresh_cache-fca2180e-32c1-4280-b8a4-6bafb2112d02" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:21:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-deb8cc64-c569-471e-ae8c-1964eddf50d6 req-7bbec800-eea5-4b0c-af4b-28c8dd80ba45 service nova] Acquired lock "refresh_cache-fca2180e-32c1-4280-b8a4-6bafb2112d02" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:21:23 user nova-compute[72444]: DEBUG nova.network.neutron [req-deb8cc64-c569-471e-ae8c-1964eddf50d6 req-7bbec800-eea5-4b0c-af4b-28c8dd80ba45 service nova] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Refreshing network info cache for port 79a5a765-6bb6-40a8-8a87-0cf8fc83049f {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:21:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:21:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:21:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:21:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:21:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:21:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:21:23 user nova-compute[72444]: DEBUG nova.network.neutron [req-deb8cc64-c569-471e-ae8c-1964eddf50d6 req-7bbec800-eea5-4b0c-af4b-28c8dd80ba45 service nova] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Updated VIF entry in instance network info cache for port 79a5a765-6bb6-40a8-8a87-0cf8fc83049f. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:21:23 user nova-compute[72444]: DEBUG nova.network.neutron [req-deb8cc64-c569-471e-ae8c-1964eddf50d6 req-7bbec800-eea5-4b0c-af4b-28c8dd80ba45 service nova] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Updating instance_info_cache with network_info: [{"id": "79a5a765-6bb6-40a8-8a87-0cf8fc83049f", "address": "fa:16:3e:76:8a:69", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79a5a765-6b", "ovs_interfaceid": "79a5a765-6bb6-40a8-8a87-0cf8fc83049f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:21:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-deb8cc64-c569-471e-ae8c-1964eddf50d6 req-7bbec800-eea5-4b0c-af4b-28c8dd80ba45 service nova] Releasing lock "refresh_cache-fca2180e-32c1-4280-b8a4-6bafb2112d02" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:21:23 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG nova.compute.manager [req-9b8eb1cd-7719-4fab-b6c2-b7f49a33e505 req-cc4a9780-26c1-4719-8e71-dafc375adc1c service nova] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Received event network-changed-79a5a765-6bb6-40a8-8a87-0cf8fc83049f {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG nova.compute.manager [req-9b8eb1cd-7719-4fab-b6c2-b7f49a33e505 req-cc4a9780-26c1-4719-8e71-dafc375adc1c service nova] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Refreshing instance network info cache due to event network-changed-79a5a765-6bb6-40a8-8a87-0cf8fc83049f. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9b8eb1cd-7719-4fab-b6c2-b7f49a33e505 req-cc4a9780-26c1-4719-8e71-dafc375adc1c service nova] Acquiring lock "refresh_cache-fca2180e-32c1-4280-b8a4-6bafb2112d02" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9b8eb1cd-7719-4fab-b6c2-b7f49a33e505 req-cc4a9780-26c1-4719-8e71-dafc375adc1c service nova] Acquired lock "refresh_cache-fca2180e-32c1-4280-b8a4-6bafb2112d02" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG nova.network.neutron [req-9b8eb1cd-7719-4fab-b6c2-b7f49a33e505 req-cc4a9780-26c1-4719-8e71-dafc375adc1c service nova] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Refreshing network info cache for port 79a5a765-6bb6-40a8-8a87-0cf8fc83049f {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "fca2180e-32c1-4280-b8a4-6bafb2112d02" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "fca2180e-32c1-4280-b8a4-6bafb2112d02" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "fca2180e-32c1-4280-b8a4-6bafb2112d02-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "fca2180e-32c1-4280-b8a4-6bafb2112d02-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "fca2180e-32c1-4280-b8a4-6bafb2112d02-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:21:24 user nova-compute[72444]: INFO nova.compute.manager [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Terminating instance
Aug 03 05:21:24 user nova-compute[72444]: DEBUG nova.compute.manager [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG nova.network.neutron [req-9b8eb1cd-7719-4fab-b6c2-b7f49a33e505 req-cc4a9780-26c1-4719-8e71-dafc375adc1c service nova] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Updated VIF entry in instance network info cache for port 79a5a765-6bb6-40a8-8a87-0cf8fc83049f. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG nova.network.neutron [req-9b8eb1cd-7719-4fab-b6c2-b7f49a33e505 req-cc4a9780-26c1-4719-8e71-dafc375adc1c service nova] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Updating instance_info_cache with network_info: [{"id": "79a5a765-6bb6-40a8-8a87-0cf8fc83049f", "address": "fa:16:3e:76:8a:69", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79a5a765-6b", "ovs_interfaceid": "79a5a765-6bb6-40a8-8a87-0cf8fc83049f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9b8eb1cd-7719-4fab-b6c2-b7f49a33e505 req-cc4a9780-26c1-4719-8e71-dafc375adc1c service nova] Releasing lock "refresh_cache-fca2180e-32c1-4280-b8a4-6bafb2112d02" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:21:24 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Instance destroyed successfully.
Aug 03 05:21:24 user nova-compute[72444]: DEBUG nova.objects.instance [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lazy-loading 'resources' on Instance uuid fca2180e-32c1-4280-b8a4-6bafb2112d02 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:19:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-155256941',display_name='tempest-TestVolumeBootPattern-server-155256941',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-155256941',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJb/ucac2bYqYTTpUwHVlINSI4Sfb+N0MYWJk4BUfIgi24wGpfawX18lRHaBUwUNuvA9BvzcrJArj3JZ6r/WP+myl5DP/2VX4xcdyXqMaH1gGJv8NyGzE7tn1ggSM7aa7A==',key_name='tempest-TestVolumeBootPattern-1711073489',keypairs=<?>,launch_index=0,launched_at=2023-08-03T05:19:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae931112fcda4e2f8dfd4f540d905139',ramdisk_id='',reservation_id='r-zyk20wby',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1788747136',owner_user_name='tempest-TestVolumeBootPattern-1788747136-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T05:19:45Z,user_data=None,user_id='ef4d8130e33c4d9ea44c29be12f18234',uuid=fca2180e-32c1-4280-b8a4-6bafb2112d02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79a5a765-6bb6-40a8-8a87-0cf8fc83049f", "address": "fa:16:3e:76:8a:69", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79a5a765-6b", "ovs_interfaceid": "79a5a765-6bb6-40a8-8a87-0cf8fc83049f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Converting VIF {"id": "79a5a765-6bb6-40a8-8a87-0cf8fc83049f", "address": "fa:16:3e:76:8a:69", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79a5a765-6b", "ovs_interfaceid": "79a5a765-6bb6-40a8-8a87-0cf8fc83049f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:8a:69,bridge_name='br-int',has_traffic_filtering=True,id=79a5a765-6bb6-40a8-8a87-0cf8fc83049f,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79a5a765-6b') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG os_vif [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:8a:69,bridge_name='br-int',has_traffic_filtering=True,id=79a5a765-6bb6-40a8-8a87-0cf8fc83049f,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79a5a765-6b') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79a5a765-6b, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:21:24 user nova-compute[72444]: INFO os_vif [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:8a:69,bridge_name='br-int',has_traffic_filtering=True,id=79a5a765-6bb6-40a8-8a87-0cf8fc83049f,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79a5a765-6b')
Aug 03 05:21:24 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RCSkOmlX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:21:24 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:21:24 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2039569-8b09-456a-9605-ed99c07dfec4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[335634e9-c069-4672-af93-582ec6f96421]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed (non-flash)
Aug 03 05:21:24 user nova-compute[72444]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c (non-flash)
Aug 03 05:21:24 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed (non-flash)
Aug 03 05:21:24 user nova-compute[72444]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c (non-flash)
Aug 03 05:21:24 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308c17a7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c'): ({'sdd'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Removing single pathed devices sdd {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 05:21:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8c273f-ba0d-4c7d-95cf-d7737ac6c4eb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fb28c5-ebd8-42ac-9fcb-8e9a05111ab9]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Flushing IO for device /dev/sdd {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c5fbc3-ce63-4bdd-8ee9-3b6a95fb45e3]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72444) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79b5950-045b-44a2-85e5-78ebceecf33c]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] SCSI volumes sdd have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG nova.compute.manager [req-ef13f741-f264-48d7-94ce-3a894b8753c4 req-31dbea2f-bbe3-4ccf-abc4-55ecab8ba1b0 service nova] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Received event network-vif-unplugged-79a5a765-6bb6-40a8-8a87-0cf8fc83049f {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ef13f741-f264-48d7-94ce-3a894b8753c4 req-31dbea2f-bbe3-4ccf-abc4-55ecab8ba1b0 service nova] Acquiring lock "fca2180e-32c1-4280-b8a4-6bafb2112d02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ef13f741-f264-48d7-94ce-3a894b8753c4 req-31dbea2f-bbe3-4ccf-abc4-55ecab8ba1b0 service nova] Lock "fca2180e-32c1-4280-b8a4-6bafb2112d02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ef13f741-f264-48d7-94ce-3a894b8753c4 req-31dbea2f-bbe3-4ccf-abc4-55ecab8ba1b0 service nova] Lock "fca2180e-32c1-4280-b8a4-6bafb2112d02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG nova.compute.manager [req-ef13f741-f264-48d7-94ce-3a894b8753c4 req-31dbea2f-bbe3-4ccf-abc4-55ecab8ba1b0 service nova] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] No waiting events found dispatching network-vif-unplugged-79a5a765-6bb6-40a8-8a87-0cf8fc83049f {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG nova.compute.manager [req-ef13f741-f264-48d7-94ce-3a894b8753c4 req-31dbea2f-bbe3-4ccf-abc4-55ecab8ba1b0 service nova] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Received event network-vif-unplugged-79a5a765-6bb6-40a8-8a87-0cf8fc83049f for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG nova.compute.manager [req-ef13f741-f264-48d7-94ce-3a894b8753c4 req-31dbea2f-bbe3-4ccf-abc4-55ecab8ba1b0 service nova] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Received event network-vif-plugged-79a5a765-6bb6-40a8-8a87-0cf8fc83049f {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ef13f741-f264-48d7-94ce-3a894b8753c4 req-31dbea2f-bbe3-4ccf-abc4-55ecab8ba1b0 service nova] Acquiring lock "fca2180e-32c1-4280-b8a4-6bafb2112d02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ef13f741-f264-48d7-94ce-3a894b8753c4 req-31dbea2f-bbe3-4ccf-abc4-55ecab8ba1b0 service nova] Lock "fca2180e-32c1-4280-b8a4-6bafb2112d02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ef13f741-f264-48d7-94ce-3a894b8753c4 req-31dbea2f-bbe3-4ccf-abc4-55ecab8ba1b0 service nova] Lock "fca2180e-32c1-4280-b8a4-6bafb2112d02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG nova.compute.manager [req-ef13f741-f264-48d7-94ce-3a894b8753c4 req-31dbea2f-bbe3-4ccf-abc4-55ecab8ba1b0 service nova] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] No waiting events found dispatching network-vif-plugged-79a5a765-6bb6-40a8-8a87-0cf8fc83049f {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:21:25 user nova-compute[72444]: WARNING nova.compute.manager [req-ef13f741-f264-48d7-94ce-3a894b8753c4 req-31dbea2f-bbe3-4ccf-abc4-55ecab8ba1b0 service nova] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Received unexpected event network-vif-plugged-79a5a765-6bb6-40a8-8a87-0cf8fc83049f for instance with vm_state active and task_state deleting.
Aug 03 05:21:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:21:25 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:21:25 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:21:25 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=8732MB free_disk=25.366928100585938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[93284d8d-f0f6-4444-b04e-c2847ce4b419]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efa3e9f-1676-44c3-b155-5cfd07de2d75]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c, portal: 172.16.0.220,3260]
Aug 03 05:21:25 user nova-compute[72444]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c, portal: 172.16.0.220,3260] successful.
Aug 03 05:21:25 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 2a778b55-8481-43cb-a628-b6c3c0690933 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance fca2180e-32c1-4280-b8a4-6bafb2112d02 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b7bc13-5c08-40f3-abd7-3567b07a875c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e8abb9-03ac-4dc6-91d6-0dacd82054c2]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.615s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] <== disconnect_volume: return (616ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 05:21:25 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Deleting instance files /opt/stack/data/nova/instances/fca2180e-32c1-4280-b8a4-6bafb2112d02_del
Aug 03 05:21:25 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Deletion of /opt/stack/data/nova/instances/fca2180e-32c1-4280-b8a4-6bafb2112d02_del complete
Aug 03 05:21:25 user nova-compute[72444]: INFO nova.compute.manager [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Took 1.47 seconds to destroy the instance on the hypervisor.
Aug 03 05:21:25 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:21:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.227s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:21:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:21:26 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:21:26 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Took 0.65 seconds to deallocate network for instance.
Aug 03 05:21:26 user nova-compute[72444]: DEBUG nova.compute.manager [req-a2a22255-96a2-48fd-ab3d-8dc2adc43bac req-acc3f680-b3b9-48a8-8885-1e139c969696 service nova] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Received event network-vif-deleted-79a5a765-6bb6-40a8-8a87-0cf8fc83049f {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:21:26 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:21:26 user nova-compute[72444]: INFO nova.compute.manager [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Took 0.74 seconds to detach 1 volumes for instance.
Aug 03 05:21:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:21:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:21:27 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:21:27 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:21:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.139s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:21:27 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Deleted allocations for instance fca2180e-32c1-4280-b8a4-6bafb2112d02
Aug 03 05:21:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-632987ec-fc5e-412e-9205-b02f6660899a tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "fca2180e-32c1-4280-b8a4-6bafb2112d02" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.211s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:21:28 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691040073.378004, 06bccfea-4a42-4880-8712-e9a7c0cd2a13 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:21:28 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] VM Stopped (Lifecycle Event)
Aug 03 05:21:28 user nova-compute[72444]: DEBUG nova.compute.manager [None req-753bc443-c93e-4477-9837-eedd87af0665 None None] [instance: 06bccfea-4a42-4880-8712-e9a7c0cd2a13] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:21:29 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:21:31 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:21:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:21:39 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691040084.8723166, fca2180e-32c1-4280-b8a4-6bafb2112d02 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:21:39 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] VM Stopped (Lifecycle Event)
Aug 03 05:21:39 user nova-compute[72444]: DEBUG nova.compute.manager [None req-9a5878e3-9e5d-4951-bb6c-d9f4d8029729 None None] [instance: fca2180e-32c1-4280-b8a4-6bafb2112d02] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:21:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:21:44 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:21:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:21:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:21:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:21:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:21:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:21:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:21:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:21:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:22:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:22:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "e191e075-3d24-4f6b-a612-a6c52baecc12" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:22:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "e191e075-3d24-4f6b-a612-a6c52baecc12" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:22:06 user nova-compute[72444]: DEBUG nova.compute.manager [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 05:22:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:22:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:22:06 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 05:22:06 user nova-compute[72444]: INFO nova.compute.claims [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Claim successful on node user
Aug 03 05:22:06 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:22:06 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:22:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.256s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:22:06 user nova-compute[72444]: DEBUG nova.compute.manager [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 05:22:06 user nova-compute[72444]: DEBUG nova.compute.manager [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 05:22:06 user nova-compute[72444]: DEBUG nova.network.neutron [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 05:22:06 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 05:22:06 user nova-compute[72444]: DEBUG nova.compute.manager [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 05:22:06 user nova-compute[72444]: DEBUG nova.policy [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '39ca6b589ce84537984e0df64b6085f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8210385d97453ab4befb159a457772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 05:22:06 user nova-compute[72444]: DEBUG nova.compute.manager [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 05:22:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 05:22:06 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Creating image(s)
Aug 03 05:22:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "/opt/stack/data/nova/instances/e191e075-3d24-4f6b-a612-a6c52baecc12/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:22:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "/opt/stack/data/nova/instances/e191e075-3d24-4f6b-a612-a6c52baecc12/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:22:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "/opt/stack/data/nova/instances/e191e075-3d24-4f6b-a612-a6c52baecc12/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:22:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:22:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.161s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:22:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:22:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:22:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:22:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.139s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:22:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/e191e075-3d24-4f6b-a612-a6c52baecc12/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:22:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/e191e075-3d24-4f6b-a612-a6c52baecc12/disk 1073741824" returned: 0 in 0.054s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:22:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:22:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:22:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.131s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:22:07 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e191e075-3d24-4f6b-a612-a6c52baecc12/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 05:22:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e191e075-3d24-4f6b-a612-a6c52baecc12/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:22:07 user nova-compute[72444]: DEBUG nova.network.neutron [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Successfully created port: 038a5198-3ba1-42e0-9dbf-6460cdb5f806 {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 05:22:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e191e075-3d24-4f6b-a612-a6c52baecc12/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:22:07 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Cannot resize image /opt/stack/data/nova/instances/e191e075-3d24-4f6b-a612-a6c52baecc12/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 05:22:07 user nova-compute[72444]: DEBUG nova.objects.instance [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lazy-loading 'migration_context' on Instance uuid e191e075-3d24-4f6b-a612-a6c52baecc12 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:22:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 05:22:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Ensure instance console log exists: /opt/stack/data/nova/instances/e191e075-3d24-4f6b-a612-a6c52baecc12/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 05:22:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:22:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:22:07 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:22:08 user nova-compute[72444]: DEBUG nova.network.neutron [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Successfully updated port: 038a5198-3ba1-42e0-9dbf-6460cdb5f806 {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 05:22:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "refresh_cache-e191e075-3d24-4f6b-a612-a6c52baecc12" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:22:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquired lock "refresh_cache-e191e075-3d24-4f6b-a612-a6c52baecc12" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:22:08 user nova-compute[72444]: DEBUG nova.network.neutron [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 05:22:08 user nova-compute[72444]: DEBUG nova.compute.manager [req-700b2b2e-412b-44a0-8ae6-c5dc562ca519 req-084d5e03-db70-46e1-b715-98cfa7b5f2d7 service nova] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Received event network-changed-038a5198-3ba1-42e0-9dbf-6460cdb5f806 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:22:08 user nova-compute[72444]: DEBUG nova.compute.manager [req-700b2b2e-412b-44a0-8ae6-c5dc562ca519 req-084d5e03-db70-46e1-b715-98cfa7b5f2d7 service nova] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Refreshing instance network info cache due to event network-changed-038a5198-3ba1-42e0-9dbf-6460cdb5f806. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:22:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-700b2b2e-412b-44a0-8ae6-c5dc562ca519 req-084d5e03-db70-46e1-b715-98cfa7b5f2d7 service nova] Acquiring lock "refresh_cache-e191e075-3d24-4f6b-a612-a6c52baecc12" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:22:08 user nova-compute[72444]: DEBUG nova.network.neutron [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG nova.network.neutron [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Updating instance_info_cache with network_info: [{"id": "038a5198-3ba1-42e0-9dbf-6460cdb5f806", "address": "fa:16:3e:03:c1:7e", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038a5198-3b", "ovs_interfaceid": "038a5198-3ba1-42e0-9dbf-6460cdb5f806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Releasing lock "refresh_cache-e191e075-3d24-4f6b-a612-a6c52baecc12" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG nova.compute.manager [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Instance network_info: |[{"id": "038a5198-3ba1-42e0-9dbf-6460cdb5f806", "address": "fa:16:3e:03:c1:7e", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038a5198-3b", "ovs_interfaceid": "038a5198-3ba1-42e0-9dbf-6460cdb5f806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-700b2b2e-412b-44a0-8ae6-c5dc562ca519 req-084d5e03-db70-46e1-b715-98cfa7b5f2d7 service nova] Acquired lock "refresh_cache-e191e075-3d24-4f6b-a612-a6c52baecc12" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG nova.network.neutron [req-700b2b2e-412b-44a0-8ae6-c5dc562ca519 req-084d5e03-db70-46e1-b715-98cfa7b5f2d7 service nova] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Refreshing network info cache for port 038a5198-3ba1-42e0-9dbf-6460cdb5f806 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Start _get_guest_xml network_info=[{"id": "038a5198-3ba1-42e0-9dbf-6460cdb5f806", "address": "fa:16:3e:03:c1:7e", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038a5198-3b", "ovs_interfaceid": "038a5198-3ba1-42e0-9dbf-6460cdb5f806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 05:22:09 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:22:09 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:22:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:22:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1161148507',display_name='tempest-AttachVolumeNegativeTest-server-1161148507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1161148507',id=50,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjBdBWWjQuxFFrT/YucPKTZebKAo9Hwh6uF3VWNqAJMfTYNB1IdfpObgv+mlOIrviEK1GcXGVui4FuTr1NmAf1R0xe6kCzy1gWJrjF2UUO4zd8O5mPC0EZM49KsuvT8aw==',key_name='tempest-keypair-1966542089',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d8210385d97453ab4befb159a457772',ramdisk_id='',reservation_id='r-dabexfde',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1998464271',owner_user_name='tempest-AttachVolumeNegativeTest-1998464271-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:22:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39ca6b589ce84537984e0df64b6085f3',uuid=e191e075-3d24-4f6b-a612-a6c52baecc12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "038a5198-3ba1-42e0-9dbf-6460cdb5f806", "address": "fa:16:3e:03:c1:7e", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038a5198-3b", "ovs_interfaceid": "038a5198-3ba1-42e0-9dbf-6460cdb5f806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Converting VIF {"id": "038a5198-3ba1-42e0-9dbf-6460cdb5f806", "address": "fa:16:3e:03:c1:7e", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038a5198-3b", "ovs_interfaceid": "038a5198-3ba1-42e0-9dbf-6460cdb5f806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:c1:7e,bridge_name='br-int',has_traffic_filtering=True,id=038a5198-3ba1-42e0-9dbf-6460cdb5f806,network=Network(9605cf27-7ef3-4664-97b1-a6e1d093ce98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038a5198-3b') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG nova.objects.instance [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lazy-loading 'pci_devices' on Instance uuid e191e075-3d24-4f6b-a612-a6c52baecc12 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] End _get_guest_xml xml=<domain type="kvm">
Aug 03 05:22:09 user nova-compute[72444]:   <uuid>e191e075-3d24-4f6b-a612-a6c52baecc12</uuid>
Aug 03 05:22:09 user nova-compute[72444]:   <name>instance-00000032</name>
Aug 03 05:22:09 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 05:22:09 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 05:22:09 user nova-compute[72444]:   <metadata>
Aug 03 05:22:09 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 05:22:09 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 05:22:09 user nova-compute[72444]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1161148507</nova:name>
Aug 03 05:22:09 user nova-compute[72444]:       <nova:creationTime>2023-08-03 05:22:09</nova:creationTime>
Aug 03 05:22:09 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 05:22:09 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 05:22:09 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 05:22:09 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 05:22:09 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 05:22:09 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 05:22:09 user nova-compute[72444]:       </nova:flavor>
Aug 03 05:22:09 user nova-compute[72444]:       <nova:owner>
Aug 03 05:22:09 user nova-compute[72444]:         <nova:user uuid="39ca6b589ce84537984e0df64b6085f3">tempest-AttachVolumeNegativeTest-1998464271-project-member</nova:user>
Aug 03 05:22:09 user nova-compute[72444]:         <nova:project uuid="9d8210385d97453ab4befb159a457772">tempest-AttachVolumeNegativeTest-1998464271</nova:project>
Aug 03 05:22:09 user nova-compute[72444]:       </nova:owner>
Aug 03 05:22:09 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 05:22:09 user nova-compute[72444]:       <nova:ports>
Aug 03 05:22:09 user nova-compute[72444]:         <nova:port uuid="038a5198-3ba1-42e0-9dbf-6460cdb5f806">
Aug 03 05:22:09 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 03 05:22:09 user nova-compute[72444]:         </nova:port>
Aug 03 05:22:09 user nova-compute[72444]:       </nova:ports>
Aug 03 05:22:09 user nova-compute[72444]:     </nova:instance>
Aug 03 05:22:09 user nova-compute[72444]:   </metadata>
Aug 03 05:22:09 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 05:22:09 user nova-compute[72444]:     <system>
Aug 03 05:22:09 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 05:22:09 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 05:22:09 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 05:22:09 user nova-compute[72444]:       <entry name="serial">e191e075-3d24-4f6b-a612-a6c52baecc12</entry>
Aug 03 05:22:09 user nova-compute[72444]:       <entry name="uuid">e191e075-3d24-4f6b-a612-a6c52baecc12</entry>
Aug 03 05:22:09 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 05:22:09 user nova-compute[72444]:     </system>
Aug 03 05:22:09 user nova-compute[72444]:   </sysinfo>
Aug 03 05:22:09 user nova-compute[72444]:   <os>
Aug 03 05:22:09 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 05:22:09 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 05:22:09 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 05:22:09 user nova-compute[72444]:   </os>
Aug 03 05:22:09 user nova-compute[72444]:   <features>
Aug 03 05:22:09 user nova-compute[72444]:     <acpi/>
Aug 03 05:22:09 user nova-compute[72444]:     <apic/>
Aug 03 05:22:09 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 05:22:09 user nova-compute[72444]:   </features>
Aug 03 05:22:09 user nova-compute[72444]:   <clock offset="utc">
Aug 03 05:22:09 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 05:22:09 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 05:22:09 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 05:22:09 user nova-compute[72444]:   </clock>
Aug 03 05:22:09 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 05:22:09 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 05:22:09 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 05:22:09 user nova-compute[72444]:   </cpu>
Aug 03 05:22:09 user nova-compute[72444]:   <devices>
Aug 03 05:22:09 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 05:22:09 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 05:22:09 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/e191e075-3d24-4f6b-a612-a6c52baecc12/disk"/>
Aug 03 05:22:09 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 05:22:09 user nova-compute[72444]:     </disk>
Aug 03 05:22:09 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 05:22:09 user nova-compute[72444]:       <mac address="fa:16:3e:03:c1:7e"/>
Aug 03 05:22:09 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:22:09 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 05:22:09 user nova-compute[72444]:       <target dev="tap038a5198-3b"/>
Aug 03 05:22:09 user nova-compute[72444]:     </interface>
Aug 03 05:22:09 user nova-compute[72444]:     <serial type="pty">
Aug 03 05:22:09 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/e191e075-3d24-4f6b-a612-a6c52baecc12/console.log" append="off"/>
Aug 03 05:22:09 user nova-compute[72444]:     </serial>
Aug 03 05:22:09 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 05:22:09 user nova-compute[72444]:     <video>
Aug 03 05:22:09 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:22:09 user nova-compute[72444]:     </video>
Aug 03 05:22:09 user nova-compute[72444]:     <rng model="virtio">
Aug 03 05:22:09 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 05:22:09 user nova-compute[72444]:     </rng>
Aug 03 05:22:09 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 05:22:09 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 05:22:09 user nova-compute[72444]:       <stats period="10"/>
Aug 03 05:22:09 user nova-compute[72444]:     </memballoon>
Aug 03 05:22:09 user nova-compute[72444]:   </devices>
Aug 03 05:22:09 user nova-compute[72444]: </domain>
Aug 03 05:22:09 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:22:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1161148507',display_name='tempest-AttachVolumeNegativeTest-server-1161148507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1161148507',id=50,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjBdBWWjQuxFFrT/YucPKTZebKAo9Hwh6uF3VWNqAJMfTYNB1IdfpObgv+mlOIrviEK1GcXGVui4FuTr1NmAf1R0xe6kCzy1gWJrjF2UUO4zd8O5mPC0EZM49KsuvT8aw==',key_name='tempest-keypair-1966542089',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d8210385d97453ab4befb159a457772',ramdisk_id='',reservation_id='r-dabexfde',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1998464271',owner_user_name='tempest-AttachVolumeNegativeTest-1998464271-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:22:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39ca6b589ce84537984e0df64b6085f3',uuid=e191e075-3d24-4f6b-a612-a6c52baecc12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "038a5198-3ba1-42e0-9dbf-6460cdb5f806", "address": "fa:16:3e:03:c1:7e", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038a5198-3b", "ovs_interfaceid": "038a5198-3ba1-42e0-9dbf-6460cdb5f806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Converting VIF {"id": "038a5198-3ba1-42e0-9dbf-6460cdb5f806", "address": "fa:16:3e:03:c1:7e", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038a5198-3b", "ovs_interfaceid": "038a5198-3ba1-42e0-9dbf-6460cdb5f806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:c1:7e,bridge_name='br-int',has_traffic_filtering=True,id=038a5198-3ba1-42e0-9dbf-6460cdb5f806,network=Network(9605cf27-7ef3-4664-97b1-a6e1d093ce98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038a5198-3b') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG os_vif [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:c1:7e,bridge_name='br-int',has_traffic_filtering=True,id=038a5198-3ba1-42e0-9dbf-6460cdb5f806,network=Network(9605cf27-7ef3-4664-97b1-a6e1d093ce98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038a5198-3b') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap038a5198-3b, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap038a5198-3b, col_values=(('external_ids', {'iface-id': '038a5198-3ba1-42e0-9dbf-6460cdb5f806', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:c1:7e', 'vm-uuid': 'e191e075-3d24-4f6b-a612-a6c52baecc12'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:22:09 user nova-compute[72444]: INFO os_vif [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:c1:7e,bridge_name='br-int',has_traffic_filtering=True,id=038a5198-3ba1-42e0-9dbf-6460cdb5f806,network=Network(9605cf27-7ef3-4664-97b1-a6e1d093ce98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038a5198-3b')
Aug 03 05:22:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] No VIF found with MAC fa:16:3e:03:c1:7e, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG nova.network.neutron [req-700b2b2e-412b-44a0-8ae6-c5dc562ca519 req-084d5e03-db70-46e1-b715-98cfa7b5f2d7 service nova] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Updated VIF entry in instance network info cache for port 038a5198-3ba1-42e0-9dbf-6460cdb5f806. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG nova.network.neutron [req-700b2b2e-412b-44a0-8ae6-c5dc562ca519 req-084d5e03-db70-46e1-b715-98cfa7b5f2d7 service nova] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Updating instance_info_cache with network_info: [{"id": "038a5198-3ba1-42e0-9dbf-6460cdb5f806", "address": "fa:16:3e:03:c1:7e", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038a5198-3b", "ovs_interfaceid": "038a5198-3ba1-42e0-9dbf-6460cdb5f806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:22:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-700b2b2e-412b-44a0-8ae6-c5dc562ca519 req-084d5e03-db70-46e1-b715-98cfa7b5f2d7 service nova] Releasing lock "refresh_cache-e191e075-3d24-4f6b-a612-a6c52baecc12" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:22:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:22:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:22:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:22:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:22:10 user nova-compute[72444]: DEBUG nova.compute.manager [req-ac04e6e1-3d3f-498b-9283-667f6ee2e4e5 req-c62fab14-ee65-499d-a300-e569f0e8451e service nova] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Received event network-vif-plugged-038a5198-3ba1-42e0-9dbf-6460cdb5f806 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:22:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ac04e6e1-3d3f-498b-9283-667f6ee2e4e5 req-c62fab14-ee65-499d-a300-e569f0e8451e service nova] Acquiring lock "e191e075-3d24-4f6b-a612-a6c52baecc12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:22:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ac04e6e1-3d3f-498b-9283-667f6ee2e4e5 req-c62fab14-ee65-499d-a300-e569f0e8451e service nova] Lock "e191e075-3d24-4f6b-a612-a6c52baecc12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:22:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ac04e6e1-3d3f-498b-9283-667f6ee2e4e5 req-c62fab14-ee65-499d-a300-e569f0e8451e service nova] Lock "e191e075-3d24-4f6b-a612-a6c52baecc12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:22:10 user nova-compute[72444]: DEBUG nova.compute.manager [req-ac04e6e1-3d3f-498b-9283-667f6ee2e4e5 req-c62fab14-ee65-499d-a300-e569f0e8451e service nova] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] No waiting events found dispatching network-vif-plugged-038a5198-3ba1-42e0-9dbf-6460cdb5f806 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:22:10 user nova-compute[72444]: WARNING nova.compute.manager [req-ac04e6e1-3d3f-498b-9283-667f6ee2e4e5 req-c62fab14-ee65-499d-a300-e569f0e8451e service nova] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Received unexpected event network-vif-plugged-038a5198-3ba1-42e0-9dbf-6460cdb5f806 for instance with vm_state building and task_state spawning.
Aug 03 05:22:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:22:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:22:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:22:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:22:12 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691040132.6469543, e191e075-3d24-4f6b-a612-a6c52baecc12 => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:22:12 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] VM Resumed (Lifecycle Event)
Aug 03 05:22:12 user nova-compute[72444]: DEBUG nova.compute.manager [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 05:22:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 05:22:12 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Instance spawned successfully.
Aug 03 05:22:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 05:22:12 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:22:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:22:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:22:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:22:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:22:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:22:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:22:12 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:22:12 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 05:22:12 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691040132.6477947, e191e075-3d24-4f6b-a612-a6c52baecc12 => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:22:12 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] VM Started (Lifecycle Event)
Aug 03 05:22:12 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:22:12 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:22:12 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 05:22:12 user nova-compute[72444]: INFO nova.compute.manager [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Took 6.00 seconds to spawn the instance on the hypervisor.
Aug 03 05:22:12 user nova-compute[72444]: DEBUG nova.compute.manager [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:22:12 user nova-compute[72444]: DEBUG nova.compute.manager [req-06810ba2-843c-4ba5-bc96-4e349c920d2c req-f5e2b38e-ea5c-4bfb-bbbb-ab4788b3d79b service nova] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Received event network-vif-plugged-038a5198-3ba1-42e0-9dbf-6460cdb5f806 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:22:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-06810ba2-843c-4ba5-bc96-4e349c920d2c req-f5e2b38e-ea5c-4bfb-bbbb-ab4788b3d79b service nova] Acquiring lock "e191e075-3d24-4f6b-a612-a6c52baecc12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:22:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-06810ba2-843c-4ba5-bc96-4e349c920d2c req-f5e2b38e-ea5c-4bfb-bbbb-ab4788b3d79b service nova] Lock "e191e075-3d24-4f6b-a612-a6c52baecc12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:22:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-06810ba2-843c-4ba5-bc96-4e349c920d2c req-f5e2b38e-ea5c-4bfb-bbbb-ab4788b3d79b service nova] Lock "e191e075-3d24-4f6b-a612-a6c52baecc12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:22:12 user nova-compute[72444]: DEBUG nova.compute.manager [req-06810ba2-843c-4ba5-bc96-4e349c920d2c req-f5e2b38e-ea5c-4bfb-bbbb-ab4788b3d79b service nova] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] No waiting events found dispatching network-vif-plugged-038a5198-3ba1-42e0-9dbf-6460cdb5f806 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:22:12 user nova-compute[72444]: WARNING nova.compute.manager [req-06810ba2-843c-4ba5-bc96-4e349c920d2c req-f5e2b38e-ea5c-4bfb-bbbb-ab4788b3d79b service nova] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Received unexpected event network-vif-plugged-038a5198-3ba1-42e0-9dbf-6460cdb5f806 for instance with vm_state building and task_state spawning.
Aug 03 05:22:12 user nova-compute[72444]: INFO nova.compute.manager [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Took 6.60 seconds to build instance.
Aug 03 05:22:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-652955d9-17ea-4bfb-b5db-0a553bf60be3 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "e191e075-3d24-4f6b-a612-a6c52baecc12" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.692s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:22:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:22:14 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:22:14 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:22:14 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Cleaning up deleted instances {{(pid=72444) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 03 05:22:14 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] There are 0 instances to clean {{(pid=72444) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 03 05:22:15 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:22:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:22:16 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:22:19 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:22:21 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:22:21 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 05:22:22 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:22:22 user nova-compute[72444]: DEBUG nova.compute.manager [req-d13fd772-ff91-4fc1-bd6d-aed9178c2d4f req-dd7ff65f-c45f-431f-8210-8cd8ccb9226b service nova] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Received event network-changed-d9d18ac0-7b2c-4672-8b38-c792c15fb294 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:22:22 user nova-compute[72444]: DEBUG nova.compute.manager [req-d13fd772-ff91-4fc1-bd6d-aed9178c2d4f req-dd7ff65f-c45f-431f-8210-8cd8ccb9226b service nova] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Refreshing instance network info cache due to event network-changed-d9d18ac0-7b2c-4672-8b38-c792c15fb294. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:22:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d13fd772-ff91-4fc1-bd6d-aed9178c2d4f req-dd7ff65f-c45f-431f-8210-8cd8ccb9226b service nova] Acquiring lock "refresh_cache-2a778b55-8481-43cb-a628-b6c3c0690933" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:22:22 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d13fd772-ff91-4fc1-bd6d-aed9178c2d4f req-dd7ff65f-c45f-431f-8210-8cd8ccb9226b service nova] Acquired lock "refresh_cache-2a778b55-8481-43cb-a628-b6c3c0690933" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:22:22 user nova-compute[72444]: DEBUG nova.network.neutron [req-d13fd772-ff91-4fc1-bd6d-aed9178c2d4f req-dd7ff65f-c45f-431f-8210-8cd8ccb9226b service nova] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Refreshing network info cache for port d9d18ac0-7b2c-4672-8b38-c792c15fb294 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "2a778b55-8481-43cb-a628-b6c3c0690933" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "2a778b55-8481-43cb-a628-b6c3c0690933" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "2a778b55-8481-43cb-a628-b6c3c0690933-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "2a778b55-8481-43cb-a628-b6c3c0690933-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "2a778b55-8481-43cb-a628-b6c3c0690933-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:22:23 user nova-compute[72444]: INFO nova.compute.manager [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Terminating instance
Aug 03 05:22:23 user nova-compute[72444]: DEBUG nova.compute.manager [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Didn't find any instances for network info cache update. {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG nova.network.neutron [req-d13fd772-ff91-4fc1-bd6d-aed9178c2d4f req-dd7ff65f-c45f-431f-8210-8cd8ccb9226b service nova] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Updated VIF entry in instance network info cache for port d9d18ac0-7b2c-4672-8b38-c792c15fb294. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG nova.network.neutron [req-d13fd772-ff91-4fc1-bd6d-aed9178c2d4f req-dd7ff65f-c45f-431f-8210-8cd8ccb9226b service nova] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Updating instance_info_cache with network_info: [{"id": "d9d18ac0-7b2c-4672-8b38-c792c15fb294", "address": "fa:16:3e:af:09:a0", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d18ac0-7b", "ovs_interfaceid": "d9d18ac0-7b2c-4672-8b38-c792c15fb294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-d13fd772-ff91-4fc1-bd6d-aed9178c2d4f req-dd7ff65f-c45f-431f-8210-8cd8ccb9226b service nova] Releasing lock "refresh_cache-2a778b55-8481-43cb-a628-b6c3c0690933" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:22:23 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Instance destroyed successfully.
Aug 03 05:22:23 user nova-compute[72444]: DEBUG nova.objects.instance [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lazy-loading 'resources' on Instance uuid 2a778b55-8481-43cb-a628-b6c3c0690933 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:17:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2013951057',display_name='tempest-TestVolumeBootPattern-server-2013951057',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2013951057',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJb/ucac2bYqYTTpUwHVlINSI4Sfb+N0MYWJk4BUfIgi24wGpfawX18lRHaBUwUNuvA9BvzcrJArj3JZ6r/WP+myl5DP/2VX4xcdyXqMaH1gGJv8NyGzE7tn1ggSM7aa7A==',key_name='tempest-TestVolumeBootPattern-1711073489',keypairs=<?>,launch_index=0,launched_at=2023-08-03T05:17:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae931112fcda4e2f8dfd4f540d905139',ramdisk_id='',reservation_id='r-ib50cllz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1788747136',owner_user_name='tempest-TestVolumeBootPattern-1788747136-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T05:17:44Z,user_data=None,user_id='ef4d8130e33c4d9ea44c29be12f18234',uuid=2a778b55-8481-43cb-a628-b6c3c0690933,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9d18ac0-7b2c-4672-8b38-c792c15fb294", "address": "fa:16:3e:af:09:a0", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d18ac0-7b", "ovs_interfaceid": "d9d18ac0-7b2c-4672-8b38-c792c15fb294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Converting VIF {"id": "d9d18ac0-7b2c-4672-8b38-c792c15fb294", "address": "fa:16:3e:af:09:a0", "network": {"id": "5fa8a372-7243-4ca9-8b95-a33ce138eb9c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-431635867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae931112fcda4e2f8dfd4f540d905139", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d18ac0-7b", "ovs_interfaceid": "d9d18ac0-7b2c-4672-8b38-c792c15fb294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:09:a0,bridge_name='br-int',has_traffic_filtering=True,id=d9d18ac0-7b2c-4672-8b38-c792c15fb294,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9d18ac0-7b') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG os_vif [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:09:a0,bridge_name='br-int',has_traffic_filtering=True,id=d9d18ac0-7b2c-4672-8b38-c792c15fb294,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9d18ac0-7b') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9d18ac0-7b, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:22:23 user nova-compute[72444]: INFO os_vif [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:09:a0,bridge_name='br-int',has_traffic_filtering=True,id=d9d18ac0-7b2c-4672-8b38-c792c15fb294,network=Network(5fa8a372-7243-4ca9-8b95-a33ce138eb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9d18ac0-7b')
Aug 03 05:22:23 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDySbitl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:22:23 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:22:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ce16a1-901e-4839-905f-568e6101730c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a91ce0-d9f1-4e72-8fb7-2e8aee638c59]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed (non-flash)
Aug 03 05:22:23 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed (non-flash)
Aug 03 05:22:23 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308c15b250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed'): ({'sdc'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Removing single pathed devices sdc {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3853fd17-a858-4121-957d-9d368dbb88b7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8e9a13-068b-427a-aebb-d43adbb26b84]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Flushing IO for device /dev/sdc {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 05:22:23 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ffdcd2-70e9-4139-b6cf-3b5137ea7d25]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.031s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6006fa-a18d-4b58-974c-46e6a9900ffa]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] SCSI volumes sdc have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO1607314b-51b20e3ba7842e48', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_1607314b', '/dev/disk/by-id/scsi-23531623230653362') {{(pid=84280) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[26210cf5-6476-4d0b-9f6d-2884010a4bc0]: (4, None) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa53ae8-335f-405a-901c-b570eed5daeb]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff2379f-656b-42e7-8cf7-6f369821d51d]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed, portal: 172.16.0.220,3260]
Aug 03 05:22:24 user nova-compute[72444]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed, portal: 172.16.0.220,3260] successful.
Aug 03 05:22:24 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eeb498c-9c47-4bd7-96cf-95f826712fed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62df9c2-da3c-44ae-92d1-5f0aea78601e]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] <== disconnect_volume: return (269ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 05:22:24 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Deleting instance files /opt/stack/data/nova/instances/2a778b55-8481-43cb-a628-b6c3c0690933_del
Aug 03 05:22:24 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Deletion of /opt/stack/data/nova/instances/2a778b55-8481-43cb-a628-b6c3c0690933_del complete
Aug 03 05:22:24 user nova-compute[72444]: INFO nova.compute.manager [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 03 05:22:24 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:22:24 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Took 0.44 seconds to deallocate network for instance.
Aug 03 05:22:24 user nova-compute[72444]: DEBUG nova.compute.manager [req-393f542a-6b76-4362-a713-2e698034b0ba req-c79c4562-d017-48ec-9d59-944738aa80e4 service nova] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Received event network-vif-deleted-d9d18ac0-7b2c-4672-8b38-c792c15fb294 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:22:24 user nova-compute[72444]: INFO nova.compute.manager [req-393f542a-6b76-4362-a713-2e698034b0ba req-c79c4562-d017-48ec-9d59-944738aa80e4 service nova] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Neutron deleted interface d9d18ac0-7b2c-4672-8b38-c792c15fb294; detaching it from the instance and deleting it from the info cache
Aug 03 05:22:24 user nova-compute[72444]: DEBUG nova.network.neutron [req-393f542a-6b76-4362-a713-2e698034b0ba req-c79c4562-d017-48ec-9d59-944738aa80e4 service nova] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG nova.compute.manager [req-393f542a-6b76-4362-a713-2e698034b0ba req-c79c4562-d017-48ec-9d59-944738aa80e4 service nova] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Detach interface failed, port_id=d9d18ac0-7b2c-4672-8b38-c792c15fb294, reason: Instance 2a778b55-8481-43cb-a628-b6c3c0690933 could not be found. {{(pid=72444) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG nova.compute.manager [req-e22a9733-07be-4029-afa0-33b37fd24eb4 req-2feecaed-eb47-425b-99ad-fdf5440e7443 service nova] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Received event network-vif-unplugged-d9d18ac0-7b2c-4672-8b38-c792c15fb294 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e22a9733-07be-4029-afa0-33b37fd24eb4 req-2feecaed-eb47-425b-99ad-fdf5440e7443 service nova] Acquiring lock "2a778b55-8481-43cb-a628-b6c3c0690933-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e22a9733-07be-4029-afa0-33b37fd24eb4 req-2feecaed-eb47-425b-99ad-fdf5440e7443 service nova] Lock "2a778b55-8481-43cb-a628-b6c3c0690933-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e22a9733-07be-4029-afa0-33b37fd24eb4 req-2feecaed-eb47-425b-99ad-fdf5440e7443 service nova] Lock "2a778b55-8481-43cb-a628-b6c3c0690933-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG nova.compute.manager [req-e22a9733-07be-4029-afa0-33b37fd24eb4 req-2feecaed-eb47-425b-99ad-fdf5440e7443 service nova] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] No waiting events found dispatching network-vif-unplugged-d9d18ac0-7b2c-4672-8b38-c792c15fb294 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG nova.compute.manager [req-e22a9733-07be-4029-afa0-33b37fd24eb4 req-2feecaed-eb47-425b-99ad-fdf5440e7443 service nova] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Received event network-vif-unplugged-d9d18ac0-7b2c-4672-8b38-c792c15fb294 for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG nova.compute.manager [req-e22a9733-07be-4029-afa0-33b37fd24eb4 req-2feecaed-eb47-425b-99ad-fdf5440e7443 service nova] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Received event network-vif-plugged-d9d18ac0-7b2c-4672-8b38-c792c15fb294 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e22a9733-07be-4029-afa0-33b37fd24eb4 req-2feecaed-eb47-425b-99ad-fdf5440e7443 service nova] Acquiring lock "2a778b55-8481-43cb-a628-b6c3c0690933-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e22a9733-07be-4029-afa0-33b37fd24eb4 req-2feecaed-eb47-425b-99ad-fdf5440e7443 service nova] Lock "2a778b55-8481-43cb-a628-b6c3c0690933-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-e22a9733-07be-4029-afa0-33b37fd24eb4 req-2feecaed-eb47-425b-99ad-fdf5440e7443 service nova] Lock "2a778b55-8481-43cb-a628-b6c3c0690933-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG nova.compute.manager [req-e22a9733-07be-4029-afa0-33b37fd24eb4 req-2feecaed-eb47-425b-99ad-fdf5440e7443 service nova] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] No waiting events found dispatching network-vif-plugged-d9d18ac0-7b2c-4672-8b38-c792c15fb294 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:22:24 user nova-compute[72444]: WARNING nova.compute.manager [req-e22a9733-07be-4029-afa0-33b37fd24eb4 req-2feecaed-eb47-425b-99ad-fdf5440e7443 service nova] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Received unexpected event network-vif-plugged-d9d18ac0-7b2c-4672-8b38-c792c15fb294 for instance with vm_state active and task_state deleting.
Aug 03 05:22:24 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:22:24 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:22:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e191e075-3d24-4f6b-a612-a6c52baecc12/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:22:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e191e075-3d24-4f6b-a612-a6c52baecc12/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:22:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e191e075-3d24-4f6b-a612-a6c52baecc12/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:22:25 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e191e075-3d24-4f6b-a612-a6c52baecc12/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:22:25 user nova-compute[72444]: INFO nova.compute.manager [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Took 1.00 seconds to detach 1 volumes for instance.
Aug 03 05:22:25 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:22:25 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:22:25 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=8665MB free_disk=25.364490509033203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:22:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:22:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:22:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:22:25 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 2a778b55-8481-43cb-a628-b6c3c0690933 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:22:25 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance e191e075-3d24-4f6b-a612-a6c52baecc12 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:22:25 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:22:25 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:22:25 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Refreshing inventories for resource provider b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 03 05:22:25 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Updating ProviderTree inventory for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 03 05:22:25 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Updating inventory in ProviderTree for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 03 05:22:25 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Refreshing aggregate associations for resource provider b624a913-bb6b-4a17-8cd7-7b0950cff161, aggregates: None {{(pid=72444) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 03 05:22:25 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Refreshing trait associations for resource provider b624a913-bb6b-4a17-8cd7-7b0950cff161, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=72444) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 03 05:22:26 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:22:26 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:22:26 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:22:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.373s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:22:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.337s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:22:26 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:22:26 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:22:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:22:26 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Deleted allocations for instance 2a778b55-8481-43cb-a628-b6c3c0690933
Aug 03 05:22:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-bbcfa93d-587d-419a-8e2a-9f61f721c37f tempest-TestVolumeBootPattern-1788747136 tempest-TestVolumeBootPattern-1788747136-project-member] Lock "2a778b55-8481-43cb-a628-b6c3c0690933" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.260s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:22:27 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:22:27 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:22:27 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:22:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:22:29 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:22:29 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72444) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 03 05:22:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:22:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:22:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:22:38 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691040143.847869, 2a778b55-8481-43cb-a628-b6c3c0690933 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:22:38 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] VM Stopped (Lifecycle Event)
Aug 03 05:22:38 user nova-compute[72444]: DEBUG nova.compute.manager [None req-811de606-e1d2-4ef7-85c6-a2025a6b1e0f None None] [instance: 2a778b55-8481-43cb-a628-b6c3c0690933] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:22:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:22:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:22:43 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:22:48 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:22:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:22:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:23:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:23:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:23:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:23:16 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:23:17 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:23:18 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:23:18 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:23:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:23:22 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:23:22 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 05:23:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:23:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:23:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:23:24 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:23:24 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:23:24 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Rebuilding the list of instances to heal {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 05:23:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-e191e075-3d24-4f6b-a612-a6c52baecc12" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:23:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-e191e075-3d24-4f6b-a612-a6c52baecc12" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:23:25 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 05:23:25 user nova-compute[72444]: DEBUG nova.objects.instance [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lazy-loading 'info_cache' on Instance uuid e191e075-3d24-4f6b-a612-a6c52baecc12 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:23:25 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Updating instance_info_cache with network_info: [{"id": "038a5198-3ba1-42e0-9dbf-6460cdb5f806", "address": "fa:16:3e:03:c1:7e", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038a5198-3b", "ovs_interfaceid": "038a5198-3ba1-42e0-9dbf-6460cdb5f806", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:23:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-e191e075-3d24-4f6b-a612-a6c52baecc12" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:23:25 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 05:23:25 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:23:25 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:23:25 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:23:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:23:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:23:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:23:25 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:23:26 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e191e075-3d24-4f6b-a612-a6c52baecc12/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:23:26 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e191e075-3d24-4f6b-a612-a6c52baecc12/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:23:26 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e191e075-3d24-4f6b-a612-a6c52baecc12/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:23:26 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e191e075-3d24-4f6b-a612-a6c52baecc12/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:23:26 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:23:26 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:23:26 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=8733MB free_disk=25.335472106933594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:23:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:23:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:23:26 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance e191e075-3d24-4f6b-a612-a6c52baecc12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:23:26 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:23:26 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:23:26 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:23:26 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:23:26 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:23:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.214s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:23:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:23:29 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:23:32 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:23:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:23:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:23:43 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:23:48 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:23:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:23:57 user nova-compute[72444]: DEBUG nova.compute.manager [req-04b77493-49aa-4c54-9026-1e2c7df285cf req-3b3f3fd6-ff31-46c0-bec7-a49203696169 service nova] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Received event network-changed-038a5198-3ba1-42e0-9dbf-6460cdb5f806 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:23:57 user nova-compute[72444]: DEBUG nova.compute.manager [req-04b77493-49aa-4c54-9026-1e2c7df285cf req-3b3f3fd6-ff31-46c0-bec7-a49203696169 service nova] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Refreshing instance network info cache due to event network-changed-038a5198-3ba1-42e0-9dbf-6460cdb5f806. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:23:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-04b77493-49aa-4c54-9026-1e2c7df285cf req-3b3f3fd6-ff31-46c0-bec7-a49203696169 service nova] Acquiring lock "refresh_cache-e191e075-3d24-4f6b-a612-a6c52baecc12" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:23:57 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-04b77493-49aa-4c54-9026-1e2c7df285cf req-3b3f3fd6-ff31-46c0-bec7-a49203696169 service nova] Acquired lock "refresh_cache-e191e075-3d24-4f6b-a612-a6c52baecc12" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:23:57 user nova-compute[72444]: DEBUG nova.network.neutron [req-04b77493-49aa-4c54-9026-1e2c7df285cf req-3b3f3fd6-ff31-46c0-bec7-a49203696169 service nova] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Refreshing network info cache for port 038a5198-3ba1-42e0-9dbf-6460cdb5f806 {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:23:58 user nova-compute[72444]: DEBUG nova.network.neutron [req-04b77493-49aa-4c54-9026-1e2c7df285cf req-3b3f3fd6-ff31-46c0-bec7-a49203696169 service nova] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Updated VIF entry in instance network info cache for port 038a5198-3ba1-42e0-9dbf-6460cdb5f806. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:23:58 user nova-compute[72444]: DEBUG nova.network.neutron [req-04b77493-49aa-4c54-9026-1e2c7df285cf req-3b3f3fd6-ff31-46c0-bec7-a49203696169 service nova] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Updating instance_info_cache with network_info: [{"id": "038a5198-3ba1-42e0-9dbf-6460cdb5f806", "address": "fa:16:3e:03:c1:7e", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038a5198-3b", "ovs_interfaceid": "038a5198-3ba1-42e0-9dbf-6460cdb5f806", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:23:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-04b77493-49aa-4c54-9026-1e2c7df285cf req-3b3f3fd6-ff31-46c0-bec7-a49203696169 service nova] Releasing lock "refresh_cache-e191e075-3d24-4f6b-a612-a6c52baecc12" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:23:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:24:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:24:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "e191e075-3d24-4f6b-a612-a6c52baecc12" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:24:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "e191e075-3d24-4f6b-a612-a6c52baecc12" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:24:01 user nova-compute[72444]: DEBUG nova.objects.instance [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lazy-loading 'flavor' on Instance uuid e191e075-3d24-4f6b-a612-a6c52baecc12 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:24:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "e191e075-3d24-4f6b-a612-a6c52baecc12" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:24:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "e191e075-3d24-4f6b-a612-a6c52baecc12" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:24:01 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "e191e075-3d24-4f6b-a612-a6c52baecc12" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:24:01 user nova-compute[72444]: INFO nova.compute.manager [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Attaching volume 04d4f4a7-64da-4367-b310-20d65141a4a5 to /dev/vdb
Aug 03 05:24:01 user nova-compute[72444]: DEBUG os_brick.utils [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:24:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:24:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:24:01 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec201db7-cf5e-434f-b40f-b94a97f504f8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:24:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:24:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:24:01 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[52938201-8447-48a3-a2df-20d231128390]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:24:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:24:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:24:01 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10d4c74-9f41-445f-b025-a16ef453418c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:24:01 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc6739a-5225-4fb4-8aea-516af2182a25]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:24:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:24:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:24:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 05:24:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:24:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:24:01 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 05:24:01 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6740e1cf-03e0-4647-9cbc-4582498e5904]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:24:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 05:24:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 05:24:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 05:24:01 user nova-compute[72444]: DEBUG os_brick.utils [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:24:01 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Updating existing volume attachment record: 0cde4f50-3e83-435a-8310-fb90dde5a5e9 {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 05:24:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:24:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:24:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:24:13 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NOxQDpoC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:24:15 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:24:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:24:15 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:24:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:24:15 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 05:24:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[47625183-8547-40a2-9581-fd6dc2178501]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 05:24:15 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c012bf-93db-4bfb-afa4-4c2a707c9e48]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5] added
Aug 03 05:24:15 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3528ff-11bb-4e31-a1bd-1b2b2e195b75]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[145d2763-d976-4be4-99b0-1309a5fd343b]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NOxQDpoC {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NOxQDpoC" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b0b287-b5f1-4b07-9eef-596d9d2fd7ab]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NOxQDpoC'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[387bb944-b32b-4a25-9d14-9618a3279da3]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[966791cf-e8c5-4368-87e9-1966c90fbdf1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 03 05:24:15 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 03 05:24:15 user nova-compute[72444]:  {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:24:15 user nova-compute[72444]: WARNING os_brick.initiator.connectors.iscsi [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 03 05:24:15 user nova-compute[72444]: 
Aug 03 05:24:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5 -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8edaeb-6b6b-4294-8808-5fbccd6c376b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5, portal: 172.16.0.220,3260]
Aug 03 05:24:15 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5, portal: 172.16.0.220,3260] successful.
Aug 03 05:24:15 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0edffa7-7ea4-43ea-bddc-622ee70a50a8]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[25febf12-9d92-4675-9a5a-9d7a00377602]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5 (non-flash)
Aug 03 05:24:15 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5 (non-flash)
Aug 03 05:24:15 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93dc5aa-b6a0-4dee-a98c-c15aded1c308]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 05:24:15 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NOxQDpoC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 05:24:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:24:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:24:16 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23465636430373234', 'path': '/dev/sdb'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:24:16 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465636430373234', 'path': '/dev/sdb'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 05:24:16 user nova-compute[72444]: DEBUG nova.objects.instance [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lazy-loading 'flavor' on Instance uuid e191e075-3d24-4f6b-a612-a6c52baecc12 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:24:16 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 05:24:16 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:24:16 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 05:24:16 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 05:24:16 user nova-compute[72444]:   <serial>04d4f4a7-64da-4367-b310-20d65141a4a5</serial>
Aug 03 05:24:16 user nova-compute[72444]: </disk>
Aug 03 05:24:16 user nova-compute[72444]:  {{(pid=72444) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 05:24:16 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:24:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:24:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:24:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] No VIF found with MAC fa:16:3e:03:c1:7e, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 05:24:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-6865757f-1a07-4054-9f82-11b3f9b5966f tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "e191e075-3d24-4f6b-a612-a6c52baecc12" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.902s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:24:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2afb2a08-136e-425c-a193-2e4950f1c2f6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "e191e075-3d24-4f6b-a612-a6c52baecc12" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:24:17 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2afb2a08-136e-425c-a193-2e4950f1c2f6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "e191e075-3d24-4f6b-a612-a6c52baecc12" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:24:18 user nova-compute[72444]: INFO nova.compute.manager [None req-2afb2a08-136e-425c-a193-2e4950f1c2f6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Detaching volume 04d4f4a7-64da-4367-b310-20d65141a4a5
Aug 03 05:24:18 user nova-compute[72444]: INFO nova.virt.block_device [None req-2afb2a08-136e-425c-a193-2e4950f1c2f6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Attempting to driver detach volume 04d4f4a7-64da-4367-b310-20d65141a4a5 from mountpoint /dev/vdb
Aug 03 05:24:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2afb2a08-136e-425c-a193-2e4950f1c2f6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Attempting to detach device vdb from instance e191e075-3d24-4f6b-a612-a6c52baecc12 from the persistent domain config. {{(pid=72444) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-2afb2a08-136e-425c-a193-2e4950f1c2f6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 05:24:18 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:24:18 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 05:24:18 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 05:24:18 user nova-compute[72444]:   <serial>04d4f4a7-64da-4367-b310-20d65141a4a5</serial>
Aug 03 05:24:18 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 05:24:18 user nova-compute[72444]: </disk>
Aug 03 05:24:18 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 05:24:18 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-2afb2a08-136e-425c-a193-2e4950f1c2f6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Successfully detached device vdb from instance e191e075-3d24-4f6b-a612-a6c52baecc12 from the persistent domain config.
Aug 03 05:24:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2afb2a08-136e-425c-a193-2e4950f1c2f6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e191e075-3d24-4f6b-a612-a6c52baecc12 from the live domain config. {{(pid=72444) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-2afb2a08-136e-425c-a193-2e4950f1c2f6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 05:24:18 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:24:18 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 05:24:18 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 05:24:18 user nova-compute[72444]:   <serial>04d4f4a7-64da-4367-b310-20d65141a4a5</serial>
Aug 03 05:24:18 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 05:24:18 user nova-compute[72444]: </disk>
Aug 03 05:24:18 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Received event <DeviceRemovedEvent: 1691040258.5214477, e191e075-3d24-4f6b-a612-a6c52baecc12 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72444) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-2afb2a08-136e-425c-a193-2e4950f1c2f6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e191e075-3d24-4f6b-a612-a6c52baecc12 {{(pid=72444) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 05:24:18 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-2afb2a08-136e-425c-a193-2e4950f1c2f6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Successfully detached device vdb from instance e191e075-3d24-4f6b-a612-a6c52baecc12 from the live domain config.
Aug 03 05:24:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2afb2a08-136e-425c-a193-2e4950f1c2f6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2afb2a08-136e-425c-a193-2e4950f1c2f6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NOxQDpoC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:24:18 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-2afb2a08-136e-425c-a193-2e4950f1c2f6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:24:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-2afb2a08-136e-425c-a193-2e4950f1c2f6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-2afb2a08-136e-425c-a193-2e4950f1c2f6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2afb2a08-136e-425c-a193-2e4950f1c2f6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f26b24e-b0e2-4330-97b4-bd0e9b057034]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f2ad8c-05a4-4c6f-b06f-f97d8ac2baa2]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2afb2a08-136e-425c-a193-2e4950f1c2f6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5 (non-flash)
Aug 03 05:24:18 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2afb2a08-136e-425c-a193-2e4950f1c2f6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5 (non-flash)
Aug 03 05:24:18 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2afb2a08-136e-425c-a193-2e4950f1c2f6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30943063b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5'): ({'sdb'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-2afb2a08-136e-425c-a193-2e4950f1c2f6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Removing single pathed devices sdb {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4699db1e-0711-4899-8f9b-c9ee9124f5d5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[36884bf7-de73-4134-9203-b5ce29ee8a6c]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-2afb2a08-136e-425c-a193-2e4950f1c2f6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Flushing IO for device /dev/sdb {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d1a6b8-6d1f-4953-b43b-7bad866cc3e3]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-2afb2a08-136e-425c-a193-2e4950f1c2f6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[944f5784-7fa0-46c3-9e24-5f42d1e10bb1]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-2afb2a08-136e-425c-a193-2e4950f1c2f6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-2afb2a08-136e-425c-a193-2e4950f1c2f6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2afb2a08-136e-425c-a193-2e4950f1c2f6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4157d93c-7052-4282-bfc3-e4a6ce68770a]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2afb2a08-136e-425c-a193-2e4950f1c2f6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5 -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3252e4bb-e234-45d6-8b40-52a31a0a2bbd]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2afb2a08-136e-425c-a193-2e4950f1c2f6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5, portal: 172.16.0.220,3260]
Aug 03 05:24:18 user nova-compute[72444]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5, portal: 172.16.0.220,3260] successful.
Aug 03 05:24:18 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5 -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d4f4a7-64da-4367-b310-20d65141a4a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90b3a0f-e3bc-480f-b47d-f30f5afcbdf7]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2afb2a08-136e-425c-a193-2e4950f1c2f6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-2afb2a08-136e-425c-a193-2e4950f1c2f6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.237s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-2afb2a08-136e-425c-a193-2e4950f1c2f6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] <== disconnect_volume: return (239ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2afb2a08-136e-425c-a193-2e4950f1c2f6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:24:18 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:24:20 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:24:21 user nova-compute[72444]: DEBUG nova.objects.instance [None req-2afb2a08-136e-425c-a193-2e4950f1c2f6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lazy-loading 'flavor' on Instance uuid e191e075-3d24-4f6b-a612-a6c52baecc12 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:24:21 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-2afb2a08-136e-425c-a193-2e4950f1c2f6 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "e191e075-3d24-4f6b-a612-a6c52baecc12" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.087s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:24:23 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:24:24 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:24:24 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:24:24 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Rebuilding the list of instances to heal {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 05:24:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-e191e075-3d24-4f6b-a612-a6c52baecc12" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:24:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-e191e075-3d24-4f6b-a612-a6c52baecc12" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:24:24 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 05:24:24 user nova-compute[72444]: DEBUG nova.objects.instance [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lazy-loading 'info_cache' on Instance uuid e191e075-3d24-4f6b-a612-a6c52baecc12 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:24:25 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Updating instance_info_cache with network_info: [{"id": "038a5198-3ba1-42e0-9dbf-6460cdb5f806", "address": "fa:16:3e:03:c1:7e", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038a5198-3b", "ovs_interfaceid": "038a5198-3ba1-42e0-9dbf-6460cdb5f806", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:24:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-e191e075-3d24-4f6b-a612-a6c52baecc12" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:24:25 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 05:24:25 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:24:25 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:24:25 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 05:24:25 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:24:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:24:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:24:25 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:24:25 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:24:26 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e191e075-3d24-4f6b-a612-a6c52baecc12/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:24:26 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e191e075-3d24-4f6b-a612-a6c52baecc12/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:24:26 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e191e075-3d24-4f6b-a612-a6c52baecc12/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:24:26 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e191e075-3d24-4f6b-a612-a6c52baecc12/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:24:26 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:24:26 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:24:26 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=8726MB free_disk=25.333045959472656GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:24:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:24:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:24:26 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance e191e075-3d24-4f6b-a612-a6c52baecc12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:24:26 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:24:26 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:24:26 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:24:26 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:24:26 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:24:26 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:24:27 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:24:28 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:24:28 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:24:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:24:33 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:24:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:24:43 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:24:48 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:24:53 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:24:58 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:25:03 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:25:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ae13adef-cba4-4524-948f-bbd635b9ece9 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "e191e075-3d24-4f6b-a612-a6c52baecc12" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:25:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ae13adef-cba4-4524-948f-bbd635b9ece9 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "e191e075-3d24-4f6b-a612-a6c52baecc12" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:25:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ae13adef-cba4-4524-948f-bbd635b9ece9 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "e191e075-3d24-4f6b-a612-a6c52baecc12-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:25:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ae13adef-cba4-4524-948f-bbd635b9ece9 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "e191e075-3d24-4f6b-a612-a6c52baecc12-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:25:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ae13adef-cba4-4524-948f-bbd635b9ece9 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "e191e075-3d24-4f6b-a612-a6c52baecc12-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:25:08 user nova-compute[72444]: INFO nova.compute.manager [None req-ae13adef-cba4-4524-948f-bbd635b9ece9 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Terminating instance
Aug 03 05:25:08 user nova-compute[72444]: DEBUG nova.compute.manager [None req-ae13adef-cba4-4524-948f-bbd635b9ece9 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 05:25:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:25:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:25:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:25:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:25:08 user nova-compute[72444]: DEBUG nova.compute.manager [req-9e98e57f-5880-4db2-80b2-461b552cb569 req-eb7aaad8-11d2-40b3-b084-28088edaefe3 service nova] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Received event network-vif-unplugged-038a5198-3ba1-42e0-9dbf-6460cdb5f806 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:25:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9e98e57f-5880-4db2-80b2-461b552cb569 req-eb7aaad8-11d2-40b3-b084-28088edaefe3 service nova] Acquiring lock "e191e075-3d24-4f6b-a612-a6c52baecc12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:25:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9e98e57f-5880-4db2-80b2-461b552cb569 req-eb7aaad8-11d2-40b3-b084-28088edaefe3 service nova] Lock "e191e075-3d24-4f6b-a612-a6c52baecc12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:25:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-9e98e57f-5880-4db2-80b2-461b552cb569 req-eb7aaad8-11d2-40b3-b084-28088edaefe3 service nova] Lock "e191e075-3d24-4f6b-a612-a6c52baecc12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:25:08 user nova-compute[72444]: DEBUG nova.compute.manager [req-9e98e57f-5880-4db2-80b2-461b552cb569 req-eb7aaad8-11d2-40b3-b084-28088edaefe3 service nova] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] No waiting events found dispatching network-vif-unplugged-038a5198-3ba1-42e0-9dbf-6460cdb5f806 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:25:08 user nova-compute[72444]: DEBUG nova.compute.manager [req-9e98e57f-5880-4db2-80b2-461b552cb569 req-eb7aaad8-11d2-40b3-b084-28088edaefe3 service nova] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Received event network-vif-unplugged-038a5198-3ba1-42e0-9dbf-6460cdb5f806 for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 05:25:08 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:25:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:25:09 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Instance destroyed successfully.
Aug 03 05:25:09 user nova-compute[72444]: DEBUG nova.objects.instance [None req-ae13adef-cba4-4524-948f-bbd635b9ece9 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lazy-loading 'resources' on Instance uuid e191e075-3d24-4f6b-a612-a6c52baecc12 {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:25:09 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-ae13adef-cba4-4524-948f-bbd635b9ece9 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:22:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1161148507',display_name='tempest-AttachVolumeNegativeTest-server-1161148507',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1161148507',id=50,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjBdBWWjQuxFFrT/YucPKTZebKAo9Hwh6uF3VWNqAJMfTYNB1IdfpObgv+mlOIrviEK1GcXGVui4FuTr1NmAf1R0xe6kCzy1gWJrjF2UUO4zd8O5mPC0EZM49KsuvT8aw==',key_name='tempest-keypair-1966542089',keypairs=<?>,launch_index=0,launched_at=2023-08-03T05:22:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d8210385d97453ab4befb159a457772',ramdisk_id='',reservation_id='r-dabexfde',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1998464271',owner_user_name='tempest-AttachVolumeNegativeTest-1998464271-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T05:22:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39ca6b589ce84537984e0df64b6085f3',uuid=e191e075-3d24-4f6b-a612-a6c52baecc12,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "038a5198-3ba1-42e0-9dbf-6460cdb5f806", "address": "fa:16:3e:03:c1:7e", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038a5198-3b", "ovs_interfaceid": "038a5198-3ba1-42e0-9dbf-6460cdb5f806", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 05:25:09 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-ae13adef-cba4-4524-948f-bbd635b9ece9 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Converting VIF {"id": "038a5198-3ba1-42e0-9dbf-6460cdb5f806", "address": "fa:16:3e:03:c1:7e", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038a5198-3b", "ovs_interfaceid": "038a5198-3ba1-42e0-9dbf-6460cdb5f806", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:25:09 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-ae13adef-cba4-4524-948f-bbd635b9ece9 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:c1:7e,bridge_name='br-int',has_traffic_filtering=True,id=038a5198-3ba1-42e0-9dbf-6460cdb5f806,network=Network(9605cf27-7ef3-4664-97b1-a6e1d093ce98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038a5198-3b') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:25:09 user nova-compute[72444]: DEBUG os_vif [None req-ae13adef-cba4-4524-948f-bbd635b9ece9 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:c1:7e,bridge_name='br-int',has_traffic_filtering=True,id=038a5198-3ba1-42e0-9dbf-6460cdb5f806,network=Network(9605cf27-7ef3-4664-97b1-a6e1d093ce98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038a5198-3b') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 05:25:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:25:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap038a5198-3b, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:25:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:25:09 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:25:09 user nova-compute[72444]: INFO os_vif [None req-ae13adef-cba4-4524-948f-bbd635b9ece9 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:c1:7e,bridge_name='br-int',has_traffic_filtering=True,id=038a5198-3ba1-42e0-9dbf-6460cdb5f806,network=Network(9605cf27-7ef3-4664-97b1-a6e1d093ce98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038a5198-3b')
Aug 03 05:25:09 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-ae13adef-cba4-4524-948f-bbd635b9ece9 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Deleting instance files /opt/stack/data/nova/instances/e191e075-3d24-4f6b-a612-a6c52baecc12_del
Aug 03 05:25:09 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-ae13adef-cba4-4524-948f-bbd635b9ece9 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Deletion of /opt/stack/data/nova/instances/e191e075-3d24-4f6b-a612-a6c52baecc12_del complete
Aug 03 05:25:09 user nova-compute[72444]: INFO nova.compute.manager [None req-ae13adef-cba4-4524-948f-bbd635b9ece9 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 03 05:25:09 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-ae13adef-cba4-4524-948f-bbd635b9ece9 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 05:25:09 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 05:25:09 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 05:25:10 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:25:10 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Took 0.93 seconds to deallocate network for instance.
Aug 03 05:25:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ae13adef-cba4-4524-948f-bbd635b9ece9 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:25:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ae13adef-cba4-4524-948f-bbd635b9ece9 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:25:10 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-ae13adef-cba4-4524-948f-bbd635b9ece9 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:25:10 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-ae13adef-cba4-4524-948f-bbd635b9ece9 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:25:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ae13adef-cba4-4524-948f-bbd635b9ece9 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.119s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:25:10 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-ae13adef-cba4-4524-948f-bbd635b9ece9 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Deleted allocations for instance e191e075-3d24-4f6b-a612-a6c52baecc12
Aug 03 05:25:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ae13adef-cba4-4524-948f-bbd635b9ece9 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "e191e075-3d24-4f6b-a612-a6c52baecc12" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.373s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:25:10 user nova-compute[72444]: DEBUG nova.compute.manager [req-f3b17389-7651-424c-8d0a-581cbc8a23b2 req-fb712f7e-be5c-47ce-93a1-d90a7985c368 service nova] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Received event network-vif-plugged-038a5198-3ba1-42e0-9dbf-6460cdb5f806 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:25:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f3b17389-7651-424c-8d0a-581cbc8a23b2 req-fb712f7e-be5c-47ce-93a1-d90a7985c368 service nova] Acquiring lock "e191e075-3d24-4f6b-a612-a6c52baecc12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:25:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f3b17389-7651-424c-8d0a-581cbc8a23b2 req-fb712f7e-be5c-47ce-93a1-d90a7985c368 service nova] Lock "e191e075-3d24-4f6b-a612-a6c52baecc12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:25:10 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-f3b17389-7651-424c-8d0a-581cbc8a23b2 req-fb712f7e-be5c-47ce-93a1-d90a7985c368 service nova] Lock "e191e075-3d24-4f6b-a612-a6c52baecc12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:25:10 user nova-compute[72444]: DEBUG nova.compute.manager [req-f3b17389-7651-424c-8d0a-581cbc8a23b2 req-fb712f7e-be5c-47ce-93a1-d90a7985c368 service nova] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] No waiting events found dispatching network-vif-plugged-038a5198-3ba1-42e0-9dbf-6460cdb5f806 {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:25:10 user nova-compute[72444]: WARNING nova.compute.manager [req-f3b17389-7651-424c-8d0a-581cbc8a23b2 req-fb712f7e-be5c-47ce-93a1-d90a7985c368 service nova] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Received unexpected event network-vif-plugged-038a5198-3ba1-42e0-9dbf-6460cdb5f806 for instance with vm_state deleted and task_state None.
Aug 03 05:25:10 user nova-compute[72444]: DEBUG nova.compute.manager [req-f3b17389-7651-424c-8d0a-581cbc8a23b2 req-fb712f7e-be5c-47ce-93a1-d90a7985c368 service nova] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Received event network-vif-deleted-038a5198-3ba1-42e0-9dbf-6460cdb5f806 {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:25:14 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:25:17 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:25:19 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:25:19 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:25:21 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:25:24 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691040309.3167784, e191e075-3d24-4f6b-a612-a6c52baecc12 => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:25:24 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] VM Stopped (Lifecycle Event)
Aug 03 05:25:24 user nova-compute[72444]: DEBUG nova.compute.manager [None req-aa2f96ec-8251-4a82-a42f-0bd9d79743d3 None None] [instance: e191e075-3d24-4f6b-a612-a6c52baecc12] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:25:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:25:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:25:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:25:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:25:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:25:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:25:24 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:25:25 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:25:25 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 05:25:26 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:25:26 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:25:26 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Rebuilding the list of instances to heal {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 05:25:26 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Didn't find any instances for network info cache update. {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 03 05:25:27 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:25:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:25:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:25:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:25:27 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:25:28 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:25:28 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:25:28 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=8872MB free_disk=25.3515625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:25:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:25:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:25:28 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:25:28 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:25:28 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:25:28 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:25:28 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:25:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:25:29 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:25:29 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:25:30 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:25:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:25:37 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:25:39 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:25:44 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:25:49 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:25:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:25:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:25:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:25:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:25:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:25:54 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:25:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:25:59 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:26:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:26:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:26:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 05:26:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:26:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:26:03 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 05:26:03 user nova-compute[72444]: INFO nova.compute.claims [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Claim successful on node user
Aug 03 05:26:03 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:26:03 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:26:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.186s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:26:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 05:26:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 05:26:03 user nova-compute[72444]: DEBUG nova.network.neutron [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 05:26:03 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 05:26:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 05:26:03 user nova-compute[72444]: DEBUG nova.policy [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '39ca6b589ce84537984e0df64b6085f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8210385d97453ab4befb159a457772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 05:26:03 user nova-compute[72444]: DEBUG nova.compute.manager [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 05:26:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 05:26:03 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Creating image(s)
Aug 03 05:26:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "/opt/stack/data/nova/instances/8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:26:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "/opt/stack/data/nova/instances/8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:26:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "/opt/stack/data/nova/instances/8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:26:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:26:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.140s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:26:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:26:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:26:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:26:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.137s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:26:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:26:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f/disk 1073741824" returned: 0 in 0.061s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:26:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:26:03 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:26:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.135s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:26:04 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 05:26:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:26:04 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:26:04 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Cannot resize image /opt/stack/data/nova/instances/8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 05:26:04 user nova-compute[72444]: DEBUG nova.objects.instance [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lazy-loading 'migration_context' on Instance uuid 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:26:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 05:26:04 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Ensure instance console log exists: /opt/stack/data/nova/instances/8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 05:26:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:26:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:26:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:26:04 user nova-compute[72444]: DEBUG nova.network.neutron [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Successfully created port: 298308f5-3e71-4c65-8ff1-73ed244ab60c {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 05:26:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:26:04 user nova-compute[72444]: DEBUG nova.network.neutron [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Successfully updated port: 298308f5-3e71-4c65-8ff1-73ed244ab60c {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 05:26:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "refresh_cache-8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:26:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquired lock "refresh_cache-8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:26:04 user nova-compute[72444]: DEBUG nova.network.neutron [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 05:26:04 user nova-compute[72444]: DEBUG nova.compute.manager [req-c70f3c45-e185-4f50-82dd-7daaba498352 req-24a2bab3-6413-43d2-b29d-dff1a79dfcdf service nova] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Received event network-changed-298308f5-3e71-4c65-8ff1-73ed244ab60c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:26:04 user nova-compute[72444]: DEBUG nova.compute.manager [req-c70f3c45-e185-4f50-82dd-7daaba498352 req-24a2bab3-6413-43d2-b29d-dff1a79dfcdf service nova] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Refreshing instance network info cache due to event network-changed-298308f5-3e71-4c65-8ff1-73ed244ab60c. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:26:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-c70f3c45-e185-4f50-82dd-7daaba498352 req-24a2bab3-6413-43d2-b29d-dff1a79dfcdf service nova] Acquiring lock "refresh_cache-8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:26:04 user nova-compute[72444]: DEBUG nova.network.neutron [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG nova.network.neutron [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Updating instance_info_cache with network_info: [{"id": "298308f5-3e71-4c65-8ff1-73ed244ab60c", "address": "fa:16:3e:e4:da:25", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298308f5-3e", "ovs_interfaceid": "298308f5-3e71-4c65-8ff1-73ed244ab60c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Releasing lock "refresh_cache-8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG nova.compute.manager [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Instance network_info: |[{"id": "298308f5-3e71-4c65-8ff1-73ed244ab60c", "address": "fa:16:3e:e4:da:25", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298308f5-3e", "ovs_interfaceid": "298308f5-3e71-4c65-8ff1-73ed244ab60c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-c70f3c45-e185-4f50-82dd-7daaba498352 req-24a2bab3-6413-43d2-b29d-dff1a79dfcdf service nova] Acquired lock "refresh_cache-8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG nova.network.neutron [req-c70f3c45-e185-4f50-82dd-7daaba498352 req-24a2bab3-6413-43d2-b29d-dff1a79dfcdf service nova] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Refreshing network info cache for port 298308f5-3e71-4c65-8ff1-73ed244ab60c {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Start _get_guest_xml network_info=[{"id": "298308f5-3e71-4c65-8ff1-73ed244ab60c", "address": "fa:16:3e:e4:da:25", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298308f5-3e", "ovs_interfaceid": "298308f5-3e71-4c65-8ff1-73ed244ab60c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 05:26:05 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:26:05 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:26:05 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:26:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1334300981',display_name='tempest-AttachVolumeNegativeTest-server-1334300981',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1334300981',id=51,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMRFRIkci8lUlb3P2m/Phgmgte4T0lBAX5yPwzmoweq2BIYuRsZEw4orceftB4pxxixjTRVpV//kJJ6i6XffMJNj45rr41n5+lSw8HA93iEuaQ/UsNXpTRvfGJ7pO73RAw==',key_name='tempest-keypair-329142450',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d8210385d97453ab4befb159a457772',ramdisk_id='',reservation_id='r-ksh5u8mz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1998464271',owner_user_name='tempest-AttachVolumeNegativeTest-1998464271-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:26:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39ca6b589ce84537984e0df64b6085f3',uuid=8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "298308f5-3e71-4c65-8ff1-73ed244ab60c", "address": "fa:16:3e:e4:da:25", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298308f5-3e", "ovs_interfaceid": "298308f5-3e71-4c65-8ff1-73ed244ab60c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Converting VIF {"id": "298308f5-3e71-4c65-8ff1-73ed244ab60c", "address": "fa:16:3e:e4:da:25", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298308f5-3e", "ovs_interfaceid": "298308f5-3e71-4c65-8ff1-73ed244ab60c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:da:25,bridge_name='br-int',has_traffic_filtering=True,id=298308f5-3e71-4c65-8ff1-73ed244ab60c,network=Network(9605cf27-7ef3-4664-97b1-a6e1d093ce98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap298308f5-3e') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG nova.objects.instance [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lazy-loading 'pci_devices' on Instance uuid 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] End _get_guest_xml xml=<domain type="kvm">
Aug 03 05:26:05 user nova-compute[72444]:   <uuid>8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f</uuid>
Aug 03 05:26:05 user nova-compute[72444]:   <name>instance-00000033</name>
Aug 03 05:26:05 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 05:26:05 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 05:26:05 user nova-compute[72444]:   <metadata>
Aug 03 05:26:05 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 05:26:05 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 05:26:05 user nova-compute[72444]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1334300981</nova:name>
Aug 03 05:26:05 user nova-compute[72444]:       <nova:creationTime>2023-08-03 05:26:05</nova:creationTime>
Aug 03 05:26:05 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 05:26:05 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 05:26:05 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 05:26:05 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 05:26:05 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 05:26:05 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 05:26:05 user nova-compute[72444]:       </nova:flavor>
Aug 03 05:26:05 user nova-compute[72444]:       <nova:owner>
Aug 03 05:26:05 user nova-compute[72444]:         <nova:user uuid="39ca6b589ce84537984e0df64b6085f3">tempest-AttachVolumeNegativeTest-1998464271-project-member</nova:user>
Aug 03 05:26:05 user nova-compute[72444]:         <nova:project uuid="9d8210385d97453ab4befb159a457772">tempest-AttachVolumeNegativeTest-1998464271</nova:project>
Aug 03 05:26:05 user nova-compute[72444]:       </nova:owner>
Aug 03 05:26:05 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 05:26:05 user nova-compute[72444]:       <nova:ports>
Aug 03 05:26:05 user nova-compute[72444]:         <nova:port uuid="298308f5-3e71-4c65-8ff1-73ed244ab60c">
Aug 03 05:26:05 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 03 05:26:05 user nova-compute[72444]:         </nova:port>
Aug 03 05:26:05 user nova-compute[72444]:       </nova:ports>
Aug 03 05:26:05 user nova-compute[72444]:     </nova:instance>
Aug 03 05:26:05 user nova-compute[72444]:   </metadata>
Aug 03 05:26:05 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 05:26:05 user nova-compute[72444]:     <system>
Aug 03 05:26:05 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 05:26:05 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 05:26:05 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 05:26:05 user nova-compute[72444]:       <entry name="serial">8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f</entry>
Aug 03 05:26:05 user nova-compute[72444]:       <entry name="uuid">8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f</entry>
Aug 03 05:26:05 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 05:26:05 user nova-compute[72444]:     </system>
Aug 03 05:26:05 user nova-compute[72444]:   </sysinfo>
Aug 03 05:26:05 user nova-compute[72444]:   <os>
Aug 03 05:26:05 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 05:26:05 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 05:26:05 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 05:26:05 user nova-compute[72444]:   </os>
Aug 03 05:26:05 user nova-compute[72444]:   <features>
Aug 03 05:26:05 user nova-compute[72444]:     <acpi/>
Aug 03 05:26:05 user nova-compute[72444]:     <apic/>
Aug 03 05:26:05 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 05:26:05 user nova-compute[72444]:   </features>
Aug 03 05:26:05 user nova-compute[72444]:   <clock offset="utc">
Aug 03 05:26:05 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 05:26:05 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 05:26:05 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 05:26:05 user nova-compute[72444]:   </clock>
Aug 03 05:26:05 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 05:26:05 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 05:26:05 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 05:26:05 user nova-compute[72444]:   </cpu>
Aug 03 05:26:05 user nova-compute[72444]:   <devices>
Aug 03 05:26:05 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 05:26:05 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 05:26:05 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f/disk"/>
Aug 03 05:26:05 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 05:26:05 user nova-compute[72444]:     </disk>
Aug 03 05:26:05 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 05:26:05 user nova-compute[72444]:       <mac address="fa:16:3e:e4:da:25"/>
Aug 03 05:26:05 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:26:05 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 05:26:05 user nova-compute[72444]:       <target dev="tap298308f5-3e"/>
Aug 03 05:26:05 user nova-compute[72444]:     </interface>
Aug 03 05:26:05 user nova-compute[72444]:     <serial type="pty">
Aug 03 05:26:05 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f/console.log" append="off"/>
Aug 03 05:26:05 user nova-compute[72444]:     </serial>
Aug 03 05:26:05 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 05:26:05 user nova-compute[72444]:     <video>
Aug 03 05:26:05 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:26:05 user nova-compute[72444]:     </video>
Aug 03 05:26:05 user nova-compute[72444]:     <rng model="virtio">
Aug 03 05:26:05 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 05:26:05 user nova-compute[72444]:     </rng>
Aug 03 05:26:05 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 05:26:05 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 05:26:05 user nova-compute[72444]:       <stats period="10"/>
Aug 03 05:26:05 user nova-compute[72444]:     </memballoon>
Aug 03 05:26:05 user nova-compute[72444]:   </devices>
Aug 03 05:26:05 user nova-compute[72444]: </domain>
Aug 03 05:26:05 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:26:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1334300981',display_name='tempest-AttachVolumeNegativeTest-server-1334300981',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1334300981',id=51,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMRFRIkci8lUlb3P2m/Phgmgte4T0lBAX5yPwzmoweq2BIYuRsZEw4orceftB4pxxixjTRVpV//kJJ6i6XffMJNj45rr41n5+lSw8HA93iEuaQ/UsNXpTRvfGJ7pO73RAw==',key_name='tempest-keypair-329142450',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d8210385d97453ab4befb159a457772',ramdisk_id='',reservation_id='r-ksh5u8mz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1998464271',owner_user_name='tempest-AttachVolumeNegativeTest-1998464271-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:26:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39ca6b589ce84537984e0df64b6085f3',uuid=8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "298308f5-3e71-4c65-8ff1-73ed244ab60c", "address": "fa:16:3e:e4:da:25", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298308f5-3e", "ovs_interfaceid": "298308f5-3e71-4c65-8ff1-73ed244ab60c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Converting VIF {"id": "298308f5-3e71-4c65-8ff1-73ed244ab60c", "address": "fa:16:3e:e4:da:25", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298308f5-3e", "ovs_interfaceid": "298308f5-3e71-4c65-8ff1-73ed244ab60c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:da:25,bridge_name='br-int',has_traffic_filtering=True,id=298308f5-3e71-4c65-8ff1-73ed244ab60c,network=Network(9605cf27-7ef3-4664-97b1-a6e1d093ce98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap298308f5-3e') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG os_vif [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:da:25,bridge_name='br-int',has_traffic_filtering=True,id=298308f5-3e71-4c65-8ff1-73ed244ab60c,network=Network(9605cf27-7ef3-4664-97b1-a6e1d093ce98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap298308f5-3e') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap298308f5-3e, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap298308f5-3e, col_values=(('external_ids', {'iface-id': '298308f5-3e71-4c65-8ff1-73ed244ab60c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:da:25', 'vm-uuid': '8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:26:05 user nova-compute[72444]: INFO os_vif [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:da:25,bridge_name='br-int',has_traffic_filtering=True,id=298308f5-3e71-4c65-8ff1-73ed244ab60c,network=Network(9605cf27-7ef3-4664-97b1-a6e1d093ce98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap298308f5-3e')
Aug 03 05:26:05 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] No VIF found with MAC fa:16:3e:e4:da:25, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG nova.network.neutron [req-c70f3c45-e185-4f50-82dd-7daaba498352 req-24a2bab3-6413-43d2-b29d-dff1a79dfcdf service nova] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Updated VIF entry in instance network info cache for port 298308f5-3e71-4c65-8ff1-73ed244ab60c. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG nova.network.neutron [req-c70f3c45-e185-4f50-82dd-7daaba498352 req-24a2bab3-6413-43d2-b29d-dff1a79dfcdf service nova] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Updating instance_info_cache with network_info: [{"id": "298308f5-3e71-4c65-8ff1-73ed244ab60c", "address": "fa:16:3e:e4:da:25", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298308f5-3e", "ovs_interfaceid": "298308f5-3e71-4c65-8ff1-73ed244ab60c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:26:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-c70f3c45-e185-4f50-82dd-7daaba498352 req-24a2bab3-6413-43d2-b29d-dff1a79dfcdf service nova] Releasing lock "refresh_cache-8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:26:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:26:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:26:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:26:06 user nova-compute[72444]: DEBUG nova.compute.manager [req-4178f77e-94c9-42b5-8a0c-70b8e1d71131 req-145ee552-b098-491c-a9ae-9033eb885994 service nova] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Received event network-vif-plugged-298308f5-3e71-4c65-8ff1-73ed244ab60c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:26:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4178f77e-94c9-42b5-8a0c-70b8e1d71131 req-145ee552-b098-491c-a9ae-9033eb885994 service nova] Acquiring lock "8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:26:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4178f77e-94c9-42b5-8a0c-70b8e1d71131 req-145ee552-b098-491c-a9ae-9033eb885994 service nova] Lock "8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:26:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-4178f77e-94c9-42b5-8a0c-70b8e1d71131 req-145ee552-b098-491c-a9ae-9033eb885994 service nova] Lock "8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:26:06 user nova-compute[72444]: DEBUG nova.compute.manager [req-4178f77e-94c9-42b5-8a0c-70b8e1d71131 req-145ee552-b098-491c-a9ae-9033eb885994 service nova] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] No waiting events found dispatching network-vif-plugged-298308f5-3e71-4c65-8ff1-73ed244ab60c {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:26:06 user nova-compute[72444]: WARNING nova.compute.manager [req-4178f77e-94c9-42b5-8a0c-70b8e1d71131 req-145ee552-b098-491c-a9ae-9033eb885994 service nova] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Received unexpected event network-vif-plugged-298308f5-3e71-4c65-8ff1-73ed244ab60c for instance with vm_state building and task_state spawning.
Aug 03 05:26:07 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:26:07 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:26:07 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:26:08 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691040368.6707864, 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:26:08 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] VM Resumed (Lifecycle Event)
Aug 03 05:26:08 user nova-compute[72444]: DEBUG nova.compute.manager [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 05:26:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 05:26:08 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Instance spawned successfully.
Aug 03 05:26:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 05:26:08 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:26:08 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:26:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:26:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:26:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:26:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:26:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:26:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:26:08 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 05:26:08 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691040368.6727176, 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:26:08 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] VM Started (Lifecycle Event)
Aug 03 05:26:08 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:26:08 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:26:08 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 05:26:08 user nova-compute[72444]: INFO nova.compute.manager [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Took 5.28 seconds to spawn the instance on the hypervisor.
Aug 03 05:26:08 user nova-compute[72444]: DEBUG nova.compute.manager [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:26:08 user nova-compute[72444]: INFO nova.compute.manager [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Took 5.81 seconds to build instance.
Aug 03 05:26:08 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-648a5b27-ecf0-44b3-a086-5b65cfe6bb63 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.907s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:26:09 user nova-compute[72444]: DEBUG nova.compute.manager [req-1c90e3d6-066f-4336-82b6-aa67a43b7af4 req-99dd8624-c2fe-416a-8fa8-1a5979972867 service nova] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Received event network-vif-plugged-298308f5-3e71-4c65-8ff1-73ed244ab60c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:26:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-1c90e3d6-066f-4336-82b6-aa67a43b7af4 req-99dd8624-c2fe-416a-8fa8-1a5979972867 service nova] Acquiring lock "8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:26:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-1c90e3d6-066f-4336-82b6-aa67a43b7af4 req-99dd8624-c2fe-416a-8fa8-1a5979972867 service nova] Lock "8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:26:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-1c90e3d6-066f-4336-82b6-aa67a43b7af4 req-99dd8624-c2fe-416a-8fa8-1a5979972867 service nova] Lock "8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:26:09 user nova-compute[72444]: DEBUG nova.compute.manager [req-1c90e3d6-066f-4336-82b6-aa67a43b7af4 req-99dd8624-c2fe-416a-8fa8-1a5979972867 service nova] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] No waiting events found dispatching network-vif-plugged-298308f5-3e71-4c65-8ff1-73ed244ab60c {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:26:09 user nova-compute[72444]: WARNING nova.compute.manager [req-1c90e3d6-066f-4336-82b6-aa67a43b7af4 req-99dd8624-c2fe-416a-8fa8-1a5979972867 service nova] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Received unexpected event network-vif-plugged-298308f5-3e71-4c65-8ff1-73ed244ab60c for instance with vm_state active and task_state None.
Aug 03 05:26:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:26:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:26:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:26:19 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:26:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:26:20 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:26:22 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:26:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:26:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:26:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:26:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:26:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:26:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:26:25 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:26:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:26:26 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:26:26 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:26:26 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Rebuilding the list of instances to heal {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 05:26:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:26:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:26:27 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 05:26:27 user nova-compute[72444]: DEBUG nova.objects.instance [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lazy-loading 'info_cache' on Instance uuid 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:26:27 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Updating instance_info_cache with network_info: [{"id": "298308f5-3e71-4c65-8ff1-73ed244ab60c", "address": "fa:16:3e:e4:da:25", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298308f5-3e", "ovs_interfaceid": "298308f5-3e71-4c65-8ff1-73ed244ab60c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:26:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:26:27 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 05:26:27 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:26:27 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 05:26:29 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:26:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:26:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:26:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:26:29 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:26:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:26:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:26:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:26:30 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:26:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:26:30 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:26:30 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:26:30 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=8728MB free_disk=25.322998046875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:26:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:26:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:26:30 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:26:30 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:26:30 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:26:30 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:26:30 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:26:30 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:26:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:26:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:26:31 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:26:32 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:26:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:26:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:26:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:26:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:26:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:26:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:26:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:26:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:26:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:26:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:26:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:26:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:27:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:27:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:27:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:27:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:27:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:27:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:27:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:27:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:27:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:27:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:27:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:27:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:27:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:27:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:27:16 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:27:16 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Cleaning up deleted instances {{(pid=72444) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 03 05:27:16 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] There are 0 instances to clean {{(pid=72444) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 03 05:27:19 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:27:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:27:20 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:27:23 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:27:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:27:25 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:27:26 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:27:26 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 05:27:27 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:27:27 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:27:27 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Rebuilding the list of instances to heal {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 05:27:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:27:27 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:27:27 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 05:27:27 user nova-compute[72444]: DEBUG nova.objects.instance [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lazy-loading 'info_cache' on Instance uuid 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:27:28 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Updating instance_info_cache with network_info: [{"id": "298308f5-3e71-4c65-8ff1-73ed244ab60c", "address": "fa:16:3e:e4:da:25", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298308f5-3e", "ovs_interfaceid": "298308f5-3e71-4c65-8ff1-73ed244ab60c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:27:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:27:28 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 05:27:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:27:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:27:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:27:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:27:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:27:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:27:30 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:27:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:27:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:27:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:27:30 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:27:31 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:27:31 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:27:31 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:27:31 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:27:31 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:27:31 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:27:31 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=8799MB free_disk=25.32113265991211GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:27:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:27:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:27:31 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:27:31 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:27:31 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:27:31 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Refreshing inventories for resource provider b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 03 05:27:31 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Updating ProviderTree inventory for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 03 05:27:31 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Updating inventory in ProviderTree for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 03 05:27:32 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Refreshing aggregate associations for resource provider b624a913-bb6b-4a17-8cd7-7b0950cff161, aggregates: None {{(pid=72444) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 03 05:27:32 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Refreshing trait associations for resource provider b624a913-bb6b-4a17-8cd7-7b0950cff161, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=72444) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 03 05:27:32 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:27:32 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:27:32 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:27:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.427s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:27:33 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:27:33 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:27:33 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72444) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 03 05:27:34 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:27:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:27:36 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:27:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:27:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:27:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:27:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:27:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:27:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:27:41 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:27:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:27:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:27:54 user nova-compute[72444]: DEBUG nova.compute.manager [req-feb945d4-e329-4a3b-9641-7c5e0741ba1e req-0aac9d93-d5b3-4a3f-9fdc-52ff7bfa491a service nova] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Received event network-changed-298308f5-3e71-4c65-8ff1-73ed244ab60c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:27:54 user nova-compute[72444]: DEBUG nova.compute.manager [req-feb945d4-e329-4a3b-9641-7c5e0741ba1e req-0aac9d93-d5b3-4a3f-9fdc-52ff7bfa491a service nova] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Refreshing instance network info cache due to event network-changed-298308f5-3e71-4c65-8ff1-73ed244ab60c. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:27:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-feb945d4-e329-4a3b-9641-7c5e0741ba1e req-0aac9d93-d5b3-4a3f-9fdc-52ff7bfa491a service nova] Acquiring lock "refresh_cache-8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:27:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-feb945d4-e329-4a3b-9641-7c5e0741ba1e req-0aac9d93-d5b3-4a3f-9fdc-52ff7bfa491a service nova] Acquired lock "refresh_cache-8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:27:54 user nova-compute[72444]: DEBUG nova.network.neutron [req-feb945d4-e329-4a3b-9641-7c5e0741ba1e req-0aac9d93-d5b3-4a3f-9fdc-52ff7bfa491a service nova] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Refreshing network info cache for port 298308f5-3e71-4c65-8ff1-73ed244ab60c {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:27:54 user nova-compute[72444]: DEBUG nova.network.neutron [req-feb945d4-e329-4a3b-9641-7c5e0741ba1e req-0aac9d93-d5b3-4a3f-9fdc-52ff7bfa491a service nova] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Updated VIF entry in instance network info cache for port 298308f5-3e71-4c65-8ff1-73ed244ab60c. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:27:54 user nova-compute[72444]: DEBUG nova.network.neutron [req-feb945d4-e329-4a3b-9641-7c5e0741ba1e req-0aac9d93-d5b3-4a3f-9fdc-52ff7bfa491a service nova] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Updating instance_info_cache with network_info: [{"id": "298308f5-3e71-4c65-8ff1-73ed244ab60c", "address": "fa:16:3e:e4:da:25", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298308f5-3e", "ovs_interfaceid": "298308f5-3e71-4c65-8ff1-73ed244ab60c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:27:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-feb945d4-e329-4a3b-9641-7c5e0741ba1e req-0aac9d93-d5b3-4a3f-9fdc-52ff7bfa491a service nova] Releasing lock "refresh_cache-8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:27:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:27:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:27:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:27:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:27:58 user nova-compute[72444]: DEBUG nova.objects.instance [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lazy-loading 'flavor' on Instance uuid 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:27:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:27:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:27:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:27:58 user nova-compute[72444]: INFO nova.compute.manager [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Attaching volume 39834e6b-75c5-451e-8958-76c65fed795d to /dev/vdb
Aug 03 05:27:58 user nova-compute[72444]: DEBUG os_brick.utils [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:27:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:27:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:27:58 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7000ae7-03d2-4f2e-9b4b-bfe77fba3792]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:27:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:27:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:27:58 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[15550bbc-47ae-4004-b052-4eafd82149a2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:27:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:27:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:27:58 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d22430-a742-40d6-bdc1-ecd3c4b32684]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:27:58 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f5b3d0-ef3d-4206-85d6-72fbc789d00a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:27:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:27:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:27:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 05:27:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:27:58 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:27:58 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 05:27:58 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b075b7b-79a0-4427-8e5f-f8466320dbe6]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:27:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 05:27:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 05:27:58 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 05:27:58 user nova-compute[72444]: DEBUG os_brick.utils [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:27:58 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Updating existing volume attachment record: 4d6460df-c0dd-405a-be03-0759cd758b67 {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 05:28:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:28:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:28:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:28:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:28:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:28:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:28:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:28:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:28:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:28:10 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 05:28:10 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sNHCgriJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:28:10 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:28:10 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:28:10 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:28:11 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:28:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:28:11 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 05:28:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[695099f2-0692-4822-b01e-40f259ccb080]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 05:28:11 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d998f68-46c1-45c1-8b30-41933596491b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d] added
Aug 03 05:28:11 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9327cb59-dd89-4fe7-a6e4-18be3f1a6efc]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cb727d-9128-4217-abd2-ecc216801b96]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sNHCgriJ {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sNHCgriJ" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc48d2e-9606-4ca7-9125-228dc50125d2]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sNHCgriJ'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ba494f-1bd5-4771-b286-5baaea6089e0]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0fd503-f10b-49f2-bdc2-14d459cd0e98]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 03 05:28:11 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 03 05:28:11 user nova-compute[72444]:  {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:28:11 user nova-compute[72444]: WARNING os_brick.initiator.connectors.iscsi [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 03 05:28:11 user nova-compute[72444]: 
Aug 03 05:28:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00ed704-4eec-451a-ad28-8fe7f53f9590]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d, portal: 172.16.0.220,3260]
Aug 03 05:28:11 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d, portal: 172.16.0.220,3260] successful.
Aug 03 05:28:11 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de6e5de-22ea-475e-8686-335287309bda]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[038b616a-6a2f-4537-9b16-b807afaa6c13]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d (non-flash)
Aug 03 05:28:11 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d (non-flash)
Aug 03 05:28:11 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda11542-a944-42f8-97bb-4473e5bb5f8d]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:28:11 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: None {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 05:28:12 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 05:28:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sNHCgriJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 05:28:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.269s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:28:12 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] <== connect_volume: return (1272ms) {'type': 'block', 'scsi_wwn': '26665353332303532', 'path': '/dev/sdb'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:28:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665353332303532', 'path': '/dev/sdb'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 05:28:12 user nova-compute[72444]: DEBUG nova.objects.instance [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lazy-loading 'flavor' on Instance uuid 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:28:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 05:28:12 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:28:12 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 05:28:12 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 05:28:12 user nova-compute[72444]:   <serial>39834e6b-75c5-451e-8958-76c65fed795d</serial>
Aug 03 05:28:12 user nova-compute[72444]: </disk>
Aug 03 05:28:12 user nova-compute[72444]:  {{(pid=72444) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 05:28:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:28:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:28:12 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] No VIF found with MAC fa:16:3e:e4:da:25, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 05:28:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-ca24e2df-c33a-4010-8280-5a1c4ac8c5de tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.278s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8d3586e9-dcaf-4361-bea8-0b5a8b75bc1a tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8d3586e9-dcaf-4361-bea8-0b5a8b75bc1a tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:28:14 user nova-compute[72444]: INFO nova.compute.manager [None req-8d3586e9-dcaf-4361-bea8-0b5a8b75bc1a tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Detaching volume 39834e6b-75c5-451e-8958-76c65fed795d
Aug 03 05:28:14 user nova-compute[72444]: INFO nova.virt.block_device [None req-8d3586e9-dcaf-4361-bea8-0b5a8b75bc1a tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Attempting to driver detach volume 39834e6b-75c5-451e-8958-76c65fed795d from mountpoint /dev/vdb
Aug 03 05:28:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-8d3586e9-dcaf-4361-bea8-0b5a8b75bc1a tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Attempting to detach device vdb from instance 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f from the persistent domain config. {{(pid=72444) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-8d3586e9-dcaf-4361-bea8-0b5a8b75bc1a tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 05:28:14 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:28:14 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 05:28:14 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 05:28:14 user nova-compute[72444]:   <serial>39834e6b-75c5-451e-8958-76c65fed795d</serial>
Aug 03 05:28:14 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 05:28:14 user nova-compute[72444]: </disk>
Aug 03 05:28:14 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 05:28:14 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-8d3586e9-dcaf-4361-bea8-0b5a8b75bc1a tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Successfully detached device vdb from instance 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f from the persistent domain config.
Aug 03 05:28:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-8d3586e9-dcaf-4361-bea8-0b5a8b75bc1a tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f from the live domain config. {{(pid=72444) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-8d3586e9-dcaf-4361-bea8-0b5a8b75bc1a tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 05:28:14 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:28:14 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 05:28:14 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 05:28:14 user nova-compute[72444]:   <serial>39834e6b-75c5-451e-8958-76c65fed795d</serial>
Aug 03 05:28:14 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 05:28:14 user nova-compute[72444]: </disk>
Aug 03 05:28:14 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Received event <DeviceRemovedEvent: 1691040494.5736365, 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72444) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-8d3586e9-dcaf-4361-bea8-0b5a8b75bc1a tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f {{(pid=72444) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 05:28:14 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-8d3586e9-dcaf-4361-bea8-0b5a8b75bc1a tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Successfully detached device vdb from instance 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f from the live domain config.
Aug 03 05:28:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d3586e9-dcaf-4361-bea8-0b5a8b75bc1a tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3586e9-dcaf-4361-bea8-0b5a8b75bc1a tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sNHCgriJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:28:14 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-8d3586e9-dcaf-4361-bea8-0b5a8b75bc1a tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:28:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-8d3586e9-dcaf-4361-bea8-0b5a8b75bc1a tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-8d3586e9-dcaf-4361-bea8-0b5a8b75bc1a tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3586e9-dcaf-4361-bea8-0b5a8b75bc1a tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[002b8b3e-b867-40d7-ab4b-caed3d2117ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e122c7bf-ab36-41bd-9ca2-c42c24461961]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3586e9-dcaf-4361-bea8-0b5a8b75bc1a tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d (non-flash)
Aug 03 05:28:14 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3586e9-dcaf-4361-bea8-0b5a8b75bc1a tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d (non-flash)
Aug 03 05:28:14 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3586e9-dcaf-4361-bea8-0b5a8b75bc1a tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3094306c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d'): ({'sdb'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-8d3586e9-dcaf-4361-bea8-0b5a8b75bc1a tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Removing single pathed devices sdb {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa827c44-2223-48ca-8fdb-c7dd7a30b435]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[21193599-fd16-4209-b89d-f10702f2f68a]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-8d3586e9-dcaf-4361-bea8-0b5a8b75bc1a tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Flushing IO for device /dev/sdb {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc705281-6e76-428f-9c6f-f82f69ba3d9e]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-8d3586e9-dcaf-4361-bea8-0b5a8b75bc1a tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[83597c93-42b2-40a1-bbaa-d04652e0ae0b]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-8d3586e9-dcaf-4361-bea8-0b5a8b75bc1a tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-8d3586e9-dcaf-4361-bea8-0b5a8b75bc1a tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3586e9-dcaf-4361-bea8-0b5a8b75bc1a tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[93475c88-652f-47f3-a833-4a320a051335]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3586e9-dcaf-4361-bea8-0b5a8b75bc1a tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3b7d48-2c6c-4c81-997d-b97ab493ed99]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3586e9-dcaf-4361-bea8-0b5a8b75bc1a tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d, portal: 172.16.0.220,3260]
Aug 03 05:28:14 user nova-compute[72444]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d, portal: 172.16.0.220,3260] successful.
Aug 03 05:28:14 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39834e6b-75c5-451e-8958-76c65fed795d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d5f8cf-346f-4f66-9d1e-22a40b429b46]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3586e9-dcaf-4361-bea8-0b5a8b75bc1a tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-8d3586e9-dcaf-4361-bea8-0b5a8b75bc1a tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.251s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3586e9-dcaf-4361-bea8-0b5a8b75bc1a tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] <== disconnect_volume: return (252ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:28:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d3586e9-dcaf-4361-bea8-0b5a8b75bc1a tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 05:28:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:28:15 user nova-compute[72444]: DEBUG nova.objects.instance [None req-8d3586e9-dcaf-4361-bea8-0b5a8b75bc1a tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lazy-loading 'flavor' on Instance uuid 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:28:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-8d3586e9-dcaf-4361-bea8-0b5a8b75bc1a tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.567s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:28:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:28:20 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:28:22 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:28:23 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:28:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:28:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:28:27 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:28:27 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:28:27 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Rebuilding the list of instances to heal {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 05:28:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:28:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:28:28 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 05:28:28 user nova-compute[72444]: DEBUG nova.objects.instance [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lazy-loading 'info_cache' on Instance uuid 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:28:28 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Updating instance_info_cache with network_info: [{"id": "298308f5-3e71-4c65-8ff1-73ed244ab60c", "address": "fa:16:3e:e4:da:25", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298308f5-3e", "ovs_interfaceid": "298308f5-3e71-4c65-8ff1-73ed244ab60c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:28:28 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:28:28 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 05:28:28 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:28:28 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:28:28 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 05:28:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:28:30 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:28:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:28:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:28:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:28:30 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:28:31 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:28:31 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:28:31 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:28:31 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:28:31 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:28:31 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:28:31 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=8786MB free_disk=25.320068359375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:28:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:28:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:28:31 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:28:31 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:28:31 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:28:31 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:28:31 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:28:31 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:28:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:28:34 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:28:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:28:36 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:28:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:28:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:28:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:28:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:28:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:28:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:28:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:28:48 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:28:49 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Triggering sync for uuid 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f {{(pid=72444) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 03 05:28:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:28:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:28:49 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:28:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:28:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:29:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:29:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:29:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:29:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:29:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:29:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:29:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-da80c058-9f12-4d35-b6fb-1f6da611f8e0 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:29:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-da80c058-9f12-4d35-b6fb-1f6da611f8e0 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:29:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-da80c058-9f12-4d35-b6fb-1f6da611f8e0 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:29:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-da80c058-9f12-4d35-b6fb-1f6da611f8e0 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:29:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-da80c058-9f12-4d35-b6fb-1f6da611f8e0 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:29:04 user nova-compute[72444]: INFO nova.compute.manager [None req-da80c058-9f12-4d35-b6fb-1f6da611f8e0 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Terminating instance
Aug 03 05:29:04 user nova-compute[72444]: DEBUG nova.compute.manager [None req-da80c058-9f12-4d35-b6fb-1f6da611f8e0 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 05:29:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:29:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:29:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:29:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:29:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:29:04 user nova-compute[72444]: DEBUG nova.compute.manager [req-724a2844-3f1c-4c18-86b5-9af36ca4145b req-d87c41f7-c3b4-431c-bffa-d5f6c0e73073 service nova] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Received event network-vif-unplugged-298308f5-3e71-4c65-8ff1-73ed244ab60c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:29:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-724a2844-3f1c-4c18-86b5-9af36ca4145b req-d87c41f7-c3b4-431c-bffa-d5f6c0e73073 service nova] Acquiring lock "8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:29:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-724a2844-3f1c-4c18-86b5-9af36ca4145b req-d87c41f7-c3b4-431c-bffa-d5f6c0e73073 service nova] Lock "8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:29:04 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-724a2844-3f1c-4c18-86b5-9af36ca4145b req-d87c41f7-c3b4-431c-bffa-d5f6c0e73073 service nova] Lock "8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:29:04 user nova-compute[72444]: DEBUG nova.compute.manager [req-724a2844-3f1c-4c18-86b5-9af36ca4145b req-d87c41f7-c3b4-431c-bffa-d5f6c0e73073 service nova] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] No waiting events found dispatching network-vif-unplugged-298308f5-3e71-4c65-8ff1-73ed244ab60c {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:29:04 user nova-compute[72444]: DEBUG nova.compute.manager [req-724a2844-3f1c-4c18-86b5-9af36ca4145b req-d87c41f7-c3b4-431c-bffa-d5f6c0e73073 service nova] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Received event network-vif-unplugged-298308f5-3e71-4c65-8ff1-73ed244ab60c for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 05:29:04 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:29:05 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Instance destroyed successfully.
Aug 03 05:29:05 user nova-compute[72444]: DEBUG nova.objects.instance [None req-da80c058-9f12-4d35-b6fb-1f6da611f8e0 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lazy-loading 'resources' on Instance uuid 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:29:05 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-da80c058-9f12-4d35-b6fb-1f6da611f8e0 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:26:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1334300981',display_name='tempest-AttachVolumeNegativeTest-server-1334300981',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1334300981',id=51,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMRFRIkci8lUlb3P2m/Phgmgte4T0lBAX5yPwzmoweq2BIYuRsZEw4orceftB4pxxixjTRVpV//kJJ6i6XffMJNj45rr41n5+lSw8HA93iEuaQ/UsNXpTRvfGJ7pO73RAw==',key_name='tempest-keypair-329142450',keypairs=<?>,launch_index=0,launched_at=2023-08-03T05:26:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d8210385d97453ab4befb159a457772',ramdisk_id='',reservation_id='r-ksh5u8mz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1998464271',owner_user_name='tempest-AttachVolumeNegativeTest-1998464271-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T05:26:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39ca6b589ce84537984e0df64b6085f3',uuid=8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "298308f5-3e71-4c65-8ff1-73ed244ab60c", "address": "fa:16:3e:e4:da:25", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298308f5-3e", "ovs_interfaceid": "298308f5-3e71-4c65-8ff1-73ed244ab60c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 05:29:05 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-da80c058-9f12-4d35-b6fb-1f6da611f8e0 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Converting VIF {"id": "298308f5-3e71-4c65-8ff1-73ed244ab60c", "address": "fa:16:3e:e4:da:25", "network": {"id": "9605cf27-7ef3-4664-97b1-a6e1d093ce98", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-880392512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d8210385d97453ab4befb159a457772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298308f5-3e", "ovs_interfaceid": "298308f5-3e71-4c65-8ff1-73ed244ab60c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:29:05 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-da80c058-9f12-4d35-b6fb-1f6da611f8e0 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:da:25,bridge_name='br-int',has_traffic_filtering=True,id=298308f5-3e71-4c65-8ff1-73ed244ab60c,network=Network(9605cf27-7ef3-4664-97b1-a6e1d093ce98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap298308f5-3e') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:29:05 user nova-compute[72444]: DEBUG os_vif [None req-da80c058-9f12-4d35-b6fb-1f6da611f8e0 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:da:25,bridge_name='br-int',has_traffic_filtering=True,id=298308f5-3e71-4c65-8ff1-73ed244ab60c,network=Network(9605cf27-7ef3-4664-97b1-a6e1d093ce98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap298308f5-3e') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 05:29:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:29:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap298308f5-3e, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:29:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:29:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:29:05 user nova-compute[72444]: INFO os_vif [None req-da80c058-9f12-4d35-b6fb-1f6da611f8e0 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:da:25,bridge_name='br-int',has_traffic_filtering=True,id=298308f5-3e71-4c65-8ff1-73ed244ab60c,network=Network(9605cf27-7ef3-4664-97b1-a6e1d093ce98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap298308f5-3e')
Aug 03 05:29:05 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-da80c058-9f12-4d35-b6fb-1f6da611f8e0 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Deleting instance files /opt/stack/data/nova/instances/8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f_del
Aug 03 05:29:05 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-da80c058-9f12-4d35-b6fb-1f6da611f8e0 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Deletion of /opt/stack/data/nova/instances/8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f_del complete
Aug 03 05:29:05 user nova-compute[72444]: INFO nova.compute.manager [None req-da80c058-9f12-4d35-b6fb-1f6da611f8e0 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 03 05:29:05 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-da80c058-9f12-4d35-b6fb-1f6da611f8e0 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 05:29:05 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 05:29:05 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 05:29:06 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:29:06 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Took 0.78 seconds to deallocate network for instance.
Aug 03 05:29:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-da80c058-9f12-4d35-b6fb-1f6da611f8e0 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:29:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-da80c058-9f12-4d35-b6fb-1f6da611f8e0 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:29:06 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-da80c058-9f12-4d35-b6fb-1f6da611f8e0 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:29:06 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-da80c058-9f12-4d35-b6fb-1f6da611f8e0 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:29:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-da80c058-9f12-4d35-b6fb-1f6da611f8e0 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.120s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:29:06 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-da80c058-9f12-4d35-b6fb-1f6da611f8e0 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Deleted allocations for instance 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f
Aug 03 05:29:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-da80c058-9f12-4d35-b6fb-1f6da611f8e0 tempest-AttachVolumeNegativeTest-1998464271 tempest-AttachVolumeNegativeTest-1998464271-project-member] Lock "8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.945s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:29:06 user nova-compute[72444]: DEBUG nova.compute.manager [req-0c1966b8-59f6-47a3-a823-11b664e3a8df req-94d0696d-779f-4b2c-bdf2-6f4ba0e8ec70 service nova] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Received event network-vif-plugged-298308f5-3e71-4c65-8ff1-73ed244ab60c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:29:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0c1966b8-59f6-47a3-a823-11b664e3a8df req-94d0696d-779f-4b2c-bdf2-6f4ba0e8ec70 service nova] Acquiring lock "8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:29:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0c1966b8-59f6-47a3-a823-11b664e3a8df req-94d0696d-779f-4b2c-bdf2-6f4ba0e8ec70 service nova] Lock "8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:29:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0c1966b8-59f6-47a3-a823-11b664e3a8df req-94d0696d-779f-4b2c-bdf2-6f4ba0e8ec70 service nova] Lock "8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:29:06 user nova-compute[72444]: DEBUG nova.compute.manager [req-0c1966b8-59f6-47a3-a823-11b664e3a8df req-94d0696d-779f-4b2c-bdf2-6f4ba0e8ec70 service nova] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] No waiting events found dispatching network-vif-plugged-298308f5-3e71-4c65-8ff1-73ed244ab60c {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:29:06 user nova-compute[72444]: WARNING nova.compute.manager [req-0c1966b8-59f6-47a3-a823-11b664e3a8df req-94d0696d-779f-4b2c-bdf2-6f4ba0e8ec70 service nova] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Received unexpected event network-vif-plugged-298308f5-3e71-4c65-8ff1-73ed244ab60c for instance with vm_state deleted and task_state None.
Aug 03 05:29:06 user nova-compute[72444]: DEBUG nova.compute.manager [req-0c1966b8-59f6-47a3-a823-11b664e3a8df req-94d0696d-779f-4b2c-bdf2-6f4ba0e8ec70 service nova] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Received event network-vif-deleted-298308f5-3e71-4c65-8ff1-73ed244ab60c {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:29:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:29:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:29:20 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691040545.1629014, 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:29:20 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] VM Stopped (Lifecycle Event)
Aug 03 05:29:20 user nova-compute[72444]: DEBUG nova.compute.manager [None req-b43f4c7e-cc7c-45dc-90af-600cf8a0265d None None] [instance: 8aa32cd3-b05f-489e-ae4e-e0353f3e1d2f] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:29:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:29:22 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:29:23 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:29:24 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:29:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:29:27 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:29:27 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:29:27 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Rebuilding the list of instances to heal {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 05:29:27 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Didn't find any instances for network info cache update. {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 03 05:29:29 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:29:29 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:29:29 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 05:29:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:29:30 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:29:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:29:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:29:30 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:29:30 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:29:31 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:29:31 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:29:31 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=8933MB free_disk=25.347332000732422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:29:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:29:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:29:31 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:29:31 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:29:31 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:29:31 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:29:31 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:29:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:29:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:29:36 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:29:37 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:29:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:29:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:29:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:29:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:29:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:29:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:29:42 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:29:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:29:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:29:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:29:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:30:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:30:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:30:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:30:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:30:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:30:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:30:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:30:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:30:12 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:30:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:30:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:30:24 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:30:24 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:30:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:30:25 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:30:29 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:30:29 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:30:29 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Rebuilding the list of instances to heal {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 05:30:29 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Didn't find any instances for network info cache update. {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 03 05:30:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:30:30 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:30:30 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 05:30:31 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:30:31 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:30:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:30:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:30:31 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:30:31 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:30:32 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:30:32 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:30:32 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=8941MB free_disk=25.345298767089844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:30:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:30:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:30:32 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:30:32 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:30:32 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:30:32 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:30:32 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:30:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.111s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:30:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:30:36 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:30:38 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:30:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:30:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:30:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:30:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:30:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:30:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:30:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:30:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:30:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:31:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:31:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:31:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:31:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:31:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:31:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:31:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:31:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:31:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:31:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:31:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:31:19 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:31:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:31:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:31:24 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:31:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:31:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:31:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:31:26 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:31:26 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:31:26 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:31:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:31:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:31:31 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:31:31 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:31:31 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Rebuilding the list of instances to heal {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 05:31:31 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Didn't find any instances for network info cache update. {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 03 05:31:31 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:31:31 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 05:31:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Acquiring lock "85957527-c73a-4654-838e-5ff79e3730fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:31:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "85957527-c73a-4654-838e-5ff79e3730fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:31:32 user nova-compute[72444]: DEBUG nova.compute.manager [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Starting instance... {{(pid=72444) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 03 05:31:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:31:32 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:31:32 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72444) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 03 05:31:32 user nova-compute[72444]: INFO nova.compute.claims [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Claim successful on node user
Aug 03 05:31:32 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:31:32 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:31:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.272s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:31:33 user nova-compute[72444]: DEBUG nova.compute.manager [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Start building networks asynchronously for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 03 05:31:33 user nova-compute[72444]: DEBUG nova.compute.manager [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Allocating IP information in the background. {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 03 05:31:33 user nova-compute[72444]: DEBUG nova.network.neutron [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] allocate_for_instance() {{(pid=72444) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 03 05:31:33 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 03 05:31:33 user nova-compute[72444]: DEBUG nova.compute.manager [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Start building block device mappings for instance. {{(pid=72444) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 03 05:31:33 user nova-compute[72444]: DEBUG nova.policy [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '14a4d925374649e19061ee3ac2c203de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b621a7d2de94a68a8547cf100467d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72444) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 03 05:31:33 user nova-compute[72444]: DEBUG nova.compute.manager [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Start spawning the instance on the hypervisor. {{(pid=72444) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 03 05:31:33 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Creating instance directory {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 03 05:31:33 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Creating image(s)
Aug 03 05:31:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Acquiring lock "/opt/stack/data/nova/instances/85957527-c73a-4654-838e-5ff79e3730fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:31:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "/opt/stack/data/nova/instances/85957527-c73a-4654-838e-5ff79e3730fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:31:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "/opt/stack/data/nova/instances/85957527-c73a-4654-838e-5ff79e3730fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:31:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:31:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.145s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:31:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Acquiring lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:31:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:31:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:31:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.145s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:31:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/85957527-c73a-4654-838e-5ff79e3730fd/disk 1073741824 {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:31:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e,backing_fmt=raw /opt/stack/data/nova/instances/85957527-c73a-4654-838e-5ff79e3730fd/disk 1073741824" returned: 0 in 0.051s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:31:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "28c6862ec5faf5161485750919ad7d82dae2ae3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:31:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:31:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28c6862ec5faf5161485750919ad7d82dae2ae3e --force-share --output=json" returned: 0 in 0.156s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:31:33 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85957527-c73a-4654-838e-5ff79e3730fd/disk. size=1073741824 {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 03 05:31:33 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85957527-c73a-4654-838e-5ff79e3730fd/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:31:33 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:31:33 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:31:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:31:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:31:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:31:33 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:31:34 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85957527-c73a-4654-838e-5ff79e3730fd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:31:34 user nova-compute[72444]: DEBUG nova.virt.disk.api [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Cannot resize image /opt/stack/data/nova/instances/85957527-c73a-4654-838e-5ff79e3730fd/disk to a smaller size. {{(pid=72444) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 03 05:31:34 user nova-compute[72444]: DEBUG nova.objects.instance [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lazy-loading 'migration_context' on Instance uuid 85957527-c73a-4654-838e-5ff79e3730fd {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:31:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Created local disks {{(pid=72444) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 03 05:31:34 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Ensure instance console log exists: /opt/stack/data/nova/instances/85957527-c73a-4654-838e-5ff79e3730fd/console.log {{(pid=72444) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 03 05:31:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:31:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:31:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:31:34 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:31:34 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:31:34 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=8594MB free_disk=25.33099365234375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:31:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:31:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:31:34 user nova-compute[72444]: DEBUG nova.network.neutron [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Successfully created port: 984e9dde-06d9-4b08-81e2-dd3144e6f33b {{(pid=72444) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 03 05:31:34 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 85957527-c73a-4654-838e-5ff79e3730fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:31:34 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:31:34 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:31:34 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:31:34 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:31:34 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:31:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.206s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG nova.network.neutron [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Successfully updated port: 984e9dde-06d9-4b08-81e2-dd3144e6f33b {{(pid=72444) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Acquiring lock "refresh_cache-85957527-c73a-4654-838e-5ff79e3730fd" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Acquired lock "refresh_cache-85957527-c73a-4654-838e-5ff79e3730fd" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG nova.network.neutron [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Building network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG nova.compute.manager [req-3f2e774a-ea48-49a5-86c6-3f729389058a req-081f9275-231b-4202-980c-2441f402a15a service nova] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Received event network-changed-984e9dde-06d9-4b08-81e2-dd3144e6f33b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG nova.compute.manager [req-3f2e774a-ea48-49a5-86c6-3f729389058a req-081f9275-231b-4202-980c-2441f402a15a service nova] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Refreshing instance network info cache due to event network-changed-984e9dde-06d9-4b08-81e2-dd3144e6f33b. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3f2e774a-ea48-49a5-86c6-3f729389058a req-081f9275-231b-4202-980c-2441f402a15a service nova] Acquiring lock "refresh_cache-85957527-c73a-4654-838e-5ff79e3730fd" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG nova.network.neutron [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Instance cache missing network info. {{(pid=72444) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG nova.network.neutron [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Updating instance_info_cache with network_info: [{"id": "984e9dde-06d9-4b08-81e2-dd3144e6f33b", "address": "fa:16:3e:cd:e9:d9", "network": {"id": "27e1a858-dcc9-4e04-a87b-a5659d8cb355", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1432430230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b621a7d2de94a68a8547cf100467d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap984e9dde-06", "ovs_interfaceid": "984e9dde-06d9-4b08-81e2-dd3144e6f33b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Releasing lock "refresh_cache-85957527-c73a-4654-838e-5ff79e3730fd" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG nova.compute.manager [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Instance network_info: |[{"id": "984e9dde-06d9-4b08-81e2-dd3144e6f33b", "address": "fa:16:3e:cd:e9:d9", "network": {"id": "27e1a858-dcc9-4e04-a87b-a5659d8cb355", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1432430230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b621a7d2de94a68a8547cf100467d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap984e9dde-06", "ovs_interfaceid": "984e9dde-06d9-4b08-81e2-dd3144e6f33b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72444) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3f2e774a-ea48-49a5-86c6-3f729389058a req-081f9275-231b-4202-980c-2441f402a15a service nova] Acquired lock "refresh_cache-85957527-c73a-4654-838e-5ff79e3730fd" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG nova.network.neutron [req-3f2e774a-ea48-49a5-86c6-3f729389058a req-081f9275-231b-4202-980c-2441f402a15a service nova] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Refreshing network info cache for port 984e9dde-06d9-4b08-81e2-dd3144e6f33b {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Start _get_guest_xml network_info=[{"id": "984e9dde-06d9-4b08-81e2-dd3144e6f33b", "address": "fa:16:3e:cd:e9:d9", "network": {"id": "27e1a858-dcc9-4e04-a87b-a5659d8cb355", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1432430230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b621a7d2de94a68a8547cf100467d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap984e9dde-06", "ovs_interfaceid": "984e9dde-06d9-4b08-81e2-dd3144e6f33b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'image_id': '9a69e530-bd68-45b7-bffb-f7168139ceb0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 03 05:31:35 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:31:35 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:31:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] CPU controller missing on host. {{(pid=72444) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.host [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] CPU controller found on host. {{(pid=72444) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72444) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-03T04:36:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-03T04:37:01Z,direct_url=<?>,disk_format='qcow2',id=9a69e530-bd68-45b7-bffb-f7168139ceb0,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='50aa3805febd42378b17cc229e7597c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-03T04:37:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Flavor limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Image limits 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Flavor pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Image pref 0:0:0 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Got 1 possible topologies {{(pid=72444) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG nova.virt.hardware [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72444) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:31:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1363968104',display_name='tempest-SnapshotDataIntegrityTests-server-1363968104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1363968104',id=52,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImJdq5wIqWICLn4pNJWRG+vXZAF7PMDTpGJfsyAyjeTHhD4gFrv3nfqvtEMGRB9msFidVTUo7uSnJqxXbSH5rhqIiJkGRjmpPImdO/XJ25T2Z562AziYwLygamV6w7gvw==',key_name='tempest-keypair-2060532131',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b621a7d2de94a68a8547cf100467d11',ramdisk_id='',reservation_id='r-iouz8kn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1218323093',owner_user_name='tempest-SnapshotDataIntegrityTests-1218323093-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:31:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14a4d925374649e19061ee3ac2c203de',uuid=85957527-c73a-4654-838e-5ff79e3730fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "984e9dde-06d9-4b08-81e2-dd3144e6f33b", "address": "fa:16:3e:cd:e9:d9", "network": {"id": "27e1a858-dcc9-4e04-a87b-a5659d8cb355", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1432430230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b621a7d2de94a68a8547cf100467d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap984e9dde-06", "ovs_interfaceid": "984e9dde-06d9-4b08-81e2-dd3144e6f33b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72444) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Converting VIF {"id": "984e9dde-06d9-4b08-81e2-dd3144e6f33b", "address": "fa:16:3e:cd:e9:d9", "network": {"id": "27e1a858-dcc9-4e04-a87b-a5659d8cb355", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1432430230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b621a7d2de94a68a8547cf100467d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap984e9dde-06", "ovs_interfaceid": "984e9dde-06d9-4b08-81e2-dd3144e6f33b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:e9:d9,bridge_name='br-int',has_traffic_filtering=True,id=984e9dde-06d9-4b08-81e2-dd3144e6f33b,network=Network(27e1a858-dcc9-4e04-a87b-a5659d8cb355),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap984e9dde-06') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG nova.objects.instance [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lazy-loading 'pci_devices' on Instance uuid 85957527-c73a-4654-838e-5ff79e3730fd {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] End _get_guest_xml xml=<domain type="kvm">
Aug 03 05:31:35 user nova-compute[72444]:   <uuid>85957527-c73a-4654-838e-5ff79e3730fd</uuid>
Aug 03 05:31:35 user nova-compute[72444]:   <name>instance-00000034</name>
Aug 03 05:31:35 user nova-compute[72444]:   <memory>524288</memory>
Aug 03 05:31:35 user nova-compute[72444]:   <vcpu>1</vcpu>
Aug 03 05:31:35 user nova-compute[72444]:   <metadata>
Aug 03 05:31:35 user nova-compute[72444]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 03 05:31:35 user nova-compute[72444]:       <nova:package version="0.0.0"/>
Aug 03 05:31:35 user nova-compute[72444]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1363968104</nova:name>
Aug 03 05:31:35 user nova-compute[72444]:       <nova:creationTime>2023-08-03 05:31:35</nova:creationTime>
Aug 03 05:31:35 user nova-compute[72444]:       <nova:flavor name="m1.tiny">
Aug 03 05:31:35 user nova-compute[72444]:         <nova:memory>512</nova:memory>
Aug 03 05:31:35 user nova-compute[72444]:         <nova:disk>1</nova:disk>
Aug 03 05:31:35 user nova-compute[72444]:         <nova:swap>0</nova:swap>
Aug 03 05:31:35 user nova-compute[72444]:         <nova:ephemeral>0</nova:ephemeral>
Aug 03 05:31:35 user nova-compute[72444]:         <nova:vcpus>1</nova:vcpus>
Aug 03 05:31:35 user nova-compute[72444]:       </nova:flavor>
Aug 03 05:31:35 user nova-compute[72444]:       <nova:owner>
Aug 03 05:31:35 user nova-compute[72444]:         <nova:user uuid="14a4d925374649e19061ee3ac2c203de">tempest-SnapshotDataIntegrityTests-1218323093-project-member</nova:user>
Aug 03 05:31:35 user nova-compute[72444]:         <nova:project uuid="5b621a7d2de94a68a8547cf100467d11">tempest-SnapshotDataIntegrityTests-1218323093</nova:project>
Aug 03 05:31:35 user nova-compute[72444]:       </nova:owner>
Aug 03 05:31:35 user nova-compute[72444]:       <nova:root type="image" uuid="9a69e530-bd68-45b7-bffb-f7168139ceb0"/>
Aug 03 05:31:35 user nova-compute[72444]:       <nova:ports>
Aug 03 05:31:35 user nova-compute[72444]:         <nova:port uuid="984e9dde-06d9-4b08-81e2-dd3144e6f33b">
Aug 03 05:31:35 user nova-compute[72444]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 03 05:31:35 user nova-compute[72444]:         </nova:port>
Aug 03 05:31:35 user nova-compute[72444]:       </nova:ports>
Aug 03 05:31:35 user nova-compute[72444]:     </nova:instance>
Aug 03 05:31:35 user nova-compute[72444]:   </metadata>
Aug 03 05:31:35 user nova-compute[72444]:   <sysinfo type="smbios">
Aug 03 05:31:35 user nova-compute[72444]:     <system>
Aug 03 05:31:35 user nova-compute[72444]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 03 05:31:35 user nova-compute[72444]:       <entry name="product">OpenStack Nova</entry>
Aug 03 05:31:35 user nova-compute[72444]:       <entry name="version">0.0.0</entry>
Aug 03 05:31:35 user nova-compute[72444]:       <entry name="serial">85957527-c73a-4654-838e-5ff79e3730fd</entry>
Aug 03 05:31:35 user nova-compute[72444]:       <entry name="uuid">85957527-c73a-4654-838e-5ff79e3730fd</entry>
Aug 03 05:31:35 user nova-compute[72444]:       <entry name="family">Virtual Machine</entry>
Aug 03 05:31:35 user nova-compute[72444]:     </system>
Aug 03 05:31:35 user nova-compute[72444]:   </sysinfo>
Aug 03 05:31:35 user nova-compute[72444]:   <os>
Aug 03 05:31:35 user nova-compute[72444]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 03 05:31:35 user nova-compute[72444]:     <boot dev="hd"/>
Aug 03 05:31:35 user nova-compute[72444]:     <smbios mode="sysinfo"/>
Aug 03 05:31:35 user nova-compute[72444]:   </os>
Aug 03 05:31:35 user nova-compute[72444]:   <features>
Aug 03 05:31:35 user nova-compute[72444]:     <acpi/>
Aug 03 05:31:35 user nova-compute[72444]:     <apic/>
Aug 03 05:31:35 user nova-compute[72444]:     <vmcoreinfo/>
Aug 03 05:31:35 user nova-compute[72444]:   </features>
Aug 03 05:31:35 user nova-compute[72444]:   <clock offset="utc">
Aug 03 05:31:35 user nova-compute[72444]:     <timer name="pit" tickpolicy="delay"/>
Aug 03 05:31:35 user nova-compute[72444]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 03 05:31:35 user nova-compute[72444]:     <timer name="hpet" present="no"/>
Aug 03 05:31:35 user nova-compute[72444]:   </clock>
Aug 03 05:31:35 user nova-compute[72444]:   <cpu mode="custom" match="exact">
Aug 03 05:31:35 user nova-compute[72444]:     <model>Nehalem</model>
Aug 03 05:31:35 user nova-compute[72444]:     <topology sockets="1" cores="1" threads="1"/>
Aug 03 05:31:35 user nova-compute[72444]:   </cpu>
Aug 03 05:31:35 user nova-compute[72444]:   <devices>
Aug 03 05:31:35 user nova-compute[72444]:     <disk type="file" device="disk">
Aug 03 05:31:35 user nova-compute[72444]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 03 05:31:35 user nova-compute[72444]:       <source file="/opt/stack/data/nova/instances/85957527-c73a-4654-838e-5ff79e3730fd/disk"/>
Aug 03 05:31:35 user nova-compute[72444]:       <target dev="vda" bus="virtio"/>
Aug 03 05:31:35 user nova-compute[72444]:     </disk>
Aug 03 05:31:35 user nova-compute[72444]:     <interface type="ethernet">
Aug 03 05:31:35 user nova-compute[72444]:       <mac address="fa:16:3e:cd:e9:d9"/>
Aug 03 05:31:35 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:31:35 user nova-compute[72444]:       <mtu size="1442"/>
Aug 03 05:31:35 user nova-compute[72444]:       <target dev="tap984e9dde-06"/>
Aug 03 05:31:35 user nova-compute[72444]:     </interface>
Aug 03 05:31:35 user nova-compute[72444]:     <serial type="pty">
Aug 03 05:31:35 user nova-compute[72444]:       <log file="/opt/stack/data/nova/instances/85957527-c73a-4654-838e-5ff79e3730fd/console.log" append="off"/>
Aug 03 05:31:35 user nova-compute[72444]:     </serial>
Aug 03 05:31:35 user nova-compute[72444]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 03 05:31:35 user nova-compute[72444]:     <video>
Aug 03 05:31:35 user nova-compute[72444]:       <model type="virtio"/>
Aug 03 05:31:35 user nova-compute[72444]:     </video>
Aug 03 05:31:35 user nova-compute[72444]:     <rng model="virtio">
Aug 03 05:31:35 user nova-compute[72444]:       <backend model="random">/dev/urandom</backend>
Aug 03 05:31:35 user nova-compute[72444]:     </rng>
Aug 03 05:31:35 user nova-compute[72444]:     <controller type="usb" index="0" model="none"/>
Aug 03 05:31:35 user nova-compute[72444]:     <memballoon model="virtio">
Aug 03 05:31:35 user nova-compute[72444]:       <stats period="10"/>
Aug 03 05:31:35 user nova-compute[72444]:     </memballoon>
Aug 03 05:31:35 user nova-compute[72444]:   </devices>
Aug 03 05:31:35 user nova-compute[72444]: </domain>
Aug 03 05:31:35 user nova-compute[72444]:  {{(pid=72444) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:31:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1363968104',display_name='tempest-SnapshotDataIntegrityTests-server-1363968104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1363968104',id=52,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImJdq5wIqWICLn4pNJWRG+vXZAF7PMDTpGJfsyAyjeTHhD4gFrv3nfqvtEMGRB9msFidVTUo7uSnJqxXbSH5rhqIiJkGRjmpPImdO/XJ25T2Z562AziYwLygamV6w7gvw==',key_name='tempest-keypair-2060532131',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b621a7d2de94a68a8547cf100467d11',ramdisk_id='',reservation_id='r-iouz8kn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1218323093',owner_user_name='tempest-SnapshotDataIntegrityTests-1218323093-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-03T05:31:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14a4d925374649e19061ee3ac2c203de',uuid=85957527-c73a-4654-838e-5ff79e3730fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "984e9dde-06d9-4b08-81e2-dd3144e6f33b", "address": "fa:16:3e:cd:e9:d9", "network": {"id": "27e1a858-dcc9-4e04-a87b-a5659d8cb355", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1432430230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b621a7d2de94a68a8547cf100467d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap984e9dde-06", "ovs_interfaceid": "984e9dde-06d9-4b08-81e2-dd3144e6f33b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Converting VIF {"id": "984e9dde-06d9-4b08-81e2-dd3144e6f33b", "address": "fa:16:3e:cd:e9:d9", "network": {"id": "27e1a858-dcc9-4e04-a87b-a5659d8cb355", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1432430230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b621a7d2de94a68a8547cf100467d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap984e9dde-06", "ovs_interfaceid": "984e9dde-06d9-4b08-81e2-dd3144e6f33b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:e9:d9,bridge_name='br-int',has_traffic_filtering=True,id=984e9dde-06d9-4b08-81e2-dd3144e6f33b,network=Network(27e1a858-dcc9-4e04-a87b-a5659d8cb355),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap984e9dde-06') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG os_vif [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:e9:d9,bridge_name='br-int',has_traffic_filtering=True,id=984e9dde-06d9-4b08-81e2-dd3144e6f33b,network=Network(27e1a858-dcc9-4e04-a87b-a5659d8cb355),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap984e9dde-06') {{(pid=72444) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap984e9dde-06, may_exist=True, interface_attrs={}) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap984e9dde-06, col_values=(('external_ids', {'iface-id': '984e9dde-06d9-4b08-81e2-dd3144e6f33b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:e9:d9', 'vm-uuid': '85957527-c73a-4654-838e-5ff79e3730fd'}),), if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:31:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:31:35 user nova-compute[72444]: INFO os_vif [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:e9:d9,bridge_name='br-int',has_traffic_filtering=True,id=984e9dde-06d9-4b08-81e2-dd3144e6f33b,network=Network(27e1a858-dcc9-4e04-a87b-a5659d8cb355),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap984e9dde-06')
Aug 03 05:31:36 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:31:36 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] No VIF found with MAC fa:16:3e:cd:e9:d9, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 05:31:36 user nova-compute[72444]: DEBUG nova.network.neutron [req-3f2e774a-ea48-49a5-86c6-3f729389058a req-081f9275-231b-4202-980c-2441f402a15a service nova] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Updated VIF entry in instance network info cache for port 984e9dde-06d9-4b08-81e2-dd3144e6f33b. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:31:36 user nova-compute[72444]: DEBUG nova.network.neutron [req-3f2e774a-ea48-49a5-86c6-3f729389058a req-081f9275-231b-4202-980c-2441f402a15a service nova] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Updating instance_info_cache with network_info: [{"id": "984e9dde-06d9-4b08-81e2-dd3144e6f33b", "address": "fa:16:3e:cd:e9:d9", "network": {"id": "27e1a858-dcc9-4e04-a87b-a5659d8cb355", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1432430230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b621a7d2de94a68a8547cf100467d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap984e9dde-06", "ovs_interfaceid": "984e9dde-06d9-4b08-81e2-dd3144e6f33b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:31:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-3f2e774a-ea48-49a5-86c6-3f729389058a req-081f9275-231b-4202-980c-2441f402a15a service nova] Releasing lock "refresh_cache-85957527-c73a-4654-838e-5ff79e3730fd" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:31:36 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:31:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:31:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:31:37 user nova-compute[72444]: DEBUG nova.compute.manager [req-ccc724db-c4cb-4c3f-ada5-b45d28dd3c1e req-5c46d89a-e49a-44ae-a21b-3cff73f50886 service nova] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Received event network-vif-plugged-984e9dde-06d9-4b08-81e2-dd3144e6f33b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:31:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ccc724db-c4cb-4c3f-ada5-b45d28dd3c1e req-5c46d89a-e49a-44ae-a21b-3cff73f50886 service nova] Acquiring lock "85957527-c73a-4654-838e-5ff79e3730fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:31:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ccc724db-c4cb-4c3f-ada5-b45d28dd3c1e req-5c46d89a-e49a-44ae-a21b-3cff73f50886 service nova] Lock "85957527-c73a-4654-838e-5ff79e3730fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:31:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ccc724db-c4cb-4c3f-ada5-b45d28dd3c1e req-5c46d89a-e49a-44ae-a21b-3cff73f50886 service nova] Lock "85957527-c73a-4654-838e-5ff79e3730fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:31:37 user nova-compute[72444]: DEBUG nova.compute.manager [req-ccc724db-c4cb-4c3f-ada5-b45d28dd3c1e req-5c46d89a-e49a-44ae-a21b-3cff73f50886 service nova] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] No waiting events found dispatching network-vif-plugged-984e9dde-06d9-4b08-81e2-dd3144e6f33b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:31:37 user nova-compute[72444]: WARNING nova.compute.manager [req-ccc724db-c4cb-4c3f-ada5-b45d28dd3c1e req-5c46d89a-e49a-44ae-a21b-3cff73f50886 service nova] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Received unexpected event network-vif-plugged-984e9dde-06d9-4b08-81e2-dd3144e6f33b for instance with vm_state building and task_state spawning.
Aug 03 05:31:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:31:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:31:38 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:31:39 user nova-compute[72444]: DEBUG nova.compute.manager [req-ad340462-032c-4c30-ac8a-c98d603cdd75 req-6d14fb00-4552-476c-8f88-15e1afbf8c8b service nova] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Received event network-vif-plugged-984e9dde-06d9-4b08-81e2-dd3144e6f33b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:31:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ad340462-032c-4c30-ac8a-c98d603cdd75 req-6d14fb00-4552-476c-8f88-15e1afbf8c8b service nova] Acquiring lock "85957527-c73a-4654-838e-5ff79e3730fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:31:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ad340462-032c-4c30-ac8a-c98d603cdd75 req-6d14fb00-4552-476c-8f88-15e1afbf8c8b service nova] Lock "85957527-c73a-4654-838e-5ff79e3730fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:31:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-ad340462-032c-4c30-ac8a-c98d603cdd75 req-6d14fb00-4552-476c-8f88-15e1afbf8c8b service nova] Lock "85957527-c73a-4654-838e-5ff79e3730fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:31:39 user nova-compute[72444]: DEBUG nova.compute.manager [req-ad340462-032c-4c30-ac8a-c98d603cdd75 req-6d14fb00-4552-476c-8f88-15e1afbf8c8b service nova] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] No waiting events found dispatching network-vif-plugged-984e9dde-06d9-4b08-81e2-dd3144e6f33b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:31:39 user nova-compute[72444]: WARNING nova.compute.manager [req-ad340462-032c-4c30-ac8a-c98d603cdd75 req-6d14fb00-4552-476c-8f88-15e1afbf8c8b service nova] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Received unexpected event network-vif-plugged-984e9dde-06d9-4b08-81e2-dd3144e6f33b for instance with vm_state building and task_state spawning.
Aug 03 05:31:39 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691040699.7864978, 85957527-c73a-4654-838e-5ff79e3730fd => Resumed> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:31:39 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] VM Resumed (Lifecycle Event)
Aug 03 05:31:39 user nova-compute[72444]: DEBUG nova.compute.manager [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Instance event wait completed in 0 seconds for  {{(pid=72444) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 03 05:31:39 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Guest created on hypervisor {{(pid=72444) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 03 05:31:39 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Instance spawned successfully.
Aug 03 05:31:39 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 03 05:31:39 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:31:39 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:31:39 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Found default for hw_cdrom_bus of ide {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:31:39 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Found default for hw_disk_bus of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:31:39 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Found default for hw_input_bus of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:31:39 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Found default for hw_pointer_model of None {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:31:39 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Found default for hw_video_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:31:39 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Found default for hw_vif_model of virtio {{(pid=72444) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 03 05:31:39 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 05:31:39 user nova-compute[72444]: DEBUG nova.virt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Emitting event <LifecycleEvent: 1691040699.7883298, 85957527-c73a-4654-838e-5ff79e3730fd => Started> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:31:39 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] VM Started (Lifecycle Event)
Aug 03 05:31:39 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:31:39 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:31:39 user nova-compute[72444]: DEBUG nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72444) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 03 05:31:39 user nova-compute[72444]: INFO nova.compute.manager [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 03 05:31:39 user nova-compute[72444]: INFO nova.compute.manager [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Took 6.65 seconds to spawn the instance on the hypervisor.
Aug 03 05:31:39 user nova-compute[72444]: DEBUG nova.compute.manager [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:31:40 user nova-compute[72444]: INFO nova.compute.manager [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Took 7.34 seconds to build instance.
Aug 03 05:31:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-d1393b33-38e4-4ebe-9121-1d1c35bc8d0c tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "85957527-c73a-4654-838e-5ff79e3730fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.458s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:31:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:31:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:31:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:31:47 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:31:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:31:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:31:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:31:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:32:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:32:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:32:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:32:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:32:10 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:32:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:32:15 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:32:17 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:32:20 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:32:21 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:32:21 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Cleaning up deleted instances {{(pid=72444) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 03 05:32:21 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] There are 0 instances to clean {{(pid=72444) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 03 05:32:25 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:32:26 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:32:27 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:32:28 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:32:30 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:32:31 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:32:31 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 05:32:33 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:32:33 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:32:33 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Rebuilding the list of instances to heal {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 05:32:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-85957527-c73a-4654-838e-5ff79e3730fd" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:32:33 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-85957527-c73a-4654-838e-5ff79e3730fd" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:32:33 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 05:32:33 user nova-compute[72444]: DEBUG nova.objects.instance [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lazy-loading 'info_cache' on Instance uuid 85957527-c73a-4654-838e-5ff79e3730fd {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:32:34 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Updating instance_info_cache with network_info: [{"id": "984e9dde-06d9-4b08-81e2-dd3144e6f33b", "address": "fa:16:3e:cd:e9:d9", "network": {"id": "27e1a858-dcc9-4e04-a87b-a5659d8cb355", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1432430230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b621a7d2de94a68a8547cf100467d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap984e9dde-06", "ovs_interfaceid": "984e9dde-06d9-4b08-81e2-dd3144e6f33b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:32:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-85957527-c73a-4654-838e-5ff79e3730fd" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:32:34 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 05:32:34 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:32:34 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:32:34 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72444) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 03 05:32:34 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:32:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:32:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:32:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:32:34 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:32:35 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85957527-c73a-4654-838e-5ff79e3730fd/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:32:35 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85957527-c73a-4654-838e-5ff79e3730fd/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:32:35 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85957527-c73a-4654-838e-5ff79e3730fd/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:32:35 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85957527-c73a-4654-838e-5ff79e3730fd/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:32:35 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:32:35 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:32:35 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=8712MB free_disk=25.29916763305664GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:32:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:32:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:32:35 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:32:35 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 85957527-c73a-4654-838e-5ff79e3730fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:32:35 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:32:35 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:32:36 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Refreshing inventories for resource provider b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 03 05:32:36 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Updating ProviderTree inventory for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 03 05:32:36 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Updating inventory in ProviderTree for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 03 05:32:36 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Refreshing aggregate associations for resource provider b624a913-bb6b-4a17-8cd7-7b0950cff161, aggregates: None {{(pid=72444) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 03 05:32:36 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Refreshing trait associations for resource provider b624a913-bb6b-4a17-8cd7-7b0950cff161, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=72444) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 03 05:32:36 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:32:36 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:32:36 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:32:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.490s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:32:37 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:32:40 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:32:41 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:32:44 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:32:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:32:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:32:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:32:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:32:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:32:45 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:32:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:32:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:32:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:32:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:32:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:32:50 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:32:55 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:33:00 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:33:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:33:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:33:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:33:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:33:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:33:05 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:33:07 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:33:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:33:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:33:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:33:24 user nova-compute[72444]: DEBUG nova.compute.manager [req-0f27121d-c3a2-472a-a1cf-daa8e948bc51 req-aab1d707-28d6-4118-bddb-3bc270e89b51 service nova] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Received event network-changed-984e9dde-06d9-4b08-81e2-dd3144e6f33b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:33:24 user nova-compute[72444]: DEBUG nova.compute.manager [req-0f27121d-c3a2-472a-a1cf-daa8e948bc51 req-aab1d707-28d6-4118-bddb-3bc270e89b51 service nova] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Refreshing instance network info cache due to event network-changed-984e9dde-06d9-4b08-81e2-dd3144e6f33b. {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 03 05:33:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0f27121d-c3a2-472a-a1cf-daa8e948bc51 req-aab1d707-28d6-4118-bddb-3bc270e89b51 service nova] Acquiring lock "refresh_cache-85957527-c73a-4654-838e-5ff79e3730fd" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:33:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0f27121d-c3a2-472a-a1cf-daa8e948bc51 req-aab1d707-28d6-4118-bddb-3bc270e89b51 service nova] Acquired lock "refresh_cache-85957527-c73a-4654-838e-5ff79e3730fd" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:33:24 user nova-compute[72444]: DEBUG nova.network.neutron [req-0f27121d-c3a2-472a-a1cf-daa8e948bc51 req-aab1d707-28d6-4118-bddb-3bc270e89b51 service nova] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Refreshing network info cache for port 984e9dde-06d9-4b08-81e2-dd3144e6f33b {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 03 05:33:24 user nova-compute[72444]: DEBUG nova.network.neutron [req-0f27121d-c3a2-472a-a1cf-daa8e948bc51 req-aab1d707-28d6-4118-bddb-3bc270e89b51 service nova] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Updated VIF entry in instance network info cache for port 984e9dde-06d9-4b08-81e2-dd3144e6f33b. {{(pid=72444) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 03 05:33:24 user nova-compute[72444]: DEBUG nova.network.neutron [req-0f27121d-c3a2-472a-a1cf-daa8e948bc51 req-aab1d707-28d6-4118-bddb-3bc270e89b51 service nova] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Updating instance_info_cache with network_info: [{"id": "984e9dde-06d9-4b08-81e2-dd3144e6f33b", "address": "fa:16:3e:cd:e9:d9", "network": {"id": "27e1a858-dcc9-4e04-a87b-a5659d8cb355", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1432430230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b621a7d2de94a68a8547cf100467d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap984e9dde-06", "ovs_interfaceid": "984e9dde-06d9-4b08-81e2-dd3144e6f33b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:33:24 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-0f27121d-c3a2-472a-a1cf-daa8e948bc51 req-aab1d707-28d6-4118-bddb-3bc270e89b51 service nova] Releasing lock "refresh_cache-85957527-c73a-4654-838e-5ff79e3730fd" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:33:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:33:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:33:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:33:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:33:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:33:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:33:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:33:27 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:33:27 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:33:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Acquiring lock "85957527-c73a-4654-838e-5ff79e3730fd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:33:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "85957527-c73a-4654-838e-5ff79e3730fd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:33:29 user nova-compute[72444]: DEBUG nova.objects.instance [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lazy-loading 'flavor' on Instance uuid 85957527-c73a-4654-838e-5ff79e3730fd {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:33:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "85957527-c73a-4654-838e-5ff79e3730fd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:33:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Acquiring lock "85957527-c73a-4654-838e-5ff79e3730fd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:33:29 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "85957527-c73a-4654-838e-5ff79e3730fd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:33:29 user nova-compute[72444]: INFO nova.compute.manager [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Attaching volume 4d090418-026f-4c3f-8b4a-a935791ad554 to /dev/vdb
Aug 03 05:33:29 user nova-compute[72444]: DEBUG os_brick.utils [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:33:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:33:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:33:29 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4284f13-8d87-4a09-93cd-223c5ffb478c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:33:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:33:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:33:29 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7899ba-b242-47bb-a285-d9390d5393b5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:33:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:33:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:33:29 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2263b5-472a-4268-9a6e-b2279e2825de]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:33:29 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fcbf16a-5871-4bc7-a09a-9f1cf418eb19]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:33:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:33:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:33:29 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 05:33:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:33:29 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:33:29 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 05:33:29 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecf63ad-f046-45cd-be3e-94e7aeeb10f7]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:33:29 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 05:33:29 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 05:33:29 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 05:33:29 user nova-compute[72444]: DEBUG os_brick.utils [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:33:29 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Updating existing volume attachment record: 5feedce1-2856-4f81-95a3-1988c9347753 {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 05:33:30 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:33:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:33:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:33:31 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:33:31 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 05:33:34 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:33:34 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:33:34 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Rebuilding the list of instances to heal {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 05:33:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-85957527-c73a-4654-838e-5ff79e3730fd" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:33:34 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-85957527-c73a-4654-838e-5ff79e3730fd" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:33:34 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 05:33:34 user nova-compute[72444]: DEBUG nova.objects.instance [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lazy-loading 'info_cache' on Instance uuid 85957527-c73a-4654-838e-5ff79e3730fd {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:33:35 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Updating instance_info_cache with network_info: [{"id": "984e9dde-06d9-4b08-81e2-dd3144e6f33b", "address": "fa:16:3e:cd:e9:d9", "network": {"id": "27e1a858-dcc9-4e04-a87b-a5659d8cb355", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1432430230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b621a7d2de94a68a8547cf100467d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap984e9dde-06", "ovs_interfaceid": "984e9dde-06d9-4b08-81e2-dd3144e6f33b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:33:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-85957527-c73a-4654-838e-5ff79e3730fd" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:33:35 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 05:33:35 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:33:35 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:33:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:33:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:33:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:33:35 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:33:35 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85957527-c73a-4654-838e-5ff79e3730fd/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:33:35 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85957527-c73a-4654-838e-5ff79e3730fd/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:33:35 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85957527-c73a-4654-838e-5ff79e3730fd/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:33:35 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85957527-c73a-4654-838e-5ff79e3730fd/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:33:36 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:33:36 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:33:36 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=8791MB free_disk=25.297611236572266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 85957527-c73a-4654-838e-5ff79e3730fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uACeWkNv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:33:36 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:33:36 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:33:36 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:33:36 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:33:36 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 05:33:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89461a2-79df-41bc-a037-0d2b7944e07e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 05:33:36 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554 -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a709b2-60e3-4b43-af26-3d6b227ccb07]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554] added
Aug 03 05:33:36 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[902cddb2-c170-4f8a-83f7-02d5f35d3c6f]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[432bf96c-4a74-43c8-be73-bd422295b3e5]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uACeWkNv {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uACeWkNv" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d89516-98a1-4625-a1b0-7caa8e87e816]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uACeWkNv'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c440dbff-8971-4d5e-a98a-c10c40f276dc]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b8fc71-b2db-4796-ac93-0ae7ddc27134]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 03 05:33:36 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 03 05:33:36 user nova-compute[72444]:  {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:33:36 user nova-compute[72444]: WARNING os_brick.initiator.connectors.iscsi [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 03 05:33:36 user nova-compute[72444]: 
Aug 03 05:33:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554 -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d5f613-c507-4fa4-b7a4-16fe48f25d56]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554, portal: 172.16.0.220,3260]
Aug 03 05:33:36 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554, portal: 172.16.0.220,3260] successful.
Aug 03 05:33:36 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1047d368-ef51-4f46-98ca-47e486faed39]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:33:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:33:37 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:33:37 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e125b2c-8501-444c-a933-68f6b45d3fca]: (4, ('tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:33:37 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554 (non-flash)
Aug 03 05:33:37 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:33:37 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsi session list stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554 (non-flash)
Aug 03 05:33:37 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:33:37 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:33:37 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 05:33:37 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] HCTL ('33', '-', '-', 0) found on session 66 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 05:33:37 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 05:33:37 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:33:37 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:33:37 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95f47ee-b9f3-46c6-bc25-3e4461a0f3ae]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:33:37 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Searching for a device in session 66 and hctl ['33', '*', '*', 0] yield: None {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 05:33:38 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Searching for a device in session 66 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 05:33:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uACeWkNv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 05:33:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:33:38 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26632386566396634', 'path': '/dev/sdb'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:33:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632386566396634', 'path': '/dev/sdb'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 05:33:38 user nova-compute[72444]: DEBUG nova.objects.instance [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lazy-loading 'flavor' on Instance uuid 85957527-c73a-4654-838e-5ff79e3730fd {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:33:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 05:33:38 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:33:38 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 05:33:38 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 05:33:38 user nova-compute[72444]:   <serial>4d090418-026f-4c3f-8b4a-a935791ad554</serial>
Aug 03 05:33:38 user nova-compute[72444]: </disk>
Aug 03 05:33:38 user nova-compute[72444]:  {{(pid=72444) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 05:33:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:33:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:33:38 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] No VIF found with MAC fa:16:3e:cd:e9:d9, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 05:33:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-81ec701a-d50d-4467-a5a4-e24fe4f175e6 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "85957527-c73a-4654-838e-5ff79e3730fd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.312s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:33:39 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:33:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:33:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:33:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:33:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:33:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:33:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:33:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:33:41 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:33:46 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:33:46 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:33:47 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:33:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:33:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:33:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:33:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:33:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-3b016469-9f4d-4622-ac6c-7371ae65c394 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Acquiring lock "85957527-c73a-4654-838e-5ff79e3730fd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:33:58 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-3b016469-9f4d-4622-ac6c-7371ae65c394 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "85957527-c73a-4654-838e-5ff79e3730fd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:33:58 user nova-compute[72444]: INFO nova.compute.manager [None req-3b016469-9f4d-4622-ac6c-7371ae65c394 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Detaching volume 4d090418-026f-4c3f-8b4a-a935791ad554
Aug 03 05:33:59 user nova-compute[72444]: INFO nova.virt.block_device [None req-3b016469-9f4d-4622-ac6c-7371ae65c394 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Attempting to driver detach volume 4d090418-026f-4c3f-8b4a-a935791ad554 from mountpoint /dev/vdb
Aug 03 05:33:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-3b016469-9f4d-4622-ac6c-7371ae65c394 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Attempting to detach device vdb from instance 85957527-c73a-4654-838e-5ff79e3730fd from the persistent domain config. {{(pid=72444) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-3b016469-9f4d-4622-ac6c-7371ae65c394 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 05:33:59 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:33:59 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 05:33:59 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 05:33:59 user nova-compute[72444]:   <serial>4d090418-026f-4c3f-8b4a-a935791ad554</serial>
Aug 03 05:33:59 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 05:33:59 user nova-compute[72444]: </disk>
Aug 03 05:33:59 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 05:33:59 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-3b016469-9f4d-4622-ac6c-7371ae65c394 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Successfully detached device vdb from instance 85957527-c73a-4654-838e-5ff79e3730fd from the persistent domain config.
Aug 03 05:33:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-3b016469-9f4d-4622-ac6c-7371ae65c394 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 85957527-c73a-4654-838e-5ff79e3730fd from the live domain config. {{(pid=72444) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-3b016469-9f4d-4622-ac6c-7371ae65c394 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 05:33:59 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:33:59 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 05:33:59 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 05:33:59 user nova-compute[72444]:   <serial>4d090418-026f-4c3f-8b4a-a935791ad554</serial>
Aug 03 05:33:59 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 05:33:59 user nova-compute[72444]: </disk>
Aug 03 05:33:59 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Received event <DeviceRemovedEvent: 1691040839.4917607, 85957527-c73a-4654-838e-5ff79e3730fd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72444) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-3b016469-9f4d-4622-ac6c-7371ae65c394 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 85957527-c73a-4654-838e-5ff79e3730fd {{(pid=72444) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 05:33:59 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-3b016469-9f4d-4622-ac6c-7371ae65c394 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Successfully detached device vdb from instance 85957527-c73a-4654-838e-5ff79e3730fd from the live domain config.
Aug 03 05:33:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b016469-9f4d-4622-ac6c-7371ae65c394 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b016469-9f4d-4622-ac6c-7371ae65c394 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uACeWkNv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:33:59 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-3b016469-9f4d-4622-ac6c-7371ae65c394 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:33:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-3b016469-9f4d-4622-ac6c-7371ae65c394 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-3b016469-9f4d-4622-ac6c-7371ae65c394 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b016469-9f4d-4622-ac6c-7371ae65c394 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9b2c26-dcfd-4e46-b74f-d704731a4a55]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec558e49-e933-4446-a1a4-14a87ff5d460]: (4, ('tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b016469-9f4d-4622-ac6c-7371ae65c394 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554 (non-flash)
Aug 03 05:33:59 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b016469-9f4d-4622-ac6c-7371ae65c394 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsi session list stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554 (non-flash)
Aug 03 05:33:59 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b016469-9f4d-4622-ac6c-7371ae65c394 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f309423f370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554'): ({'sdb'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-3b016469-9f4d-4622-ac6c-7371ae65c394 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Removing single pathed devices sdb {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f61685a-bbf5-47f1-83bd-35af9a8d7c97]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4edd79-c0b4-44e9-99d2-83a85f8c6204]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-3b016469-9f4d-4622-ac6c-7371ae65c394 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Flushing IO for device /dev/sdb {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[11460626-717c-4d67-a25e-7a92eb8a2c13]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-3b016469-9f4d-4622-ac6c-7371ae65c394 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3bf839-d0ce-4637-8499-fa3620766acc]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-3b016469-9f4d-4622-ac6c-7371ae65c394 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-3b016469-9f4d-4622-ac6c-7371ae65c394 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b016469-9f4d-4622-ac6c-7371ae65c394 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a6d455-4061-40bf-bf0d-ab85b27996a9]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b016469-9f4d-4622-ac6c-7371ae65c394 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554 -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcf8b66-5a9d-477b-bd75-604b5f3062dd]: (4, ('Logging out of session [sid: 66, target: iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554, portal: 172.16.0.220,3260]\nLogout of [sid: 66, target: iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b016469-9f4d-4622-ac6c-7371ae65c394 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 66, target: iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554, portal: 172.16.0.220,3260]
Aug 03 05:33:59 user nova-compute[72444]: Logout of [sid: 66, target: iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554, portal: 172.16.0.220,3260] successful.
Aug 03 05:33:59 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554 -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d090418-026f-4c3f-8b4a-a935791ad554 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4207a70e-2c1b-4c74-90af-4ca9466b853a]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b016469-9f4d-4622-ac6c-7371ae65c394 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-3b016469-9f4d-4622-ac6c-7371ae65c394 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b016469-9f4d-4622-ac6c-7371ae65c394 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] <== disconnect_volume: return (268ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:33:59 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b016469-9f4d-4622-ac6c-7371ae65c394 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 05:34:00 user nova-compute[72444]: DEBUG nova.objects.instance [None req-3b016469-9f4d-4622-ac6c-7371ae65c394 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lazy-loading 'flavor' on Instance uuid 85957527-c73a-4654-838e-5ff79e3730fd {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:34:00 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-3b016469-9f4d-4622-ac6c-7371ae65c394 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "85957527-c73a-4654-838e-5ff79e3730fd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.562s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:34:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:34:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:34:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:34:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:34:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:34:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:34:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:34:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:34:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:34:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:34:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:34:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:34:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:34:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:34:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:34:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:34:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:34:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:34:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:34:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:34:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:34:28 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:34:29 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:34:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:34:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:34:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:34:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:34:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:34:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:34:31 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:34:31 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:34:31 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 05:34:35 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:34:35 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:34:35 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Rebuilding the list of instances to heal {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 05:34:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-85957527-c73a-4654-838e-5ff79e3730fd" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:34:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-85957527-c73a-4654-838e-5ff79e3730fd" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:34:35 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 05:34:35 user nova-compute[72444]: DEBUG nova.objects.instance [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lazy-loading 'info_cache' on Instance uuid 85957527-c73a-4654-838e-5ff79e3730fd {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:34:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:34:36 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Updating instance_info_cache with network_info: [{"id": "984e9dde-06d9-4b08-81e2-dd3144e6f33b", "address": "fa:16:3e:cd:e9:d9", "network": {"id": "27e1a858-dcc9-4e04-a87b-a5659d8cb355", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1432430230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b621a7d2de94a68a8547cf100467d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap984e9dde-06", "ovs_interfaceid": "984e9dde-06d9-4b08-81e2-dd3144e6f33b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:34:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-85957527-c73a-4654-838e-5ff79e3730fd" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:34:36 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 05:34:36 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:34:36 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:34:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:34:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:34:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:34:36 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:34:36 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85957527-c73a-4654-838e-5ff79e3730fd/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:34:37 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85957527-c73a-4654-838e-5ff79e3730fd/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:34:37 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85957527-c73a-4654-838e-5ff79e3730fd/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:34:37 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85957527-c73a-4654-838e-5ff79e3730fd/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:34:37 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:34:37 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:34:37 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=8806MB free_disk=25.296531677246094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:34:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:34:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:34:37 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 85957527-c73a-4654-838e-5ff79e3730fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:34:37 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:34:37 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:34:37 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:34:37 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:34:37 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:34:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.357s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:34:40 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:34:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:34:42 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:34:46 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:34:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:34:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:34:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:34:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:34:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:34:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:34:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Acquiring lock "85957527-c73a-4654-838e-5ff79e3730fd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:34:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "85957527-c73a-4654-838e-5ff79e3730fd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:34:53 user nova-compute[72444]: DEBUG nova.objects.instance [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lazy-loading 'flavor' on Instance uuid 85957527-c73a-4654-838e-5ff79e3730fd {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:34:53 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "85957527-c73a-4654-838e-5ff79e3730fd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:34:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Acquiring lock "85957527-c73a-4654-838e-5ff79e3730fd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:34:54 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "85957527-c73a-4654-838e-5ff79e3730fd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:34:54 user nova-compute[72444]: INFO nova.compute.manager [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Attaching volume 4c687c3d-3778-4028-a619-3a68b66be4a5 to /dev/vdb
Aug 03 05:34:54 user nova-compute[72444]: DEBUG os_brick.utils [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:34:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:34:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:34:54 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[286d45b3-46db-43d0-b981-def860748422]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:34:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:34:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:34:54 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e371127f-0b4b-4916-9eb8-e70511ccc8cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:34:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:34:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:34:54 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9693fda-e323-457d-bf40-8b4f611ac0a1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:34:54 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4570a3-301a-4c2e-8b90-b25286fa87a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:34:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:34:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:34:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 05:34:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:34:54 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:34:54 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 05:34:54 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7eb5b0-3d09-4ea3-837c-b53fa53ab995]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:34:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 05:34:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 05:34:54 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 05:34:54 user nova-compute[72444]: DEBUG os_brick.utils [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:34:54 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Updating existing volume attachment record: cffecdbe-b1ed-452f-8a5d-18391e41a4c2 {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 05:34:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:34:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YQGqwWPM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:35:01 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:35:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:35:01 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:35:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:35:01 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 05:35:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5 -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e23ee8d-557f-4897-9963-8e7ccfe85bd6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 05:35:01 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadc635c-3de4-478a-96b4-90e24a8245a6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5] added
Aug 03 05:35:01 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[238e84e4-398d-4105-9f28-ae9d2655c0cd]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[019454f2-8f25-4d36-b638-c968efae9e14]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YQGqwWPM {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YQGqwWPM" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aeec64a-33bb-4f32-8ca0-716be45968de]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YQGqwWPM'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[96575270-0ef4-4900-8d82-6ad1696d7675]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5903094-3318-4601-94a0-c8f758be720a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 03 05:35:01 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 03 05:35:01 user nova-compute[72444]:  {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:35:01 user nova-compute[72444]: WARNING os_brick.initiator.connectors.iscsi [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 03 05:35:01 user nova-compute[72444]: 
Aug 03 05:35:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5 -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6639870-35ed-47fa-8c89-c099b757ea10]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5, portal: 172.16.0.220,3260]
Aug 03 05:35:01 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5, portal: 172.16.0.220,3260] successful.
Aug 03 05:35:01 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[01add59b-9029-4dc2-9209-88b726bb3460]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb73655d-bac0-4b61-8b2a-24985c8262a6]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5 (non-flash)
Aug 03 05:35:01 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5 (non-flash)
Aug 03 05:35:01 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c895c584-3e2c-47dc-a8c6-4dead1c9d3c0]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:35:01 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 05:35:02 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 05:35:02 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YQGqwWPM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 05:35:02 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:35:02 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23863663834646664', 'path': '/dev/sdb'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:35:02 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863663834646664', 'path': '/dev/sdb'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 05:35:02 user nova-compute[72444]: DEBUG nova.objects.instance [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lazy-loading 'flavor' on Instance uuid 85957527-c73a-4654-838e-5ff79e3730fd {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:35:02 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 05:35:02 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:35:02 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 05:35:02 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 05:35:02 user nova-compute[72444]:   <serial>4c687c3d-3778-4028-a619-3a68b66be4a5</serial>
Aug 03 05:35:02 user nova-compute[72444]: </disk>
Aug 03 05:35:02 user nova-compute[72444]:  {{(pid=72444) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 05:35:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:35:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:35:03 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] No VIF found with MAC fa:16:3e:cd:e9:d9, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 05:35:03 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-dde9250e-5398-4173-848d-8655b5adfa37 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "85957527-c73a-4654-838e-5ff79e3730fd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.290s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:35:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f25d2581-75ac-4949-836b-f54b92f117ef tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Acquiring lock "85957527-c73a-4654-838e-5ff79e3730fd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:35:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f25d2581-75ac-4949-836b-f54b92f117ef tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "85957527-c73a-4654-838e-5ff79e3730fd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:35:05 user nova-compute[72444]: INFO nova.compute.manager [None req-f25d2581-75ac-4949-836b-f54b92f117ef tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Detaching volume 4c687c3d-3778-4028-a619-3a68b66be4a5
Aug 03 05:35:05 user nova-compute[72444]: INFO nova.virt.block_device [None req-f25d2581-75ac-4949-836b-f54b92f117ef tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Attempting to driver detach volume 4c687c3d-3778-4028-a619-3a68b66be4a5 from mountpoint /dev/vdb
Aug 03 05:35:05 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f25d2581-75ac-4949-836b-f54b92f117ef tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Attempting to detach device vdb from instance 85957527-c73a-4654-838e-5ff79e3730fd from the persistent domain config. {{(pid=72444) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 05:35:05 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-f25d2581-75ac-4949-836b-f54b92f117ef tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 05:35:05 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:35:05 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 05:35:05 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 05:35:05 user nova-compute[72444]:   <serial>4c687c3d-3778-4028-a619-3a68b66be4a5</serial>
Aug 03 05:35:05 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 05:35:05 user nova-compute[72444]: </disk>
Aug 03 05:35:05 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 05:35:05 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-f25d2581-75ac-4949-836b-f54b92f117ef tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Successfully detached device vdb from instance 85957527-c73a-4654-838e-5ff79e3730fd from the persistent domain config.
Aug 03 05:35:05 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f25d2581-75ac-4949-836b-f54b92f117ef tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 85957527-c73a-4654-838e-5ff79e3730fd from the live domain config. {{(pid=72444) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 05:35:05 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-f25d2581-75ac-4949-836b-f54b92f117ef tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 05:35:05 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:35:05 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 05:35:05 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 05:35:05 user nova-compute[72444]:   <serial>4c687c3d-3778-4028-a619-3a68b66be4a5</serial>
Aug 03 05:35:05 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 05:35:05 user nova-compute[72444]: </disk>
Aug 03 05:35:05 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 05:35:05 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Received event <DeviceRemovedEvent: 1691040905.82142, 85957527-c73a-4654-838e-5ff79e3730fd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72444) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 05:35:05 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-f25d2581-75ac-4949-836b-f54b92f117ef tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 85957527-c73a-4654-838e-5ff79e3730fd {{(pid=72444) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 05:35:05 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-f25d2581-75ac-4949-836b-f54b92f117ef tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Successfully detached device vdb from instance 85957527-c73a-4654-838e-5ff79e3730fd from the live domain config.
Aug 03 05:35:05 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f25d2581-75ac-4949-836b-f54b92f117ef tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 05:35:05 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25d2581-75ac-4949-836b-f54b92f117ef tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YQGqwWPM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:35:05 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-f25d2581-75ac-4949-836b-f54b92f117ef tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:35:05 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-f25d2581-75ac-4949-836b-f54b92f117ef tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:35:05 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-f25d2581-75ac-4949-836b-f54b92f117ef tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:35:05 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25d2581-75ac-4949-836b-f54b92f117ef tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 05:35:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:35:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:35:05 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f48ebde-c1e0-4d37-a273-c9dd98459210]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:35:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:35:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:35:05 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[04593db2-5ef8-4e10-b11c-c1ecd213ad52]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5 (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:35:05 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25d2581-75ac-4949-836b-f54b92f117ef tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5 (non-flash)
Aug 03 05:35:05 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:35:05 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25d2581-75ac-4949-836b-f54b92f117ef tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5 (non-flash)
Aug 03 05:35:05 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:35:05 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25d2581-75ac-4949-836b-f54b92f117ef tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308c15aef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5'): ({'sdb'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 05:35:05 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-f25d2581-75ac-4949-836b-f54b92f117ef tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Removing single pathed devices sdb {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 05:35:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:35:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:35:05 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ed1f79-e5fb-4223-b1ca-8d7084621efb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:35:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:35:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.075s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:35:05 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c42e55c-131a-4d1e-a389-be39edadb150]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:35:05 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-f25d2581-75ac-4949-836b-f54b92f117ef tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Flushing IO for device /dev/sdb {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 05:35:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:35:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:35:06 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[113f5941-eec7-427e-bad8-238de808d973]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:35:06 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-f25d2581-75ac-4949-836b-f54b92f117ef tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 05:35:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:35:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:35:06 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf3f642-541f-41e2-8037-852130d75f57]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:35:06 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-f25d2581-75ac-4949-836b-f54b92f117ef tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 05:35:06 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-f25d2581-75ac-4949-836b-f54b92f117ef tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 05:35:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25d2581-75ac-4949-836b-f54b92f117ef tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 05:35:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:35:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:35:06 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[45da9e69-45dd-443e-acde-6dfe177d20d2]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:35:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25d2581-75ac-4949-836b-f54b92f117ef tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:35:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5 -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:35:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:35:06 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8490ec56-433e-4114-a564-924b91db4062]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:35:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25d2581-75ac-4949-836b-f54b92f117ef tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5, portal: 172.16.0.220,3260]
Aug 03 05:35:06 user nova-compute[72444]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5, portal: 172.16.0.220,3260] successful.
Aug 03 05:35:06 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:35:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5 -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:35:06 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c687c3d-3778-4028-a619-3a68b66be4a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:35:06 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e150af7-1a59-4630-9549-1237fe523418]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:35:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25d2581-75ac-4949-836b-f54b92f117ef tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:35:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-f25d2581-75ac-4949-836b-f54b92f117ef tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:35:06 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25d2581-75ac-4949-836b-f54b92f117ef tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] <== disconnect_volume: return (314ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:35:06 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f25d2581-75ac-4949-836b-f54b92f117ef tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 05:35:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:35:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:35:06 user nova-compute[72444]: DEBUG nova.objects.instance [None req-f25d2581-75ac-4949-836b-f54b92f117ef tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lazy-loading 'flavor' on Instance uuid 85957527-c73a-4654-838e-5ff79e3730fd {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:35:06 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-f25d2581-75ac-4949-836b-f54b92f117ef tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "85957527-c73a-4654-838e-5ff79e3730fd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.672s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:35:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:35:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:35:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:35:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:35:28 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:35:29 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:35:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:35:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:35:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:35:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:35:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:35:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:35:31 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:35:31 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 05:35:33 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:35:35 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:35:35 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:35:35 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Rebuilding the list of instances to heal {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 05:35:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-85957527-c73a-4654-838e-5ff79e3730fd" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:35:35 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-85957527-c73a-4654-838e-5ff79e3730fd" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:35:35 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 05:35:35 user nova-compute[72444]: DEBUG nova.objects.instance [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lazy-loading 'info_cache' on Instance uuid 85957527-c73a-4654-838e-5ff79e3730fd {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:35:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:35:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:35:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:35:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:35:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:35:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:35:36 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Updating instance_info_cache with network_info: [{"id": "984e9dde-06d9-4b08-81e2-dd3144e6f33b", "address": "fa:16:3e:cd:e9:d9", "network": {"id": "27e1a858-dcc9-4e04-a87b-a5659d8cb355", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1432430230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b621a7d2de94a68a8547cf100467d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap984e9dde-06", "ovs_interfaceid": "984e9dde-06d9-4b08-81e2-dd3144e6f33b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:35:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-85957527-c73a-4654-838e-5ff79e3730fd" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:35:36 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 05:35:36 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:35:36 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:35:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:35:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:35:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:35:36 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:35:37 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85957527-c73a-4654-838e-5ff79e3730fd/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:35:37 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85957527-c73a-4654-838e-5ff79e3730fd/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:35:37 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85957527-c73a-4654-838e-5ff79e3730fd/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:35:37 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85957527-c73a-4654-838e-5ff79e3730fd/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:35:37 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:35:37 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:35:37 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=8799MB free_disk=25.28772735595703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:35:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:35:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:35:37 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 85957527-c73a-4654-838e-5ff79e3730fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:35:37 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:35:37 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:35:37 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:35:37 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:35:37 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:35:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:35:39 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:35:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:35:43 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:35:46 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:35:49 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:35:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:35:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:35:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:35:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:35:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:35:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:35:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:35:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Acquiring lock "85957527-c73a-4654-838e-5ff79e3730fd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:35:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "85957527-c73a-4654-838e-5ff79e3730fd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:35:59 user nova-compute[72444]: DEBUG nova.objects.instance [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lazy-loading 'flavor' on Instance uuid 85957527-c73a-4654-838e-5ff79e3730fd {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:35:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "85957527-c73a-4654-838e-5ff79e3730fd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:35:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Acquiring lock "85957527-c73a-4654-838e-5ff79e3730fd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:35:59 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "85957527-c73a-4654-838e-5ff79e3730fd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:35:59 user nova-compute[72444]: INFO nova.compute.manager [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Attaching volume a875154a-dfa0-4f7f-a0d9-32553e68047b to /dev/vdb
Aug 03 05:35:59 user nova-compute[72444]: DEBUG os_brick.utils [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:35:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:35:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:35:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8bf091-6482-4d3f-a746-1b49c4400a39]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:35:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:35:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:35:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afcda65-d347-4138-af00-1f5b7c52adc3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:35:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:35:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:35:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7523eae-746e-42fd-8373-ac067b60f78f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:35:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dadab0f-63f1-4189-9dac-c13eef00a286]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:35:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:35:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:35:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 05:35:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:35:59 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:35:59 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 05:35:59 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edba1bf-67b4-4707-9d70-428f9729b421]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:35:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 05:35:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 05:35:59 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 05:35:59 user nova-compute[72444]: DEBUG os_brick.utils [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:35:59 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Updating existing volume attachment record: b142ae85-394f-49e5-b7db-8f5b111557ca {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 05:36:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:36:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:36:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:36:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:36:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:36:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:36:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:36:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GYyJdlAM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:36:07 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:36:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:36:07 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:36:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:36:07 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 05:36:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[23dd28ce-b465-47de-8435-545c05ae6f3c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 05:36:07 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb4b5df-1a80-440c-90ca-91e598a074bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b] added
Aug 03 05:36:07 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56c4c33-0a70-4c67-8fef-b2f0d5df126a]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98efe42-3f60-4899-80c0-9482e3e596de]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GYyJdlAM {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GYyJdlAM" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a4f4ba-ba0c-45e6-a6a8-09b33e138f57]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GYyJdlAM'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[865e72ce-4800-47fe-a818-b9337326987e]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca20e8e-242d-42cf-8561-1be6098bf5c6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 03 05:36:07 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 03 05:36:07 user nova-compute[72444]:  {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:36:07 user nova-compute[72444]: WARNING os_brick.initiator.connectors.iscsi [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 03 05:36:07 user nova-compute[72444]: 
Aug 03 05:36:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4f4e1c-8216-4b73-a7b5-f389142555a1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b, portal: 172.16.0.220,3260]
Aug 03 05:36:07 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b, portal: 172.16.0.220,3260] successful.
Aug 03 05:36:07 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fac3bd8-060b-496f-82fb-a0d0c6e93e0a]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f74ca85-2f02-4ed9-9c14-d77dafbdc3a0]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b (non-flash)
Aug 03 05:36:07 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b (non-flash)
Aug 03 05:36:07 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b713ea5d-ceef-4d73-9774-5a070725c2ab]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 05:36:07 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GYyJdlAM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 05:36:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:36:08 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23037336365346437', 'path': '/dev/sdb'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:36:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037336365346437', 'path': '/dev/sdb'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 05:36:08 user nova-compute[72444]: DEBUG nova.objects.instance [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lazy-loading 'flavor' on Instance uuid 85957527-c73a-4654-838e-5ff79e3730fd {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:36:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 05:36:08 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:36:08 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 05:36:08 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 05:36:08 user nova-compute[72444]:   <serial>a875154a-dfa0-4f7f-a0d9-32553e68047b</serial>
Aug 03 05:36:08 user nova-compute[72444]: </disk>
Aug 03 05:36:08 user nova-compute[72444]:  {{(pid=72444) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 05:36:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:36:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:36:08 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] No VIF found with MAC fa:16:3e:cd:e9:d9, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 05:36:09 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-586cfb42-6a32-4f15-a417-cff2c3f72709 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "85957527-c73a-4654-838e-5ff79e3730fd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.471s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-964d7015-0427-4240-9105-95021a42139e tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Acquiring lock "85957527-c73a-4654-838e-5ff79e3730fd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-964d7015-0427-4240-9105-95021a42139e tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "85957527-c73a-4654-838e-5ff79e3730fd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:36:11 user nova-compute[72444]: INFO nova.compute.manager [None req-964d7015-0427-4240-9105-95021a42139e tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Detaching volume a875154a-dfa0-4f7f-a0d9-32553e68047b
Aug 03 05:36:11 user nova-compute[72444]: INFO nova.virt.block_device [None req-964d7015-0427-4240-9105-95021a42139e tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Attempting to driver detach volume a875154a-dfa0-4f7f-a0d9-32553e68047b from mountpoint /dev/vdb
Aug 03 05:36:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-964d7015-0427-4240-9105-95021a42139e tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Attempting to detach device vdb from instance 85957527-c73a-4654-838e-5ff79e3730fd from the persistent domain config. {{(pid=72444) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-964d7015-0427-4240-9105-95021a42139e tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 05:36:11 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:36:11 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 05:36:11 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 05:36:11 user nova-compute[72444]:   <serial>a875154a-dfa0-4f7f-a0d9-32553e68047b</serial>
Aug 03 05:36:11 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 05:36:11 user nova-compute[72444]: </disk>
Aug 03 05:36:11 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 05:36:11 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-964d7015-0427-4240-9105-95021a42139e tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Successfully detached device vdb from instance 85957527-c73a-4654-838e-5ff79e3730fd from the persistent domain config.
Aug 03 05:36:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-964d7015-0427-4240-9105-95021a42139e tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 85957527-c73a-4654-838e-5ff79e3730fd from the live domain config. {{(pid=72444) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-964d7015-0427-4240-9105-95021a42139e tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 05:36:11 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:36:11 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 05:36:11 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 05:36:11 user nova-compute[72444]:   <serial>a875154a-dfa0-4f7f-a0d9-32553e68047b</serial>
Aug 03 05:36:11 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 05:36:11 user nova-compute[72444]: </disk>
Aug 03 05:36:11 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Received event <DeviceRemovedEvent: 1691040971.6212268, 85957527-c73a-4654-838e-5ff79e3730fd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72444) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-964d7015-0427-4240-9105-95021a42139e tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 85957527-c73a-4654-838e-5ff79e3730fd {{(pid=72444) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 05:36:11 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-964d7015-0427-4240-9105-95021a42139e tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Successfully detached device vdb from instance 85957527-c73a-4654-838e-5ff79e3730fd from the live domain config.
Aug 03 05:36:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-964d7015-0427-4240-9105-95021a42139e tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-964d7015-0427-4240-9105-95021a42139e tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GYyJdlAM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:36:11 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-964d7015-0427-4240-9105-95021a42139e tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:36:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-964d7015-0427-4240-9105-95021a42139e tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-964d7015-0427-4240-9105-95021a42139e tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-964d7015-0427-4240-9105-95021a42139e tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0f0872-7ad2-4418-b824-12396d57e6b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[550599cc-61b8-438b-bccf-3260753512e0]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-964d7015-0427-4240-9105-95021a42139e tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b (non-flash)
Aug 03 05:36:11 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-964d7015-0427-4240-9105-95021a42139e tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b (non-flash)
Aug 03 05:36:11 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-964d7015-0427-4240-9105-95021a42139e tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308c5e5cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b'): ({'sdb'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-964d7015-0427-4240-9105-95021a42139e tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Removing single pathed devices sdb {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4f4179-3f1b-4669-b22b-e5b427f5e94c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[437b5f9f-cec7-4a21-b1fe-4a97db8023f8]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-964d7015-0427-4240-9105-95021a42139e tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Flushing IO for device /dev/sdb {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[97391e39-923a-4a9d-96cc-52490a7ca01d]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-964d7015-0427-4240-9105-95021a42139e tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[208384d4-b84e-48d1-9f52-a9f78f26e0a2]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-964d7015-0427-4240-9105-95021a42139e tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-964d7015-0427-4240-9105-95021a42139e tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-964d7015-0427-4240-9105-95021a42139e tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[18aec478-a72d-4ef9-ad0d-bb3b0ae42f65]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-964d7015-0427-4240-9105-95021a42139e tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3ec8bc-7775-4468-8f30-8044807ea73f]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-964d7015-0427-4240-9105-95021a42139e tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b, portal: 172.16.0.220,3260]
Aug 03 05:36:11 user nova-compute[72444]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b, portal: 172.16.0.220,3260] successful.
Aug 03 05:36:11 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a875154a-dfa0-4f7f-a0d9-32553e68047b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2222a7d9-d615-4db3-870f-461e9c9ee8d5]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-964d7015-0427-4240-9105-95021a42139e tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-964d7015-0427-4240-9105-95021a42139e tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-964d7015-0427-4240-9105-95021a42139e tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] <== disconnect_volume: return (269ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:36:11 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-964d7015-0427-4240-9105-95021a42139e tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 05:36:12 user nova-compute[72444]: DEBUG nova.objects.instance [None req-964d7015-0427-4240-9105-95021a42139e tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lazy-loading 'flavor' on Instance uuid 85957527-c73a-4654-838e-5ff79e3730fd {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:36:12 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-964d7015-0427-4240-9105-95021a42139e tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "85957527-c73a-4654-838e-5ff79e3730fd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.578s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:36:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:36:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:36:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:36:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:36:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:36:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:36:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:36:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:36:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:36:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:36:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:36:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:36:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:36:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:36:28 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:36:29 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:36:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:36:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:36:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:36:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:36:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:36:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:36:31 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:36:31 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 05:36:33 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:36:34 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:36:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:36:36 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:36:36 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:36:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:36:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:36:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:36:36 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:36:37 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85957527-c73a-4654-838e-5ff79e3730fd/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:36:37 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85957527-c73a-4654-838e-5ff79e3730fd/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:36:37 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85957527-c73a-4654-838e-5ff79e3730fd/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:36:37 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85957527-c73a-4654-838e-5ff79e3730fd/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:36:37 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:36:37 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:36:37 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=8794MB free_disk=25.286705017089844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:36:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:36:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:36:37 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 85957527-c73a-4654-838e-5ff79e3730fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:36:37 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:36:37 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:36:37 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:36:37 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:36:37 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:36:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.212s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:36:38 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:36:38 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:36:38 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Rebuilding the list of instances to heal {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 05:36:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-85957527-c73a-4654-838e-5ff79e3730fd" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:36:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-85957527-c73a-4654-838e-5ff79e3730fd" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:36:39 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 05:36:39 user nova-compute[72444]: DEBUG nova.objects.instance [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lazy-loading 'info_cache' on Instance uuid 85957527-c73a-4654-838e-5ff79e3730fd {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:36:39 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Updating instance_info_cache with network_info: [{"id": "984e9dde-06d9-4b08-81e2-dd3144e6f33b", "address": "fa:16:3e:cd:e9:d9", "network": {"id": "27e1a858-dcc9-4e04-a87b-a5659d8cb355", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1432430230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b621a7d2de94a68a8547cf100467d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap984e9dde-06", "ovs_interfaceid": "984e9dde-06d9-4b08-81e2-dd3144e6f33b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:36:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-85957527-c73a-4654-838e-5ff79e3730fd" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:36:39 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 05:36:40 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:36:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:36:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:36:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:36:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:36:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:36:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:36:44 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:36:46 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:36:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:36:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:36:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:36:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:36:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:36:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:36:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:37:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:37:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:37:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:37:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:37:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:37:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:37:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Acquiring lock "85957527-c73a-4654-838e-5ff79e3730fd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:37:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "85957527-c73a-4654-838e-5ff79e3730fd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:37:05 user nova-compute[72444]: DEBUG nova.objects.instance [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lazy-loading 'flavor' on Instance uuid 85957527-c73a-4654-838e-5ff79e3730fd {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:37:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "85957527-c73a-4654-838e-5ff79e3730fd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:37:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Acquiring lock "85957527-c73a-4654-838e-5ff79e3730fd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:37:05 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "85957527-c73a-4654-838e-5ff79e3730fd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:37:05 user nova-compute[72444]: INFO nova.compute.manager [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Attaching volume e3c01c2a-5aef-467a-a206-6beed07b14ca to /dev/vdb
Aug 03 05:37:05 user nova-compute[72444]: DEBUG os_brick.utils [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:37:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:37:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:37:05 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef31f55d-7b2b-4e7a-9bea-d389839811e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90446cde70d4\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:37:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:37:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:37:05 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a40a9a4-8464-47bc-8803-f0c0b8b3f7a1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:37:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:37:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:37:05 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c676749-6397-41d0-b776-018de83ff87f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:37:05 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[61237fc0-baa4-48d2-872f-bc223bdeef5d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:37:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Running cmd (subprocess): nvme version {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:37:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] 'nvme version' failed. Not Retrying. {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:37:05 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] nvme not present on system {{(pid=72444) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 03 05:37:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:37:05 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 03 05:37:05 user nova-compute[72444]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 03 05:37:05 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1f9539-2127-4725-9376-5487208e045d]: (4, '') {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:37:05 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72444) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 03 05:37:05 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 03 05:37:05 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.lightos [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] LIGHTOS: no hostnqn found. {{(pid=72444) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 03 05:37:05 user nova-compute[72444]: DEBUG os_brick.utils [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90446cde70d4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:37:05 user nova-compute[72444]: DEBUG nova.virt.block_device [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Updating existing volume attachment record: 4f736aee-e1b5-46cc-841c-7ed7b9eb259c {{(pid=72444) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 03 05:37:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:37:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:37:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:37:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:37:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:37:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:37:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:37:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Calling os-brick to attach iSCSI Volume {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KsetrucX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:37:13 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:37:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:37:13 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:37:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:37:13 user nova-compute[72444]: INFO os_brick.initiator.connectors.iscsi [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 03 05:37:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca -p 172.16.0.220:3260 {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b68e12-122c-4963-a752-456b714ca160]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 03 05:37:13 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca -p 172.16.0.220:3260 --interface default --op new {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[79793d73-af72-4206-b542-fd4ddc76b6bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca] added\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca] added
Aug 03 05:37:13 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[69050ef7-b8ca-4a4d-b28a-6ad23e3d1d97]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a90f182-32b4-4a2b-8c60-722e4c40090f]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KsetrucX {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KsetrucX" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f677ac01-23c9-4b6a-924b-20b5a84fdbf6]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KsetrucX'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[186bda6c-39ba-4d33-81e4-3a4912d2d832]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[853f9534-ece5-44ee-916f-1cd53cac4322]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 03 05:37:13 user nova-compute[72444]:  {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 03 05:37:13 user nova-compute[72444]:  {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:37:13 user nova-compute[72444]: WARNING os_brick.initiator.connectors.iscsi [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 03 05:37:13 user nova-compute[72444]: 
Aug 03 05:37:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca -p 172.16.0.220:3260 --login {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb4e314-9dce-4d7d-85fb-0d38120db1ff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca, portal: 172.16.0.220,3260]
Aug 03 05:37:13 user nova-compute[72444]: Login to [iface: default, target: iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca, portal: 172.16.0.220,3260] successful.
Aug 03 05:37:13 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb6f143-94d1-4f4f-aa63-bed628c7c632]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9d260c-51e6-4d54-a48c-1fed4789f2c9]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca (non-flash)
Aug 03 05:37:13 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca (non-flash)
Aug 03 05:37:13 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Connected to 172.16.0.220:3260 {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=72444) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72444) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c174ef1-d46c-4610-9d5a-fa7c7be77936]: (4, ('- - 0', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72444) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 03 05:37:13 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KsetrucX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72444) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 03 05:37:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:37:14 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26338303130383764', 'path': '/dev/sdb'} {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:37:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338303130383764', 'path': '/dev/sdb'} {{(pid=72444) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 03 05:37:14 user nova-compute[72444]: DEBUG nova.objects.instance [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lazy-loading 'flavor' on Instance uuid 85957527-c73a-4654-838e-5ff79e3730fd {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:37:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] attach device xml: <disk type="block" device="disk">
Aug 03 05:37:14 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:37:14 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 05:37:14 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 05:37:14 user nova-compute[72444]:   <serial>e3c01c2a-5aef-467a-a206-6beed07b14ca</serial>
Aug 03 05:37:14 user nova-compute[72444]: </disk>
Aug 03 05:37:14 user nova-compute[72444]:  {{(pid=72444) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 03 05:37:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] No BDM found with device name vda, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:37:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72444) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 03 05:37:14 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] No VIF found with MAC fa:16:3e:cd:e9:d9, not building metadata {{(pid=72444) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 03 05:37:15 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-7f8c9302-67c4-4a5f-aa36-4c44fbcc66b7 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "85957527-c73a-4654-838e-5ff79e3730fd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.372s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:37:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:37:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:37:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-6f2e3372-8132-4eea-804c-72b043466d38 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Acquiring lock "85957527-c73a-4654-838e-5ff79e3730fd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:37:16 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-6f2e3372-8132-4eea-804c-72b043466d38 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "85957527-c73a-4654-838e-5ff79e3730fd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:37:16 user nova-compute[72444]: INFO nova.compute.manager [None req-6f2e3372-8132-4eea-804c-72b043466d38 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Detaching volume e3c01c2a-5aef-467a-a206-6beed07b14ca
Aug 03 05:37:16 user nova-compute[72444]: INFO nova.virt.block_device [None req-6f2e3372-8132-4eea-804c-72b043466d38 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Attempting to driver detach volume e3c01c2a-5aef-467a-a206-6beed07b14ca from mountpoint /dev/vdb
Aug 03 05:37:16 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-6f2e3372-8132-4eea-804c-72b043466d38 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Attempting to detach device vdb from instance 85957527-c73a-4654-838e-5ff79e3730fd from the persistent domain config. {{(pid=72444) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 03 05:37:16 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-6f2e3372-8132-4eea-804c-72b043466d38 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 05:37:16 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:37:16 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 05:37:16 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 05:37:16 user nova-compute[72444]:   <serial>e3c01c2a-5aef-467a-a206-6beed07b14ca</serial>
Aug 03 05:37:16 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 05:37:16 user nova-compute[72444]: </disk>
Aug 03 05:37:16 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 05:37:17 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-6f2e3372-8132-4eea-804c-72b043466d38 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Successfully detached device vdb from instance 85957527-c73a-4654-838e-5ff79e3730fd from the persistent domain config.
Aug 03 05:37:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-6f2e3372-8132-4eea-804c-72b043466d38 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 85957527-c73a-4654-838e-5ff79e3730fd from the live domain config. {{(pid=72444) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.guest [None req-6f2e3372-8132-4eea-804c-72b043466d38 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] detach device xml: <disk type="block" device="disk">
Aug 03 05:37:17 user nova-compute[72444]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 03 05:37:17 user nova-compute[72444]:   <source dev="/dev/sdb"/>
Aug 03 05:37:17 user nova-compute[72444]:   <target dev="vdb" bus="virtio"/>
Aug 03 05:37:17 user nova-compute[72444]:   <serial>e3c01c2a-5aef-467a-a206-6beed07b14ca</serial>
Aug 03 05:37:17 user nova-compute[72444]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 03 05:37:17 user nova-compute[72444]: </disk>
Aug 03 05:37:17 user nova-compute[72444]:  {{(pid=72444) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-245ed60f-7ba3-4b4d-9708-b2fd85d855b3 None None] Received event <DeviceRemovedEvent: 1691041037.4210162, 85957527-c73a-4654-838e-5ff79e3730fd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72444) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.driver [None req-6f2e3372-8132-4eea-804c-72b043466d38 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 85957527-c73a-4654-838e-5ff79e3730fd {{(pid=72444) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 03 05:37:17 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-6f2e3372-8132-4eea-804c-72b043466d38 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Successfully detached device vdb from instance 85957527-c73a-4654-838e-5ff79e3730fd from the live domain config.
Aug 03 05:37:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f2e3372-8132-4eea-804c-72b043466d38 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] calling os-brick to detach iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2e3372-8132-4eea-804c-72b043466d38 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3094550340>, {'target_iqns': ['iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KsetrucX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 03 05:37:17 user nova-compute[72444]: WARNING os_brick.initiator.connectors.base [None req-6f2e3372-8132-4eea-804c-72b043466d38 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 03 05:37:17 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-6f2e3372-8132-4eea-804c-72b043466d38 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-6f2e3372-8132-4eea-804c-72b043466d38 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2e3372-8132-4eea-804c-72b043466d38 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca', 0)] {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[44109097-e2ec-4e99-bca9-fe97e5ad6515]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaec9b59-8687-437d-a673-5bc8ddf6e8b5]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca (non-flash)\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2e3372-8132-4eea-804c-72b043466d38 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca (non-flash)
Aug 03 05:37:17 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2e3372-8132-4eea-804c-72b043466d38 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca (non-flash)
Aug 03 05:37:17 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2e3372-8132-4eea-804c-72b043466d38 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308c3e8a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca'): ({'sdb'}, set())}) {{(pid=72444) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-6f2e3372-8132-4eea-804c-72b043466d38 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Removing single pathed devices sdb {{(pid=72444) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e39e73-60e8-477d-a9c8-50c1b2fc9add]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b20799-c3d3-4732-804a-e2be2e9087bc]: (4, ('ok\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-6f2e3372-8132-4eea-804c-72b043466d38 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Flushing IO for device /dev/sdb {{(pid=72444) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fe1ee2-ed66-44dc-8fcf-4a8aca21e60d]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-6f2e3372-8132-4eea-804c-72b043466d38 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72444) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e79cd6-1561-47fc-be86-2aff5b9ea41a]: (4, ('1', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-6f2e3372-8132-4eea-804c-72b043466d38 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG os_brick.initiator.linuxscsi [None req-6f2e3372-8132-4eea-804c-72b043466d38 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] SCSI volumes sdb have been removed. {{(pid=72444) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2e3372-8132-4eea-804c-72b043466d38 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca')] {{(pid=72444) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d2a43a-41c7-43e5-97fd-75546700189a]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2e3372-8132-4eea-804c-72b043466d38 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca -p 172.16.0.220:3260 --logout {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dadaacf-d6c8-40d7-9678-440f2789f7fb]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2e3372-8132-4eea-804c-72b043466d38 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca, portal: 172.16.0.220,3260]
Aug 03 05:37:17 user nova-compute[72444]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca, portal: 172.16.0.220,3260] successful.
Aug 03 05:37:17 user nova-compute[72444]:  stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca -p 172.16.0.220:3260 --op delete {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c01c2a-5aef-467a-a206-6beed07b14ca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84280) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b91b003-5913-4d95-8765-6d9a12326ee4]: (4, ('', '')) {{(pid=84280) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2e3372-8132-4eea-804c-72b043466d38 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72444) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.base [None req-6f2e3372-8132-4eea-804c-72b043466d38 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.253s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2e3372-8132-4eea-804c-72b043466d38 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] <== disconnect_volume: return (254ms) None {{(pid=72444) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 03 05:37:17 user nova-compute[72444]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f2e3372-8132-4eea-804c-72b043466d38 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Disconnected iSCSI Volume {{(pid=72444) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 03 05:37:18 user nova-compute[72444]: DEBUG nova.objects.instance [None req-6f2e3372-8132-4eea-804c-72b043466d38 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lazy-loading 'flavor' on Instance uuid 85957527-c73a-4654-838e-5ff79e3730fd {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:37:18 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-6f2e3372-8132-4eea-804c-72b043466d38 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "85957527-c73a-4654-838e-5ff79e3730fd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.562s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:37:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:37:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:37:25 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:37:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:37:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:37:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:37:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:37:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:37:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:37:29 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:37:30 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:37:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:37:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:37:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:37:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:37:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:37:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:37:31 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:37:31 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 05:37:35 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:37:35 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:37:35 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Cleaning up deleted instances {{(pid=72444) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 03 05:37:35 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] There are 0 instances to clean {{(pid=72444) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 03 05:37:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:37:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:37:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:37:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:37:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:37:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:37:37 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:37:37 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72444) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 03 05:37:38 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:37:38 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:37:38 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Rebuilding the list of instances to heal {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 05:37:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "refresh_cache-85957527-c73a-4654-838e-5ff79e3730fd" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 03 05:37:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquired lock "refresh_cache-85957527-c73a-4654-838e-5ff79e3730fd" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 03 05:37:38 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Forcefully refreshing network info cache for instance {{(pid=72444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 03 05:37:38 user nova-compute[72444]: DEBUG nova.objects.instance [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lazy-loading 'info_cache' on Instance uuid 85957527-c73a-4654-838e-5ff79e3730fd {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:37:39 user nova-compute[72444]: DEBUG nova.network.neutron [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Updating instance_info_cache with network_info: [{"id": "984e9dde-06d9-4b08-81e2-dd3144e6f33b", "address": "fa:16:3e:cd:e9:d9", "network": {"id": "27e1a858-dcc9-4e04-a87b-a5659d8cb355", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1432430230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b621a7d2de94a68a8547cf100467d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap984e9dde-06", "ovs_interfaceid": "984e9dde-06d9-4b08-81e2-dd3144e6f33b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:37:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Releasing lock "refresh_cache-85957527-c73a-4654-838e-5ff79e3730fd" {{(pid=72444) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 03 05:37:39 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Updated the network info_cache for instance {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 03 05:37:39 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:37:39 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:37:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:37:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:37:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:37:39 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:37:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85957527-c73a-4654-838e-5ff79e3730fd/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:37:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85957527-c73a-4654-838e-5ff79e3730fd/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:37:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85957527-c73a-4654-838e-5ff79e3730fd/disk --force-share --output=json {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 03 05:37:39 user nova-compute[72444]: DEBUG oslo_concurrency.processutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85957527-c73a-4654-838e-5ff79e3730fd/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72444) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 03 05:37:40 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:37:40 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:37:40 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=8781MB free_disk=25.28565216064453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:37:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:37:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:37:40 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Instance 85957527-c73a-4654-838e-5ff79e3730fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72444) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 03 05:37:40 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:37:40 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:37:40 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Refreshing inventories for resource provider b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 03 05:37:40 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Updating ProviderTree inventory for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 03 05:37:40 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Updating inventory in ProviderTree for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 03 05:37:40 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Refreshing aggregate associations for resource provider b624a913-bb6b-4a17-8cd7-7b0950cff161, aggregates: None {{(pid=72444) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 03 05:37:40 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Refreshing trait associations for resource provider b624a913-bb6b-4a17-8cd7-7b0950cff161, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=72444) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 03 05:37:40 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:37:40 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:37:40 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:37:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.326s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:37:41 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:37:41 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:37:44 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:37:46 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:37:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:37:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:37:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:37:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:37:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:37:51 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:37:52 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:37:53 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:37:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:37:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:37:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:37:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:37:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:37:56 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:38:01 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:38:06 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:38:11 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:38:16 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:38:21 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:38:26 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:38:29 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:38:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:38:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:38:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:38:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:38:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:38:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:38:31 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:38:33 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:38:33 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 05:38:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:38:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5c325d82-adf4-4f96-87fb-f05b6dbc5121 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Acquiring lock "85957527-c73a-4654-838e-5ff79e3730fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:38:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5c325d82-adf4-4f96-87fb-f05b6dbc5121 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "85957527-c73a-4654-838e-5ff79e3730fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:38:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5c325d82-adf4-4f96-87fb-f05b6dbc5121 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Acquiring lock "85957527-c73a-4654-838e-5ff79e3730fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:38:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5c325d82-adf4-4f96-87fb-f05b6dbc5121 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "85957527-c73a-4654-838e-5ff79e3730fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:38:36 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5c325d82-adf4-4f96-87fb-f05b6dbc5121 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "85957527-c73a-4654-838e-5ff79e3730fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:38:36 user nova-compute[72444]: INFO nova.compute.manager [None req-5c325d82-adf4-4f96-87fb-f05b6dbc5121 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Terminating instance
Aug 03 05:38:36 user nova-compute[72444]: DEBUG nova.compute.manager [None req-5c325d82-adf4-4f96-87fb-f05b6dbc5121 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Start destroying the instance on the hypervisor. {{(pid=72444) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 03 05:38:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:38:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:38:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:38:36 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:38:36 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:38:37 user nova-compute[72444]: DEBUG nova.compute.manager [req-69bf94f5-4a3a-421d-893c-ab7afec6eb18 req-e8c38e6d-f78e-456b-b1da-1fa72b52c367 service nova] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Received event network-vif-unplugged-984e9dde-06d9-4b08-81e2-dd3144e6f33b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:38:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-69bf94f5-4a3a-421d-893c-ab7afec6eb18 req-e8c38e6d-f78e-456b-b1da-1fa72b52c367 service nova] Acquiring lock "85957527-c73a-4654-838e-5ff79e3730fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:38:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-69bf94f5-4a3a-421d-893c-ab7afec6eb18 req-e8c38e6d-f78e-456b-b1da-1fa72b52c367 service nova] Lock "85957527-c73a-4654-838e-5ff79e3730fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:38:37 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-69bf94f5-4a3a-421d-893c-ab7afec6eb18 req-e8c38e6d-f78e-456b-b1da-1fa72b52c367 service nova] Lock "85957527-c73a-4654-838e-5ff79e3730fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:38:37 user nova-compute[72444]: DEBUG nova.compute.manager [req-69bf94f5-4a3a-421d-893c-ab7afec6eb18 req-e8c38e6d-f78e-456b-b1da-1fa72b52c367 service nova] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] No waiting events found dispatching network-vif-unplugged-984e9dde-06d9-4b08-81e2-dd3144e6f33b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:38:37 user nova-compute[72444]: DEBUG nova.compute.manager [req-69bf94f5-4a3a-421d-893c-ab7afec6eb18 req-e8c38e6d-f78e-456b-b1da-1fa72b52c367 service nova] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Received event network-vif-unplugged-984e9dde-06d9-4b08-81e2-dd3144e6f33b for instance with task_state deleting. {{(pid=72444) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 03 05:38:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:38:37 user nova-compute[72444]: INFO nova.virt.libvirt.driver [-] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Instance destroyed successfully.
Aug 03 05:38:37 user nova-compute[72444]: DEBUG nova.objects.instance [None req-5c325d82-adf4-4f96-87fb-f05b6dbc5121 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lazy-loading 'resources' on Instance uuid 85957527-c73a-4654-838e-5ff79e3730fd {{(pid=72444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 03 05:38:37 user nova-compute[72444]: DEBUG nova.virt.libvirt.vif [None req-5c325d82-adf4-4f96-87fb-f05b6dbc5121 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-03T05:31:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1363968104',display_name='tempest-SnapshotDataIntegrityTests-server-1363968104',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1363968104',id=52,image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImJdq5wIqWICLn4pNJWRG+vXZAF7PMDTpGJfsyAyjeTHhD4gFrv3nfqvtEMGRB9msFidVTUo7uSnJqxXbSH5rhqIiJkGRjmpPImdO/XJ25T2Z562AziYwLygamV6w7gvw==',key_name='tempest-keypair-2060532131',keypairs=<?>,launch_index=0,launched_at=2023-08-03T05:31:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b621a7d2de94a68a8547cf100467d11',ramdisk_id='',reservation_id='r-iouz8kn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a69e530-bd68-45b7-bffb-f7168139ceb0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1218323093',owner_user_name='tempest-SnapshotDataIntegrityTests-1218323093-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-03T05:31:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14a4d925374649e19061ee3ac2c203de',uuid=85957527-c73a-4654-838e-5ff79e3730fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "984e9dde-06d9-4b08-81e2-dd3144e6f33b", "address": "fa:16:3e:cd:e9:d9", "network": {"id": "27e1a858-dcc9-4e04-a87b-a5659d8cb355", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1432430230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b621a7d2de94a68a8547cf100467d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap984e9dde-06", "ovs_interfaceid": "984e9dde-06d9-4b08-81e2-dd3144e6f33b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 03 05:38:37 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-5c325d82-adf4-4f96-87fb-f05b6dbc5121 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Converting VIF {"id": "984e9dde-06d9-4b08-81e2-dd3144e6f33b", "address": "fa:16:3e:cd:e9:d9", "network": {"id": "27e1a858-dcc9-4e04-a87b-a5659d8cb355", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1432430230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b621a7d2de94a68a8547cf100467d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap984e9dde-06", "ovs_interfaceid": "984e9dde-06d9-4b08-81e2-dd3144e6f33b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 03 05:38:37 user nova-compute[72444]: DEBUG nova.network.os_vif_util [None req-5c325d82-adf4-4f96-87fb-f05b6dbc5121 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:e9:d9,bridge_name='br-int',has_traffic_filtering=True,id=984e9dde-06d9-4b08-81e2-dd3144e6f33b,network=Network(27e1a858-dcc9-4e04-a87b-a5659d8cb355),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap984e9dde-06') {{(pid=72444) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 03 05:38:37 user nova-compute[72444]: DEBUG os_vif [None req-5c325d82-adf4-4f96-87fb-f05b6dbc5121 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:e9:d9,bridge_name='br-int',has_traffic_filtering=True,id=984e9dde-06d9-4b08-81e2-dd3144e6f33b,network=Network(27e1a858-dcc9-4e04-a87b-a5659d8cb355),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap984e9dde-06') {{(pid=72444) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 03 05:38:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:38:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap984e9dde-06, bridge=br-int, if_exists=True) {{(pid=72444) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 03 05:38:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:38:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:38:37 user nova-compute[72444]: INFO os_vif [None req-5c325d82-adf4-4f96-87fb-f05b6dbc5121 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:e9:d9,bridge_name='br-int',has_traffic_filtering=True,id=984e9dde-06d9-4b08-81e2-dd3144e6f33b,network=Network(27e1a858-dcc9-4e04-a87b-a5659d8cb355),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap984e9dde-06')
Aug 03 05:38:37 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-5c325d82-adf4-4f96-87fb-f05b6dbc5121 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Deleting instance files /opt/stack/data/nova/instances/85957527-c73a-4654-838e-5ff79e3730fd_del
Aug 03 05:38:37 user nova-compute[72444]: INFO nova.virt.libvirt.driver [None req-5c325d82-adf4-4f96-87fb-f05b6dbc5121 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Deletion of /opt/stack/data/nova/instances/85957527-c73a-4654-838e-5ff79e3730fd_del complete
Aug 03 05:38:37 user nova-compute[72444]: INFO nova.compute.manager [None req-5c325d82-adf4-4f96-87fb-f05b6dbc5121 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 03 05:38:37 user nova-compute[72444]: DEBUG oslo.service.loopingcall [None req-5c325d82-adf4-4f96-87fb-f05b6dbc5121 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72444) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 03 05:38:37 user nova-compute[72444]: DEBUG nova.compute.manager [-] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Deallocating network for instance {{(pid=72444) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 03 05:38:37 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] deallocate_for_instance() {{(pid=72444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 03 05:38:38 user nova-compute[72444]: DEBUG nova.network.neutron [-] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Updating instance_info_cache with network_info: [] {{(pid=72444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 03 05:38:38 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Took 1.00 seconds to deallocate network for instance.
Aug 03 05:38:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5c325d82-adf4-4f96-87fb-f05b6dbc5121 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:38:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5c325d82-adf4-4f96-87fb-f05b6dbc5121 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:38:38 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-5c325d82-adf4-4f96-87fb-f05b6dbc5121 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:38:38 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-5c325d82-adf4-4f96-87fb-f05b6dbc5121 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:38:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5c325d82-adf4-4f96-87fb-f05b6dbc5121 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.116s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:38:38 user nova-compute[72444]: INFO nova.scheduler.client.report [None req-5c325d82-adf4-4f96-87fb-f05b6dbc5121 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Deleted allocations for instance 85957527-c73a-4654-838e-5ff79e3730fd
Aug 03 05:38:38 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-5c325d82-adf4-4f96-87fb-f05b6dbc5121 tempest-SnapshotDataIntegrityTests-1218323093 tempest-SnapshotDataIntegrityTests-1218323093-project-member] Lock "85957527-c73a-4654-838e-5ff79e3730fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.181s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:38:38 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:38:38 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:38:38 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Rebuilding the list of instances to heal {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 05:38:38 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Didn't find any instances for network info cache update. {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 03 05:38:39 user nova-compute[72444]: DEBUG nova.compute.manager [req-833241d4-2d86-4415-a3aa-dc84113efe74 req-f7785706-a3aa-4c11-895a-ec46ad009ffe service nova] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Received event network-vif-plugged-984e9dde-06d9-4b08-81e2-dd3144e6f33b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:38:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-833241d4-2d86-4415-a3aa-dc84113efe74 req-f7785706-a3aa-4c11-895a-ec46ad009ffe service nova] Acquiring lock "85957527-c73a-4654-838e-5ff79e3730fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:38:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-833241d4-2d86-4415-a3aa-dc84113efe74 req-f7785706-a3aa-4c11-895a-ec46ad009ffe service nova] Lock "85957527-c73a-4654-838e-5ff79e3730fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:38:39 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [req-833241d4-2d86-4415-a3aa-dc84113efe74 req-f7785706-a3aa-4c11-895a-ec46ad009ffe service nova] Lock "85957527-c73a-4654-838e-5ff79e3730fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:38:39 user nova-compute[72444]: DEBUG nova.compute.manager [req-833241d4-2d86-4415-a3aa-dc84113efe74 req-f7785706-a3aa-4c11-895a-ec46ad009ffe service nova] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] No waiting events found dispatching network-vif-plugged-984e9dde-06d9-4b08-81e2-dd3144e6f33b {{(pid=72444) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 03 05:38:39 user nova-compute[72444]: WARNING nova.compute.manager [req-833241d4-2d86-4415-a3aa-dc84113efe74 req-f7785706-a3aa-4c11-895a-ec46ad009ffe service nova] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Received unexpected event network-vif-plugged-984e9dde-06d9-4b08-81e2-dd3144e6f33b for instance with vm_state deleted and task_state None.
Aug 03 05:38:39 user nova-compute[72444]: DEBUG nova.compute.manager [req-833241d4-2d86-4415-a3aa-dc84113efe74 req-f7785706-a3aa-4c11-895a-ec46ad009ffe service nova] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Received event network-vif-deleted-984e9dde-06d9-4b08-81e2-dd3144e6f33b {{(pid=72444) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 03 05:38:39 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:38:39 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:38:40 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:38:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:38:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:38:40 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:38:40 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:38:41 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:38:41 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:38:41 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=8911MB free_disk=25.31277847290039GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:38:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:38:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:38:41 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:38:41 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:38:41 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:38:41 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:38:41 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:38:41 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:38:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:38:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:38:47 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:38:51 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:38:52 user nova-compute[72444]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691041117.3770077, 85957527-c73a-4654-838e-5ff79e3730fd => Stopped> {{(pid=72444) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 03 05:38:52 user nova-compute[72444]: INFO nova.compute.manager [-] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] VM Stopped (Lifecycle Event)
Aug 03 05:38:52 user nova-compute[72444]: DEBUG nova.compute.manager [None req-c8ffa7a8-4ca1-4def-ae40-484b33af896c None None] [instance: 85957527-c73a-4654-838e-5ff79e3730fd] Checking state {{(pid=72444) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 03 05:38:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:38:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:38:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:38:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:38:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:38:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:38:57 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:39:02 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:39:07 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:39:12 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:39:17 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:39:22 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:39:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:39:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:39:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:39:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:39:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:39:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:39:27 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:39:30 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:39:31 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:39:32 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:39:33 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:39:33 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:39:33 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72444) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 03 05:39:34 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:39:37 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:39:38 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:39:39 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:39:40 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:39:40 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Starting heal instance info cache {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 03 05:39:40 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Rebuilding the list of instances to heal {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 03 05:39:40 user nova-compute[72444]: DEBUG nova.compute.manager [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Didn't find any instances for network info cache update. {{(pid=72444) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 03 05:39:40 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:39:42 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:39:42 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:39:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:39:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:39:42 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:39:42 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Auditing locally available compute resources for user (node: user) {{(pid=72444) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 03 05:39:43 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:39:43 user nova-compute[72444]: WARNING nova.virt.libvirt.driver [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 03 05:39:43 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Hypervisor/Node resource view: name=user free_ram=9025MB free_disk=25.311599731445312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72444) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 03 05:39:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 03 05:39:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 03 05:39:43 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 03 05:39:43 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72444) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 03 05:39:43 user nova-compute[72444]: DEBUG nova.compute.provider_tree [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed in ProviderTree for provider: b624a913-bb6b-4a17-8cd7-7b0950cff161 {{(pid=72444) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 03 05:39:43 user nova-compute[72444]: DEBUG nova.scheduler.client.report [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Inventory has not changed for provider b624a913-bb6b-4a17-8cd7-7b0950cff161 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72444) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 03 05:39:43 user nova-compute[72444]: DEBUG nova.compute.resource_tracker [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Compute_service record updated for user:user {{(pid=72444) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 03 05:39:43 user nova-compute[72444]: DEBUG oslo_concurrency.lockutils [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.335s {{(pid=72444) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 03 05:39:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:39:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:39:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:39:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:39:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:39:47 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:39:49 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:39:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:39:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 03 05:39:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72444) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 03 05:39:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:39:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72444) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 03 05:39:52 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 03 05:39:55 user nova-compute[72444]: DEBUG oslo_service.periodic_task [None req-85d4379a-3a45-42f7-b84d-d6e4b2534956 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72444) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 03 05:39:57 user nova-compute[72444]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72444) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}